higress-group/higress

[HEP] Support More LLM Providers

Ouverte

#940 ouverte le 15 mai 2024

 (6 commentaires) (1 réaction) (1 personne assignée)Go (1 219 forks)github user discovery
area/plugingood first issuehelp wantedkind/HEPlevel/normalpriority/highsig/wasmtype/enhancement

Métriques du dépôt

Stars
 (9 036 étoiles)
Métriques de merge PR
 (Merge moyen 7j 9h) (18 PRs mergées en 30 j)

Description

背景

最近 Higress 上线了一个新的 Wasm 插件,AI 代理(ai-proxy),支持对接各类 AI 大模型服务提供商,并以统一的 OpenAI 接口契约对外提供服务。目前已支持 OpenAI、Azure OpenAI、通义千问(Qwen)和月之暗面(Moonshot)。

为了进一步扩展该插件的功能,我们需要对接更多的 AI 大模型服务提供商。欢迎大家积极参与本项任务。感兴趣的同学可以在对应的子 issue 下留言认领。

待对接服务提供商

  • #2744
  • #1695
  • #1696
  • #1697
  • #1698
  • #1642
  • #954
  • #944
  • #952
  • #941
  • #956
  • #947
  • #945
  • #946
  • #948
  • #949
  • #950
  • #951
  • #953
  • #955
  • #957
  • #958
  • #959
  • #960
  • #961
  • #962
  • #963
  • #964

参考文档


background

Recently, Higress launched a new Wasm plug-in, AI proxy (ai-proxy), which supports connecting with various AI big model service providers and provides services to the outside world with a unified OpenAI interface contract. Currently, OpenAI, Azure OpenAI, Qwen and Moonshot are supported.

In order to further expand the functionality of this plug-in, we need to connect with more AI big model service providers. Everyone is welcome to actively participate in this task. Interested students can leave a message under the corresponding sub issue to claim.

To be connected to the service provider

  • #2744
  • #1695
  • #1696
  • #1697
  • #1698
  • #1642
  • #954
  • #944
  • #952
  • #941
  • #956
  • #947
  • #945
  • #946
  • #948
  • #949
  • #950
  • #951
  • #953
  • #955
  • #957
  • #958
  • #959
  • #960
  • #961
  • #962
  • #963
  • #964

Reference Document

Guide contributeur