higress-group/higress

[HEP] Support More LLM Providers

Offen

#940 geöffnet am 15.05.2024

 (6 Kommentare) (1 Reaktion) (1 zugewiesene Person)Go (1.219 Forks)github user discovery
area/plugingood first issuehelp wantedkind/HEPlevel/normalpriority/highsig/wasmtype/enhancement

Repository-Metriken

Stars
 (9.036 Sterne)
PR-Merge-Metriken
 (Durchschn. Merge 7T 9h) (18 gemergte PRs in 30 T)

Beschreibung

背景

最近 Higress 上线了一个新的 Wasm 插件,AI 代理(ai-proxy),支持对接各类 AI 大模型服务提供商,并以统一的 OpenAI 接口契约对外提供服务。目前已支持 OpenAI、Azure OpenAI、通义千问(Qwen)和月之暗面(Moonshot)。

为了进一步扩展该插件的功能,我们需要对接更多的 AI 大模型服务提供商。欢迎大家积极参与本项任务。感兴趣的同学可以在对应的子 issue 下留言认领。

待对接服务提供商

  • #2744
  • #1695
  • #1696
  • #1697
  • #1698
  • #1642
  • #954
  • #944
  • #952
  • #941
  • #956
  • #947
  • #945
  • #946
  • #948
  • #949
  • #950
  • #951
  • #953
  • #955
  • #957
  • #958
  • #959
  • #960
  • #961
  • #962
  • #963
  • #964

参考文档


background

Recently, Higress launched a new Wasm plug-in, AI proxy (ai-proxy), which supports connecting with various AI big model service providers and provides services to the outside world with a unified OpenAI interface contract. Currently, OpenAI, Azure OpenAI, Qwen and Moonshot are supported.

In order to further expand the functionality of this plug-in, we need to connect with more AI big model service providers. Everyone is welcome to actively participate in this task. Interested students can leave a message under the corresponding sub issue to claim.

To be connected to the service provider

  • #2744
  • #1695
  • #1696
  • #1697
  • #1698
  • #1642
  • #954
  • #944
  • #952
  • #941
  • #956
  • #947
  • #945
  • #946
  • #948
  • #949
  • #950
  • #951
  • #953
  • #955
  • #957
  • #958
  • #959
  • #960
  • #961
  • #962
  • #963
  • #964

Reference Document

Contributor Guide