amumu96/inferencePython
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
(0 stars) (0 forks) (0 件の索引済み issue) (0 件のオープンな good first issue)