Feature request: openai_compatible API_TYPE so any OpenAI-compatible endpoint works with no service class

Abierto
  • ¿Algo no está bien?
#369 0 comentarios 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
3/5
Tiempo estimado
1-2 días
Aptitud para principiantes
58/100
Tipo de issue
Nueva funcionalidad
Claridad
Bastante claro
Estado de actividad
Activo
Stack tecnológico
python
Área
backend

Línea de trabajo

Start by reading the custom-model path in the agents.yaml config and the model factory where service classes are registered (ufo/config and ufo/llm or similar module). Trace how API_BASE, API_KEY, and API_MODEL flow into an existing OpenAI-style service class, then add an openai_compatible API_TYPE that reuses it with no code required. Done means HOST_AGENT and APP_AGENT can point at any OpenAI-compatible endpoint purely via config.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

Hi — I run DemonRoute (demonroute.com), an OpenAI-compatible API at https://api.demonroute.com/v1.

I will be direct about why I am here: we are talking to a lot of projects, because there is no large established provider for no-subscription, anonymous API keys for open-weight uncensored models. We are earning distribution one repo at a time.

UFO is a case where the current path is close but not quite open. Today the custom-model route in agents.yaml takes API_BASE, API_KEY, and API_MODEL, but using it still means writing a Python service class and registering it in the model factory. That is a real barrier for anyone who just wants to point HOST_AGENT or APP_AGENT at an OpenAI-compatible endpoint.

The feature ask: add an openai_compatible API_TYPE that sends standard chat-completions requests to API_BASE with API_KEY and API_MODEL, no code required. That would make any OpenAI-compatible provider work out of the box, DemonRoute included.

Why it matters for UFO users: every desktop step is an LLM call with screenshots attached, so cost adds up fast, and your own docs flag cost optimization. We carry Dolphin, MythoMax, Hermes, and abliterated Llama/Qwen builds that handle adversarial automation tasks without refusing, and we never train on user content. Nothing on a user's screen is ever used to train a model.

Who is behind it: during the NFT peak I became the largest NFT artist on the third-largest chain in the world, overnight, with zero funding. That turned into consulting for Fortune 500s, celebrities, and emerging tech companies. I run everything under NFT Demon Holdings LLC, and DemonRoute is my passion priority.

Reciprocal: any app that lists DemonRoute as a provider option gets listed on demonroute.com/integrations.

Jeremy, DemonRoute

Lenguaje dominante
Python
Estrellas
10.2k
Forks
1.1k
Merge medio
1 min
PR fusionados (30 d)
1

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de microsoft/UFO

Todos los issues de microsoft/UFO

Issues similares

Más issues de Python

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.