SylphAI-Inc/AdalFlow

LitServe Integration

Offen

#290 geöffnet am 30.11.2024

 (1 Kommentar) (0 Reaktionen) (0 zugewiesene Personen)Python (387 Forks)github user discovery
[adalflow] suggest integrationhelp wanted

Repository-Metriken

Stars
 (4.209 Sterne)
PR-Merge-Metriken
 (Keine gemergten PRs in 30 T)

Beschreibung

Description & Motivation

Litserve is one of the model that can serve more optimized performance more than vLLM and oLLama

Pitch

Integration of LitServe like oLlama

Alternatives

No response

Additional context

Consider this issue if you find usefull

Contributor Guide