containers/ramalama

Implement whisper.cpp

Offen

#51 geöffnet am 21.08.2024

 (40 Kommentare) (1 Reaktion) (1 zugewiesene Person)Python (357 Forks)github user discovery
enhancementgood first issue

Repository-Metriken

Stars
 (3.013 Sterne)
PR-Merge-Metriken
 (Durchschn. Merge 6T 7h) (32 gemergte PRs in 30 T)

Beschreibung

If there is a way to auto-detect between language model files and asr model files. We should do that, or if that's not possible we should just use a runtime flag, so some options for the runtime flag would be:

ramalama --runtime vllm
ramalama --runtime llama.cpp
ramalama --runtime whisper.cpp

Contributor Guide