containers/ramalama

Implement whisper.cpp

Open

#51 opened on 2024年8月21日

GitHub で見る
 (40 comments) (1 reaction) (1 assignee)Python (341 forks)github user discovery
enhancementgood first issue

Repository metrics

Stars
 (2,873 stars)
PR merge metrics
 (PR metrics pending)

説明

If there is a way to auto-detect between language model files and asr model files. We should do that, or if that's not possible we should just use a runtime flag, so some options for the runtime flag would be:

ramalama --runtime vllm
ramalama --runtime llama.cpp
ramalama --runtime whisper.cpp

コントリビューターガイド