containers/ramalama

Implement whisper.cpp

オープン

#51 opened on 2024/08/21

 (40 件のコメント) (1 件のリアクション) (1 人の担当者)Python (356 件のフォーク)github user discovery
enhancementgood first issue

Repository metrics

Stars
 (3,010 個のスター)
PR merge metrics
 (平均マージ 6d 7h) (30d で 32 merged PRs)

説明

If there is a way to auto-detect between language model files and asr model files. We should do that, or if that's not possible we should just use a runtime flag, so some options for the runtime flag would be:

ramalama --runtime vllm
ramalama --runtime llama.cpp
ramalama --runtime whisper.cpp

コントリビューターガイド