containers/ramalama

Implement whisper.cpp

Open

#51 创建于 2024年8月21日

在 GitHub 查看
 (40 评论) (1 反应) (1 负责人)Python (341 fork)github user discovery
enhancementgood first issue

仓库指标

Star
 (2,873 star)
PR 合并指标
 (PR 指标待抓取)

描述

If there is a way to auto-detect between language model files and asr model files. We should do that, or if that's not possible we should just use a runtime flag, so some options for the runtime flag would be:

ramalama --runtime vllm
ramalama --runtime llama.cpp
ramalama --runtime whisper.cpp

贡献者指南