ggml-org/whisper.cpp

can I enable "-dl" option and detect multiple languages (in one audio-clip)? Thanks!

Open

#3,018 创建于 2025年4月8日

在 GitHub 查看
 (2 评论) (0 反应) (0 负责人)C++ (49,693 star) (5,535 fork)batch import
enhancementgood first issue

描述

Hi,

I could run whisper-cli to detect language and it works great (as the following): whisper-cli -f ./jfk.wav -dl --model ./ggml-small.bin

it works great and I could get the auto-detected language (like the following)::

...
whisper_full_with_state: auto-detected language: en (p = 0.958143)
...

my question is: can I also use the same "-dl" option to detect a wav-file which has multiple languages? in this case will whisper-cli show 2 language-types (similar as the above, but show 2 language-types)? Thanks!

贡献者指南

技术栈
cpp
领域
climachine learning
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
over 1 week
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
fresh
清晰度议题是否清楚说明期望改动、验收标准和下一步。
clear
前置要求
C++whisper.cpp build process
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
15
研究方向
The issue asks whether the dl flag can detect multiple languages in a single audio clip. To answer, investigate the current language detection implementation in whisper.cpp, specifically the `whisper full with state` function and how the dl flag triggers detection. Check if the model supports per segment language detection or only per clip. Consider examining the documentation and existing PRs or discussions about multi language support. A potential solution might involve modifying the CLI to output detected languages per segment or adding a new option.