ggml-org/whisper.cpp

Add ability to limit auto-detection to a subset of languages

Open

Aperta il 2 set 2023

Vedi su GitHub
 (5 commenti) (3 reazioni) (0 assegnatari)C++ (49.693 star) (5535 fork)batch import
enhancementgood first issue

Descrizione

From what I can tell, auto-detection simply picks the language with the highest probability score. Sometimes, I know the language could only be 1 out of 5 possible languages. In such cases, it would be useful to be able to specify the possible languages, to improve the likelyhood of the auto-detection picking the correct language.

Guida contributor

Tech stack
cpp
Dominio
machine learningaibackend
Tipo issue
feature
DifficoltàQuanto dovrebbe essere impegnativa per un nuovo contributor.
3
Tempo stimatoTempo stimato per completare e verificare uno scope piccolo.
1-3 hours
Stato attivitàQuanto è probabile che la issue sia ancora attiva e reviewable.
fresh
ChiarezzaQuanto chiaramente la issue descrive problema, scope e risultato atteso.
clear
Prerequisiti
C++whisper.cpp codebaselanguage detection logic
Adatta ai principiantiQuanto la issue è adatta a contributor alla prima esperienza.
35
Direzione di ricerca
First, examine the existing auto detection implementation in whisper.cpp, likely in whisper.cpp or common.cpp, to understand how languages are scored and the highest probability selected. Then, propose a modification to accept a user specified subset of languages (e.g., via an API parameter or environment variable) that filters the candidate languages before scoring. Consider adding a new function or modifying the existing whisper full default params to include a language filter. Test the change with a few languages to ensure detection accuracy improves.