ggml-org/whisper.cpp

Feature request: whisper.cpp in a library (with a .Net wrapper)

Open

#303 opened on 2022年12月21日

GitHub で見る
 (6 comments) (0 reactions) (0 assignees)C++ (5,535 forks)batch import
bindingshelp wanted

Repository metrics

Stars
 (49,693 stars)
PR merge metrics
 (平均マージ 5d 20h) (30d で 36 merged PRs)

説明

This is a kind of multi-application feature request.

I used whisper.cpp "through" SubtitleEdit (https://github.com/SubtitleEdit/subtitleedit).

While using SubtitleEdit/whisper.cpp, I had good results by translating subtitles individually. In short, I selected 5 or 6 subtitles and chose "translate with whisper", SubtitleEdit extracted the audio in small files (3-4 seconds each) and it was then translated by whisper.cpp. It gave good results but, right now, it's really slow because there is a big overhead of reading the 2.8G model each time.

Could a library version of "whisper.cpp" be created? The library could then be loaded in memory of SubtitleEdit (maybe with a .Net wrapper), and the model could be loaded once, and used for multiple translations.

In short, the goal is to find a way to load the model only once and be able to rapidly translate multiple small files.

Note: If I find the time, I might try to develop it myself and create a PullRequest for whisper.cpp and SubtitleEdit but I wanted to put the idea here first.

コントリビューターガイド