Feature request: whisper.cpp in a library (with a .Net wrapper)
#303 创建于 2022年12月21日
仓库指标
- Star
- (49,693 star)
- PR 合并指标
- (平均合并 5天 20小时) (30 天内合并 36 个 PR)
描述
This is a kind of multi-application feature request.
I used whisper.cpp "through" SubtitleEdit (https://github.com/SubtitleEdit/subtitleedit).
While using SubtitleEdit/whisper.cpp, I had good results by translating subtitles individually. In short, I selected 5 or 6 subtitles and chose "translate with whisper", SubtitleEdit extracted the audio in small files (3-4 seconds each) and it was then translated by whisper.cpp. It gave good results but, right now, it's really slow because there is a big overhead of reading the 2.8G model each time.
Could a library version of "whisper.cpp" be created? The library could then be loaded in memory of SubtitleEdit (maybe with a .Net wrapper), and the model could be loaded once, and used for multiple translations.
In short, the goal is to find a way to load the model only once and be able to rapidly translate multiple small files.
Note: If I find the time, I might try to develop it myself and create a PullRequest for whisper.cpp and SubtitleEdit but I wanted to put the idea here first.