ggml-org/whisper.cpp

Feature request: whisper.cpp in a library (with a .Net wrapper)

Open

#303 创建于 2022年12月21日

在 GitHub 查看
 (6 评论) (0 反应) (0 负责人)C++ (5,535 fork)batch import
bindingshelp wanted

仓库指标

Star
 (49,693 star)
PR 合并指标
 (平均合并 5天 20小时) (30 天内合并 36 个 PR)

描述

This is a kind of multi-application feature request.

I used whisper.cpp "through" SubtitleEdit (https://github.com/SubtitleEdit/subtitleedit).

While using SubtitleEdit/whisper.cpp, I had good results by translating subtitles individually. In short, I selected 5 or 6 subtitles and chose "translate with whisper", SubtitleEdit extracted the audio in small files (3-4 seconds each) and it was then translated by whisper.cpp. It gave good results but, right now, it's really slow because there is a big overhead of reading the 2.8G model each time.

Could a library version of "whisper.cpp" be created? The library could then be loaded in memory of SubtitleEdit (maybe with a .Net wrapper), and the model could be loaded once, and used for multiple translations.

In short, the goal is to find a way to load the model only once and be able to rapidly translate multiple small files.

Note: If I find the time, I might try to develop it myself and create a PullRequest for whisper.cpp and SubtitleEdit but I wanted to put the idea here first.

贡献者指南