A podcast refuses on a tight machine rather than voicing at a smaller chunk
维护者通常 1 天内回复
@Yogi-cy 已经在做这个了。
开始于 2026年10月5日。
评估
调研方向
Read the audio.cpp request and session options first to establish how chunk size is configured, then trace check_voicing_memory() in memory.py through _wait_for_memory() and _voice_each() in speech.py. Start with a failing test in test_speech.py; handle models with no chunk_steps and update the catalog documentation. Verify real-model behavior with test_audiocpp_voicing.py and listen to a two-speaker podcast at each enabled step.
由索引模型根据 Issue 内容生成。
描述
The gap
docs/architecture/local-models/catalog.md lists this under Known gaps:
The
audioblock'schunk_stepsare committed but nothing reads them: short of memory at the default chunk, a podcast refuses rather than stepping down, until a listening test clears the smaller chunks.
Why it matters
Kokoro peaks at 2,347 MB while voicing at the default chunk, and at 1,442 MB at 120 characters and 956 MB at 60. Those numbers were measured on audio.cpp v0.8.2, reviewed and committed. A machine with two and a half gigabytes free is refused a podcast it could produce at half the memory, and the refusal instead suggests a different, lighter model — a worse answer than the same model voicing more slowly.
The manifest rule this page states is that an entry carries only fields some engine reads, precisely so nothing is reviewed and trusted while doing nothing. chunk_steps has been that field since it was added, and the memory check is one argument away from using it.
Where
surfsense_local/backend/modules/llm/providers/audiocpp/memory.py—check_voicing_memory(), which takes a singlepeak_mband raises. This is the decision point, andothersalready shows the shape of "here is a smaller thing that fits".surfsense_local/backend/modules/llm/providers/audiocpp/speech.py—_wait_for_memory()is the only caller, and_voice_each()builds the request. Note that the body today ismodel,input,voiceand sometimeslanguage: nothing tells audio.cpp what chunk size to use, so finding that knob is part of this work — it is either a request field the server accepts or a session option inserver.json, and which one it is has to be established against audio.cpp before the rest is worth writing.surfsense_local/backend/modules/llm/catalog/local/engines/audiocpp/manifest_fields.py—ChunkStepandAudioDefaults.chunk_steps, already validated and already committed.surfsense_local/backend/modules/llm/catalog/local/engines/audiocpp/audio_folder/server_config.py—_entry(), where a per-model session option would go if that is where the knob lives.surfsense_local/backend/scripts/local_manifest/entries.py— the committed steps. Kokoro and Kitten have them; Supertonic has none, so the code has to handle a model with nothing to step down to.
What done looks like
- A machine short of memory at the default chunk voices at the largest committed step that fits, rather than refusing, and a model with no steps still refuses with the sentence it gives today.
- The refusal, when it comes, accounts for the smallest step, not the default peak — otherwise the numbers in the message are wrong.
- The listening test is part of this issue, not a follow-up. Voice a two-speaker podcast at each step you enable and confirm the audio holds up; say in the PR what you listened to and on which audio.cpp build. A step that degrades the audio should not be enabled however well it fits.
- Delete the Known gaps line from
docs/architecture/local-models/catalog.mdin the same PR, and update thechunk_stepsbullet under The manifest so it describes a field that is read.
How to verify
surfsense_local/backend/tests/unit/llm/providers/audiocpp/test_speech.py drives voicing against a mock transport with an injectable available callable, so every memory branch is a unit test with no audio involved. tests/packaging/test_audiocpp_voicing.py is the real-model harness, gated on SURFSENSE_TEST_AUDIO_MODELS. The repo is TDD: write the failing unit test first.
cd surfsense_local/backend
uv run pytest -m unit
uv run pytest -m integration
uv run ruff check .
Before you start
Read CONTRIBUTING.md, the local model catalog doc and the Studio doc, which owns the podcast job this serves. Say up front whether you can run audio.cpp with a real model; without that the listening test cannot be done and the issue cannot be finished. Open your PR against dev, not main. Comment here to claim this.
- 主要语言
- Python
- 星标
- 16.3k
- 派生
- 1.6k
- 平均合并
- 11 小时 37 分钟
- 30 天内合并 PR
- 261
环境准备
这个项目没有提供开发容器、Dockerfile 或贡献指南,环境需要你自己搭建:先看它的 README,通用步骤见我们的新手贡献指南。
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
MODSetter/SurfSense 的其他 Issue
-
code quality security
难度 2/5 1-3 小时 新手友好度 78/100
维护者通常 1 天内回复
-
desktop
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 1 天内回复
-
desktop security
难度 2/5 1-3 小时 新手友好度 78/100
维护者通常 1 天内回复
-
Write the ADR for chat modes可能已有人在做 关联的 PR 仍在进行中或已合并。 未关闭architecture desktop documentation
难度 2/5 1-3 小时 新手友好度 75/100
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 73/100
维护者通常 1 天内回复
查看 MODSetter/SurfSense 的全部 Issue
相似的 Issue
-
难度 1/5 1 小时以内 新手友好度 72/100
-
[Bug]: Importing weave changes the process-wide locale可能已有人在做 @himanshu748 今天认领。 未关闭bug
难度 2/5 1-3 小时 新手友好度 78/100
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 68/100
-
bug
难度 2/5 1-3 小时 新手友好度 74/100
-
UX
难度 1/5 1 小时以内 新手友好度 72/100
mediajunkie/piper-morgan-product#2008 · 2 条评论 ·