Ingest several sources in parallel
还没有人认领这个 Issue。
评估
调研方向
Start with IngestionManager.process_pending() in gknowledge/core/ingestion.py and run make test to understand the offline tests. Implement configurable concurrent processing for 2–3 sources while keeping offline test behavior deterministic. Confirm the index and overview are rebuilt once after processing completes.
由索引模型根据 Issue 内容生成。
描述
With ChatGPT, ingestion takes about 25 s per short source, one at a time.
Where to look: IngestionManager.process_pending() in gknowledge/core/ingestion.py. The SQLite store is already safe across threads.
Done when: 2–3 sources are processed concurrently (configurable), the index and overview are rebuilt once at the end, and offline mode stays deterministic in tests.
New here? Run make start to open a demo project that restarts on every save, and make test for the core tests. See CONTRIBUTING.md. Comment below to claim the issue.
- 主要语言
- Python
- 星标
- 13
- 派生
- 0
- 平均合并
- 17 分钟
- 30 天内合并 PR
- 4
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
openapi/gknowledge 的其他 Issue
-
area: ui good first issue
难度 2/5 1-3 小时 新手友好度 82/100
openapi/gknowledge#19 ·
-
area: ui good first issue
难度 2/5 1-3 小时 新手友好度 86/100
openapi/gknowledge#13 ·
-
area: ui good first issue
难度 2/5 1-3 小时 新手友好度 88/100
openapi/gknowledge#11 ·
-
area: ui good first issue
难度 2/5 1-3 小时 新手友好度 85/100
openapi/gknowledge#10 ·
-
area: ui good first issue
难度 2/5 1-3 小时 新手友好度 87/100
openapi/gknowledge#8 ·
查看 openapi/gknowledge 的全部 Issue
相似的 Issue
-
md/asciidoc/csv: an explicit `encoding="utf-8"` keeps a leading BOM, the auto-detect path drops it未关闭
难度 2/5 1-3 小时 新手友好度 82/100
docling-project/docling#4846 ·
维护者通常 1 天内回复
-
area/sessions comp/dashboard comp/desktop comp/gateway comp/tui duplicate P2 sweeper:risk-session-state type/bug
难度 2/5 1-3 小时 新手友好度 78/100
NousResearch/hermes-agent#138914 · 1 条评论 ·
维护者通常 1 天内回复
-
bot-triaged module: activation checkpointing module: inductor oncall: pt2 triaged
难度 2/5 1-3 小时 新手友好度 62/100
维护者通常 1 天内回复
-
[oblt-aw][autodoc] Update PR Actions Detective E2E prerequisites and fix dashboard-format table typo未关闭documentation
难度 2/5 1-3 小时 新手友好度 75/100
elastic/oblt-aw#2382 · 1 条评论 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 74/100
维护者通常 1 天内回复