Hacktoberfest 2026:维护者为十月标记出来的 issue,仍然开放、适合新手。 浏览 Hacktoberfest issue

Split `forgelm/ingestion.py` into a sub-package (`_readers`, `_chunkers`, `_pipeline`) — deferred until the next change that adds a reader or a chunker

未关闭
#905 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
4/5
预计耗时
3-5 天
新手友好度
25/100
Issue 类型
重构
描述清晰度
基本清楚
活跃度
活跃
技术栈
python
领域
data

调研方向

Start with forgelm/ingestion.py and the _DEFERRED_SPLITS entry in tools/check_module_size.py, then read the deferral row in docs/roadmap/risks-and-decisions.md around line 80. The split must keep every public name importable from its current path, and test patch targets that named the old module need retargeting. Done means the module is a sub-package under the normal size ceiling, the deferral row is removed, and the CHANGELOG cites the ID. The issue is deferred until a reader or chunker change lands, so confirm that condition first.

由索引模型根据 Issue 内容生成。

描述

area: ingestion deferred severity: low source: roadmap wave: 4

Deferred work · F-PR29-A1-06 / A1-07 / A1-08: ingestion.py · severity Low · cost ~4-8 h · recorded in docs/roadmap/risks-and-decisions.md:80

Summary

forgelm/ingestion.py is a deferred module split: PDF/DOCX/EPUB/TXT/Markdown readers, chunkers and the SFT-JSONL emitter share one file; the seams are already near-independent, which makes this the highest-value split per hour. The module-size guard holds it to a fatal no-growth budget, but nothing pays the debt down until someone takes the split.

Condition or budget

The next change that adds a reader or a chunker

State today (re-checked 2026-10-09)

2110 code lines against a budget of 2110 (1443 at PR #29).

Related

#667 and #668 track how the module-size guard counts lines and accepts budget raises; decide them before relying on a module's budget.

Acceptance criteria

  • The module becomes a sub-package along the recorded seams, behaviour-neutral, with every public name still importable from its current path.
  • Its _DEFERRED_SPLITS entry is removed from tools/check_module_size.py and every resulting module is under the normal ceiling.
  • Test patch targets that named the old module are retargeted to the module that resolves the name at call time (the forgelm/verify.py split found five that silently moved).
  • The row is removed from the deferral table and the CHANGELOG names its ID (the table's removal contract).

Recorded in docs/roadmap/risks-and-decisions.md (read at f94595f) and re-checked against the code on 2026-10-09. The row leaves that table only when the fix is on main, the CHANGELOG names its ID and any promised guard exists.

主要语言
Python
星标
9
派生
1
平均合并
9 小时 14 分钟
30 天内合并 PR
37

环境准备

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

HodeTech/ForgeLM 的其他 Issue

查看 HodeTech/ForgeLM 的全部 Issue

相似的 Issue

更多 Python Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。