Hacktoberfest 2026: the issues maintainers tagged for October, open and beginner-friendly. Browse Hacktoberfest issues

Split `forgelm/ingestion.py` into a sub-package (`_readers`, `_chunkers`, `_pipeline`) — deferred until the next change that adds a reader or a chunker

Open
  • Is something wrong?
#905 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
25/100
Issue type
Refactor
Clarity
Mostly clear
Activity status
Active
Tech stack
python
Domain
data

Research direction

Start with forgelm/ingestion.py and the _DEFERRED_SPLITS entry in tools/check_module_size.py, then read the deferral row in docs/roadmap/risks-and-decisions.md around line 80. The split must keep every public name importable from its current path, and test patch targets that named the old module need retargeting. Done means the module is a sub-package under the normal size ceiling, the deferral row is removed, and the CHANGELOG cites the ID. The issue is deferred until a reader or chunker change lands, so confirm that condition first.

Written by the indexing model from the issue text.

Description

area: ingestion deferred severity: low source: roadmap wave: 4

Deferred work · F-PR29-A1-06 / A1-07 / A1-08: ingestion.py · severity Low · cost ~4-8 h · recorded in docs/roadmap/risks-and-decisions.md:80

Summary

forgelm/ingestion.py is a deferred module split: PDF/DOCX/EPUB/TXT/Markdown readers, chunkers and the SFT-JSONL emitter share one file; the seams are already near-independent, which makes this the highest-value split per hour. The module-size guard holds it to a fatal no-growth budget, but nothing pays the debt down until someone takes the split.

Condition or budget

The next change that adds a reader or a chunker

State today (re-checked 2026-10-09)

2110 code lines against a budget of 2110 (1443 at PR #29).

Related

#667 and #668 track how the module-size guard counts lines and accepts budget raises; decide them before relying on a module's budget.

Acceptance criteria

  • The module becomes a sub-package along the recorded seams, behaviour-neutral, with every public name still importable from its current path.
  • Its _DEFERRED_SPLITS entry is removed from tools/check_module_size.py and every resulting module is under the normal ceiling.
  • Test patch targets that named the old module are retargeted to the module that resolves the name at call time (the forgelm/verify.py split found five that silently moved).
  • The row is removed from the deferral table and the CHANGELOG names its ID (the table's removal contract).

Recorded in docs/roadmap/risks-and-decisions.md (read at f94595f) and re-checked against the code on 2026-10-09. The row leaves that table only when the fix is on main, the CHANGELOG names its ID and any promised guard exists.

Dominant language
Python
Stars
9
Forks
1
Avg merge
8h 10m
Merged PRs (30d)
5

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from HodeTech/ForgeLM

All issues in HodeTech/ForgeLM

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.