Trend-tracking jq recipe prints evaluation_completed=false as 'n/a', because jq's // operator treats false like null (F-W1-DOCS-TRAIN-16)
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
- 难度
- 1/5
- 预计耗时
- 1-3 小时
- 新手友好度
- 80/100
- Issue 类型
- 文档
- 描述清晰度
- 描述清楚
- 活跃度
- 活跃
- 技术栈
- python
调研方向
有问题的 jq 视图位于 docs/usermanuals/en/evaluation/trend-tracking.md 的第 47 行,土耳其语副本 docs/usermanuals/tr/evaluation/trend-tracking.md 的同一行需要相同的修改。使用 jq 1.7.1 对三个输入 {"evaluation_completed": false}、{"evaluation_completed": true} 和 {} 运行文档中的表达式,以查看当前输出。当三种情况分别输出 false、true 和 n/a,并且两个语言页面在同一次修改中更新时,即为完成。
由索引模型根据 Issue 内容生成。
描述
Wave 4 · group W4 Docs · highest severity Low · 1 finding(s) · effort docs fix
Summary
The page explains that evaluation_completed: false marks a safety run that produced no usable evidence, then gives a jq view that renders the field with .evaluation_completed // "n/a". jq's alternative operator falls back on false as well as null, so exactly the rows the view is meant to expose print as completed=n/a, indistinguishable from older rows that lack the field.
Primary finding
F-W1-DOCS-TRAIN-16 — The trend query hides an explicit evaluation failure as missing telemetry
severity Low · confidence high · reproduced with jq 1.7.1
What happens. docs/usermanuals/en/evaluation/trend-tracking.md:47 and the Turkish mirror at the same line. Rows with evaluation_completed: false do occur: the safety orchestrator sets it when the classifier abstains (forgelm/safety/_orchestrator.py:359-361) and _append_trend_entry writes it to safety_trend.jsonl (forgelm/safety/_results.py:168).
Where.
docs/usermanuals/en/evaluation/trend-tracking.md:47docs/usermanuals/tr/evaluation/trend-tracking.md:47forgelm/safety/_orchestrator.py:359-361forgelm/safety/_results.py:168
Evidence (re-verified on 2026-10-09).
- With jq 1.7.1 the documented expression prints
completed=n/afor{"evaluation_completed": false},completed=truefortrue, andcompleted=n/awhen the field is absent.
Recommended fix. Render the field without the alternative operator, for example completed=\(if .evaluation_completed == null then "n/a" else .evaluation_completed end), which prints true, false and n/a for the three cases.
Acceptance criteria
- The jq view prints
true,falseandn/afor true, false and missing values. - Documentation listed above is corrected in English and in its Turkish mirror in the same PR.
- The finding is resolved or explicitly closed with a reason.
Found by the September 2026 independent review of ForgeLM against commit cab2947 and re-verified against development at f94595f on 2026-10-09. Code links point at cab2947; line numbers may have moved since. Finding IDs (F-W1-…) are stable references for this backlog.
- 主要语言
- Python
- 星标
- 9
- 派生
- 1
- 平均合并
- 10 小时 40 分钟
- 30 天内合并 PR
- 12
环境准备
- 提供 Dockerfile 或 Docker Compose 文件
- 有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
HodeTech/ForgeLM 的其他 Issue
-
area: site bug severity: low
难度 2/5 1-3 小时 新手友好度 75/100
维护者通常 1 天内回复
-
area: dev-tooling bug severity: low source: roadmap wave: 4
难度 2/5 1-3 小时 新手友好度 70/100
维护者通常 1 天内回复
-
Site: the theme-locked --code-comment grey (#6a6f80) on the dark code surface is 3.8:1, below WCAG AA, in both themes (F-W1-SITE-06)可能已有人在做 @vortsghost2025 于 3 天前认领。 未关闭area: site bug good first issue severity: low source: review-2026-09 wave: 4
难度 2/5 1-3 小时 新手友好度 66/100
维护者通常 1 天内回复
-
Choosing-a-trainer table documents KTO rows as {prompt, response, label}, but the KTO loader requires a completion column (F-W1-DOCS-TRAIN-02)可能已有人在做 @vortsghost2025 于 2 天前认领。 未关闭documentation good first issue severity: medium source: review-2026-09 wave: 3
难度 2/5 1-3 小时 新手友好度 75/100
维护者通常 1 天内回复
-
documentation severity: medium source: review-2026-09 wave: 3
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 1 天内回复
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 72/100
PolicyEngine/policyengine-us#10262 ·
维护者通常 2 天内回复
-
难度 2/5 1-3 小时 新手友好度 74/100
kellyjonbrazil/jc#788 ·
维护者通常 2 天内回复
-
bug
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 1 天内回复
-
`/search.json` ignores the documented `editions.sort` parameter可能已有人在做 @PranavD2905 今天认领。 未关闭Affects: Server Good First Issue Module: Solr Needs: Triage Theme: Public APIs Theme: Search
难度 2/5 1-3 小时 新手友好度 74/100
internetarchive/openlibrary#13989 · 1 条评论 ·
维护者通常 1 天内回复
-
bug P2: misleading query
难度 2/5 1-3 小时 新手友好度 62/100
jeffknupp/association#478 ·