[curriculum-eval] side-quest-01-02-environment-reference.md: checkpoint_quality — checkpoint invisible to rubric due to shortcode heading mismatch
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
- 难度
- 2/5
- 预计耗时
- 1-3 小时
- 新手友好度
- 75/100
- Issue 类型
- 缺陷
- 描述清晰度
- 基本清楚
- 活跃度
- 活跃
- 技术栈
- markdown, python
- 领域
- documentation, tooling
调研方向
从 .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py 开始，阅读 CHECKPOINT_RE 及相关的 checkpoint 检测逻辑。更新对 ✅ 标题格式的识别，然后重新对 workshop 语料库运行 curriculum rubric，并验证有效的 checkpoint 部分不再获得为零的 checkpoint_quality 分数。单独的 workshop 内容建议属于可选的后续范围。
由索引模型根据 Issue 内容生成。
描述
File: workshop/side-quest-01-02-environment-reference.md
Overall Score: 4.93 / 10.0 (corpus mean: 6.09 / 10.0)
Flagged Dimensions:
| Dimension | Score | Benchmark | Delta |
|---|---|---|---|
| checkpoint_quality | 0.0 | ≥ 4 items → ≥10 (has_checkpoint required) | −10.0 |
| active_learning | 2.1 | ≥ 3.0 density (10.0 cap) | −0.9 |
| cognitive_load | 6.3 | ≤ 800 words (10.0) | −3.7 |
Root Cause (≤ 2 sentences):
The rubric's CHECKPOINT_RE only matches a literal ✅ emoji heading (## ✅ Checkpoint), but this file (like 90 of 93 workshop files) uses the :white_check_mark: shortcode instead, so has_checkpoint evaluates to False and checkpoint_quality is forced to 0.0 even though the page has a real, well-formed checkpoint with 7 checklist items. Separately, at 1,433 words this reference page is nearly double the 800-word cognitive-load ceiling and its 0.63 activity density (2 code blocks + 7 checklist items per ~1,430 words) is far below the ideal density of 3.
Evidence (quoted from the file):
✅ Checkpoint
- You can name each environment and tool used in this workshop and describe its role
Learning Science Rationale:
Mayer's Signaling Principle holds that clear, consistently recognized structural cues (like a checkpoint heading) help learners self-assess progress; a checkpoint that exists in the markdown but is invisible to the scoring tool represents a measurement gap, not a content gap, and should be fixed at the rubric level, not by rewriting a correct heading. Independently, Sweller's Cognitive Load Theory predicts that a 1,433-word single-pass reference page with low activity density forces learners into passive reading rather than active retrieval, increasing extraneous load and reducing retention — the page would benefit from being split or from adding retrieval-practice checkboxes throughout, not just at the end.
Improvement Prompt (for an agent):
In .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, update CHECKPOINT_RE (and any related prereq/checkpoint detection regex) to also match the ":white_check_mark:" shortcode heading format used across the workshop (e.g. "## :white_check_mark: Checkpoint"), in addition to the literal "✅" emoji. Re-run the rubric against the workshop corpus and confirm checkpoint_quality scores are no longer zero for files that have a valid checkpoint section. Separately, in workshop/side-quest-01-02-environment-reference.md, consider adding 2-3 short "quick check" checklist items or mini code snippets distributed through the glossary and screenshot sections (not just at the end) to raise activity_density above 3, and evaluate whether the glossary table and the conceptual-screenshots section could be split into two shorter pages to bring word_count under 800.
Expected Score After Fix: 7.0 / 10.0 (assuming rubric regex fix restores checkpoint_quality to ~10 and activity density improves modestly)
Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · 125.2 AIC · ⌖ 7.43 AIC · ⊞ 9K · ◷
- expires on Sep 30, 2026, 1:09 PM UTC
- 主要语言
- JavaScript
- 星标
- 51
- 派生
- 23
- 平均合并
- 8 小时 37 分钟
- 30 天内合并 PR
- 23
环境准备
在浏览器里用你自己的 GitHub 账号启动这个项目的开发容器。
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 没有贡献指南
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
githubnext/gh-aw-workshop 的其他 Issue
-
feedback simulation workshop
难度 1/5 1 小时以内 新手友好度 85/100
githubnext/gh-aw-workshop#4007 ·
维护者通常 1 天内回复
-
documentation guidelines
难度 1/5 1 小时以内 新手友好度 92/100
githubnext/gh-aw-workshop#4003 ·
维护者通常 1 天内回复
-
documentation guidelines
难度 1/5 1 小时以内 新手友好度 92/100
githubnext/gh-aw-workshop#4002 ·
维护者通常 1 天内回复
-
documentation
难度 1/5 1 小时以内 新手友好度 95/100
githubnext/gh-aw-workshop#3986 ·
维护者通常 1 天内回复
-
curriculum documentation quality
难度 2/5 半天 新手友好度 78/100
githubnext/gh-aw-workshop#3975 ·
维护者通常 1 天内回复
查看 githubnext/gh-aw-workshop 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 68/100
NCAR/music-box-interactive#628 ·
维护者通常 1 天内回复
-
难度 1/5 1 小时以内 新手友好度 68/100
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 65/100
remotion-dev/remotion#11847 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 86/100
phoenixframework/phoenix_live_view#4456 ·
维护者通常 1 天内回复
-
难度 1/5 1 小时以内 新手友好度 88/100
AllTheMods/ATM-10#4436 ·
维护者通常 5 天内回复