[curriculum-eval] curriculum_assessment.py: checkpoint_quality — regex misses :white_check_mark: shortcode, 92/94 pages falsely flagged
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
调研方向
阅读 .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py 并定位 CHECKPOINT_RE 和 prereq regex。按照描述更新它们以同时匹配 emoji 和 GitHub shortcode 标题形式，然后针对 workshop/ 重新运行评估，并确认 04-github-actions-intro.md 的 has_checkpoint 在语料库均值上升时为 true。为两种标题形式添加单元测试。
由索引模型根据 Issue 内容生成。
描述
File: .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py
Overall Score: corpus mean 6.06 / 10.0 (depressed by scorer defect)
Flagged Dimensions:
| Dimension | Score | Benchmark | Delta |
|---|---|---|---|
| checkpoint_quality | 0.0 on 92/94 pages | ≥ 7.5 | −7.5 |
| scaffolding | 5.0 on most pages | 10 | −5.0 |
Root Cause (≤ 2 sentences):
CHECKPOINT_RE matches ##\s+✅\s*Checkpoint and the prerequisite check matches ##\s+📋\s*Before You Start, but workshop files write these headings with GitHub shortcodes (## :white_check_mark: Checkpoint, ## :clipboard: Before You Start). Every page is therefore scored as missing both, which drags scores by about 2–3 points and triggers missing_checkpoint on 92 of 94 pages.
Evidence (quoted from the file):
workshop/04-github-actions-intro.mdline 138:## :white_check_mark: Checkpointfollowed by 5 checklist items — yet its metrics reporthas_checkpoint: false,checkpoint_quality: 0.0.
Scorer: CHECKPOINT_RE = re.compile(r"##\s+✅\s*Checkpoint", re.IGNORECASE)
Learning Science Rationale:
Valid measurement underpins any evidence-based review: a rubric with a systematic false negative produces misleading prioritisation (for example, the −2.00 "declines" on side-quest-11-09 and side-quest-12-01 likely reflect heading-format changes rather than learning quality). Fixing the detector lets Cognitive Load, Mayer's segmenting and retrieval-practice signals (checkpoints) be evaluated on real differences.
Improvement Prompt (for an agent):
In .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, update CHECKPOINT_RE to match both the emoji and shortcode forms, e.g. r"##\s+(?:✅|:white_check_mark:)\s*Checkpoint", and update the has_prereq_section regex to match r"##\s+(?:📋|:clipboard:)\s*Before You Start" (also accept a "Prerequisites" heading). Also check CHECKLIST_RE and any other emoji-dependent patterns for shortcode equivalents. Re-run the assessment against workshop/ and confirm has_checkpoint is true for 04-github-actions-intro.md and that corpus mean rises. Add a small unit test covering both heading forms.
Expected Score After Fix: ~8.3 / 10.0 corpus mean (checkpoint +2.0 weight × ~8 and scaffolding +1.5 × 5 on most pages)
Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · ~42 AIC · ⌖ ~1 AIC · ⊞ 5K · ◷
- expires on Oct 26, 2026, 5:07 AM UTC
- 主要语言
- JavaScript
- 星标
- 56
- 派生
- 40
- 平均合并
- 2 天 7 小时
- 30 天内合并 PR
- 16
环境准备
在浏览器里用你自己的 GitHub 账号启动这个项目的开发容器。
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 没有贡献指南
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
githubnext/gh-aw-workshop 的其他 Issue
-
curriculum documentation quality
难度 2/5 1-3 小时 新手友好度 78/100
githubnext/gh-aw-workshop#5105 ·
维护者通常 1 天内回复
-
curriculum documentation quality
难度 2/5 1-3 小时 新手友好度 77/100
githubnext/gh-aw-workshop#5104 ·
维护者通常 1 天内回复
-
curriculum documentation quality
难度 2/5 1-3 小时 新手友好度 82/100
githubnext/gh-aw-workshop#5103 ·
维护者通常 1 天内回复
-
curriculum documentation quality
难度 2/5 1-3 小时 新手友好度 78/100
githubnext/gh-aw-workshop#5100 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 72/100
githubnext/gh-aw-workshop#3109 · 11 条评论 ·
维护者通常 1 天内回复
查看 githubnext/gh-aw-workshop 的全部 Issue
相似的 Issue
-
FEATURE REQUEST
难度 2/5 1-3 小时 新手友好度 68/100
linuxmint/cinnamon-spices-extensions#1193 ·
维护者通常 1 天内回复
-
bug
难度 2/5 1-3 小时 新手友好度 76/100
Fei2411/DeepSeek-Bot#703 ·
-
area:web first-timers-only good first issue
难度 1/5 1 小时以内 新手友好度 95/100
career-ops-hq/career-ops#6264 ·
维护者通常 1 天内回复
-
难度 1/5 1 小时以内 新手友好度 74/100
catppuccin/firefox#21 ·
-
难度 1/5 1 小时以内 新手友好度 83/100
cline/mcp-marketplace#3394 ·