[curriculum-eval] curriculum_assessment.py: checkpoint_quality — regex misses :white_check_mark: and :clipboard: headings
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
调研方向
从 .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py 开始,检查 CHECKPOINT_RE、先决条件部分的正则表达式,以及其他 emoji 匹配模式,例如 :dart: 和 :pencil2:。添加或调整单元测试,使用同时包含字面 emoji 和 GitHub shortcode 形式的 Markdown 标题,包括 ## Prerequisites。重新运行评估,并确认 04-github-actions-intro.md 的检查点质量大于零。
由索引模型根据 Issue 内容生成。
描述
File: .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py
Overall Score: corpus mean 6.06 / 10.0 is understated by this bug
Flagged Dimensions:
| Dimension | Score | Benchmark | Delta |
|---|---|---|---|
| checkpoint_quality | 0.0 on 92/94 pages | ≥ 7.5 for pages with ≥ 3 items | −7.5 or more |
| scaffolding | 5.0 on 94/94 pages | 10 where "Before You Start" present | −5.0 |
Root Cause (≤ 2 sentences):
CHECKPOINT_RE = r"##\s+✅\s*Checkpoint" and the prereq regex ##\s+📋\s*Before You Start require literal emoji, while workshop files use GitHub shortcodes (## :white_check_mark: Checkpoint, ## :clipboard: Before You Start). As a result 92/94 pages report has_checkpoint: false and 94/94 has_prereq_section: false.
Evidence (quoted from the file):
workshop/04-github-actions-intro.mdline 138:## :white_check_mark: Checkpointfollowed by 5 checklist items — yetrubric-results.jsonreportshas_checkpoint: false,checkpoint_quality: 0.0.
Learning Science Rationale:
Valid measurement is a precondition for acting on Cognitive Load and retrieval-practice findings (Roediger & Karpicke's testing effect motivates checkpoints). A rubric that scores existing checkpoints as absent sends authors to fix non-problems and hides real defects such as thin checklists, so every downstream prioritisation is distorted.
Improvement Prompt (for an agent):
In .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, update CHECKPOINT_RE to match both "## ✅ Checkpoint" and "## :white_check_mark: Checkpoint", and update the has_prereq_section regex to match both "## 📋 Before You Start" and "## :clipboard: Before You Start" (plus "## Prerequisites"). Also check any other emoji-literal regexes (e.g. :dart:, :pencil2:) in the file. Add/adjust unit tests with sample markdown for both forms, re-run the assessment, and confirm checkpoint_quality > 0 for pages such as 04-github-actions-intro.md.
Expected Score After Fix: corpus mean ≈ 8.0 / 10.0 (checkpoint and scaffolding dimensions would score properly).
Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · ~44 AIC · ⌖ ~1 AIC · ⊞ 5K · ◷
- expires on Nov 11, 2026, 3:31 AM UTC
- 主要语言
- JavaScript
- 星标
- 58
- 派生
- 40
- 平均合并
- 1 天 22 小时
- 30 天内合并 PR
- 7
环境准备
在浏览器里用你自己的 GitHub 账号启动这个项目的开发容器。
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 没有贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
githubnext/gh-aw-workshop 的其他 Issue
-
[workshop-sim] Repair: Make Copilot access and billing path decision self-contained in Steps 07/07d未关闭feedback simulation workshop
难度 2/5 1-3 小时 新手友好度 72/100
githubnext/gh-aw-workshop#5597 ·
维护者通常 1 天内回复
-
feedback simulation workshop
难度 2/5 1-3 小时 新手友好度 78/100
githubnext/gh-aw-workshop#5595 ·
维护者通常 1 天内回复
-
curriculum documentation quality
难度 2/5 1-3 小时 新手友好度 76/100
githubnext/gh-aw-workshop#5583 ·
维护者通常 1 天内回复
-
curriculum documentation quality
难度 2/5 1-3 小时 新手友好度 84/100
githubnext/gh-aw-workshop#5582 ·
维护者通常 1 天内回复
-
[curriculum-eval] 04-github-actions-intro.md: cognitive_load — 28 new concepts in a 766-word step未关闭curriculum documentation quality
难度 2/5 1-3 小时 新手友好度 74/100
githubnext/gh-aw-workshop#5579 ·
维护者通常 1 天内回复
查看 githubnext/gh-aw-workshop 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 75/100
swc-project/swc-ai-issues#414 ·
-
难度 2/5 1-3 小时 新手友好度 84/100
swagger-api/swagger-client#4318 ·
维护者通常 1 天内回复
-
check:passed feeds:add
难度 2/5 1-3 小时 新手友好度 68/100
维护者通常 1 天内回复
-
Disabled radio toggle button groups lose checked state可能已有人在做 @vladosskins178 今天认领。 未关闭bug confirmed css has-pr v6
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 62/100
维护者通常 1 天内回复