[curriculum-eval] curriculum_assessment.py: checkpoint_quality — shortcode headings not detected, 91/93 pages falsely score 0
维护者通常 3 天内回复
还没有人认领这个 Issue。
评估
- 难度
- 2/5
- 预计耗时
- 1-3 小时
- 新手友好度
- 76/100
- Issue 类型
- 缺陷
- 描述清晰度
- 描述清楚
- 活跃度
- 活跃
- 技术栈
- github-actions, markdown, python
调研方向
从 .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py 开始，检查 CHECKPOINT_RE、has_prereq_section 和清单计数逻辑。对比它们在 issue 中展示的原样 emoji 和 shortcode 标题上的行为，然后运行评估和相关单元测试。当这些标题能够被识别，且包含 checkpoint 部分的页面不再产生错误的 missing_checkpoint 结果时，工作即告完成。
由索引模型根据 Issue 内容生成。
描述
File: .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py (affects every workshop/*.md)
Overall Score: 5.4 / 10.0 for workshop/04-github-actions-intro.md (corpus mean: 6.1)
Flagged Dimensions:
| Dimension | Score | Benchmark | Delta |
|---|---|---|---|
| checkpoint_quality | 0.0 | ≥ 4 items → 10.0 | -10.0 |
| scaffolding | 5.0 | 10.0 | -5.0 |
Root Cause (≤ 2 sentences):
CHECKPOINT_RE matches only a literal ✅ and has_prereq_section only a literal 📋, but workshop files use :white_check_mark: / :clipboard: shortcodes (per AGENTS.md). As a result 91 of 93 pages report has_checkpoint: false although they have 4+ checklist items.
Evidence (quoted from the file):
## :white_check_mark: Checkpointfollowed by five- [ ]items (workshop/04-github-actions-intro.md, lines 138–144) is scoredhas_checkpoint: false,checkpoint_quality: 0.0.
Learning Science Rationale:
Valid measurement is a precondition for acting on formative-assessment signals (Black & Wiliam). Checkpoints support retrieval practice and self-monitoring; a rubric that scores them 0 for nearly all pages produces false missing_checkpoint findings and hides genuine differences such as length (Cognitive Load Theory) and low activity density.
Improvement Prompt (for an agent):
In .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, update CHECKPOINT_RE to match both "## ✅ Checkpoint" and "## :white_check_mark: Checkpoint", and update the has_prereq_section regex to match both "## 📋 Before You Start" and "## :clipboard: Before You Start" (plus "## Prerequisites"). Ensure checkpoint checklist-item counting works with the shortcode form. Add/adjust unit tests, re-run the assessment, and confirm the corpus no longer reports missing_checkpoint for pages that have a checkpoint section.
Expected Score After Fix: 7.4 / 10.0 for 04-github-actions-intro.md (checkpoint +2.0 weight, scaffolding +0.75 effective); corpus mean rises to roughly 7.5.
Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · 25.6 AIC · ⌖ 0.781 AIC · ⊞ 10.4K · ◷
- expires on Oct 23, 2026, 5:38 AM UTC
- 主要语言
- JavaScript
- 星标
- 58
- 派生
- 40
- 平均合并
- 4 天 4 小时
- 30 天内合并 PR
- 8
环境准备
在浏览器里用你自己的 GitHub 账号启动这个项目的开发容器。
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 没有贡献指南
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
githubnext/gh-aw-workshop 的其他 Issue
-
[ordering-review] workshop order graph: 1 confirmed ordering problem, 3 cycles are false positives未关闭
难度 2/5 1-3 小时 新手友好度 85/100
githubnext/gh-aw-workshop#5331 ·
维护者通常 3 天内回复
-
feedback simulation workshop
难度 2/5 1-3 小时 新手友好度 69/100
githubnext/gh-aw-workshop#5328 ·
维护者通常 3 天内回复
-
[curriculum-eval] 04-github-actions-intro.md: cognitive_load — 28 new concepts in a "5 minutes" page未关闭curriculum documentation quality
难度 2/5 1-3 小时 新手友好度 77/100
githubnext/gh-aw-workshop#5320 ·
维护者通常 3 天内回复
-
curriculum documentation quality
难度 2/5 1-3 小时 新手友好度 74/100
githubnext/gh-aw-workshop#5321 ·
维护者通常 3 天内回复
-
[ordering-review] workshop order graph: environment reference verifies tools before Codespace exists未关闭
难度 2/5 1-3 小时 新手友好度 78/100
githubnext/gh-aw-workshop#5313 ·
维护者通常 3 天内回复
查看 githubnext/gh-aw-workshop 的全部 Issue
相似的 Issue
-
needs-area-label
难度 2/5 1-3 小时 新手友好度 66/100
维护者通常 2 天内回复
-
serienstream.to未关闭N: AdGuard for Windows P2: High T: Annoyance
难度 2/5 1-3 小时 新手友好度 61/100
AdguardTeam/AdguardFilters#246310 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 76/100
liberation-data/drivine#615 ·
维护者通常 1 天内回复
-
bug dependencies known-issue
难度 2/5 1-3 小时 新手友好度 76/100
-
unreleased dependencies
难度 1/5 1 小时以内 新手友好度 72/100
cloudfour/eslint-config#760 ·
维护者通常 1 天内回复