[curriculum-eval] curriculum_assessment.py: checkpoint_quality — regex misses :white_check_mark: and :clipboard: headings

已关闭 适合新手
#5,549 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
2/5
预计耗时
1-3 小时
新手友好度
76/100
Issue 类型
缺陷
描述清晰度
描述清楚
活跃度
活跃
技术栈
python
领域
testing

调研方向

从 .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py 开始,检查 CHECKPOINT_RE、先决条件部分的正则表达式,以及其他 emoji 匹配模式,例如 :dart: 和 :pencil2:。添加或调整单元测试,使用同时包含字面 emoji 和 GitHub shortcode 形式的 Markdown 标题,包括 ## Prerequisites。重新运行评估,并确认 04-github-actions-intro.md 的检查点质量大于零。

由索引模型根据 Issue 内容生成。

描述

curriculum documentation quality

File: .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py
Overall Score: corpus mean 6.06 / 10.0 is understated by this bug

Flagged Dimensions:

Dimension Score Benchmark Delta
checkpoint_quality 0.0 on 92/94 pages ≥ 7.5 for pages with ≥ 3 items −7.5 or more
scaffolding 5.0 on 94/94 pages 10 where "Before You Start" present −5.0

Root Cause (≤ 2 sentences):
CHECKPOINT_RE = r"##\s+✅\s*Checkpoint" and the prereq regex ##\s+📋\s*Before You Start require literal emoji, while workshop files use GitHub shortcodes (## :white_check_mark: Checkpoint, ## :clipboard: Before You Start). As a result 92/94 pages report has_checkpoint: false and 94/94 has_prereq_section: false.

Evidence (quoted from the file):

workshop/04-github-actions-intro.md line 138: ## :white_check_mark: Checkpoint followed by 5 checklist items — yet rubric-results.json reports has_checkpoint: false, checkpoint_quality: 0.0.

Learning Science Rationale:
Valid measurement is a precondition for acting on Cognitive Load and retrieval-practice findings (Roediger & Karpicke's testing effect motivates checkpoints). A rubric that scores existing checkpoints as absent sends authors to fix non-problems and hides real defects such as thin checklists, so every downstream prioritisation is distorted.

Improvement Prompt (for an agent):

In .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, update CHECKPOINT_RE to match both "## ✅ Checkpoint" and "## :white_check_mark: Checkpoint", and update the has_prereq_section regex to match both "## 📋 Before You Start" and "## :clipboard: Before You Start" (plus "## Prerequisites"). Also check any other emoji-literal regexes (e.g. :dart:, :pencil2:) in the file. Add/adjust unit tests with sample markdown for both forms, re-run the assessment, and confirm checkpoint_quality > 0 for pages such as 04-github-actions-intro.md.

Expected Score After Fix: corpus mean ≈ 8.0 / 10.0 (checkpoint and scaffolding dimensions would score properly).

Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · ~44 AIC · ⌖ ~1 AIC · ⊞ 5K · ◷

  • expires on Nov 11, 2026, 3:31 AM UTC
主要语言
JavaScript
星标
58
派生
40
平均合并
1 天 22 小时
30 天内合并 PR
7

环境准备

在 Codespaces 中打开

在浏览器里用你自己的 GitHub 账号启动这个项目的开发容器。

  • 没有 Dockerfile 或 Docker Compose 文件
  • 没有 Pull Request 模板
  • 没有贡献指南

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

githubnext/gh-aw-workshop 的其他 Issue

查看 githubnext/gh-aw-workshop 的全部 Issue

相似的 Issue

更多 JavaScript Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。