[curriculum-eval] curriculum_assessment.py: checkpoint_quality — emoji regexes miss :white_check_mark: headings, 92/94 pages scored 0

未关闭 适合新手
#5,434 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 3 天内回复

还没有人认领这个 Issue。

评估

难度
2/5
预计耗时
1-3 小时
新手友好度
82/100
Issue 类型
缺陷
描述清晰度
描述清楚
活跃度
活跃
技术栈
github-actions, python
领域
data, testing

调研方向

阅读 .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py,重点关注 CHECKPOINT_RE、先决条件标题的正则表达式,以及 Bloom 提示 activity:checkpoint。添加对 emoji 和 shortcode 形式标题的测试覆盖,然后重新运行评估,并检查至少有 90 个文件报告 checkpoint、85 个文件报告先决条件部分。issue 说明不要编辑 workshop 内容。

由索引模型根据 Issue 内容生成。

描述

curriculum documentation quality

File: .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py
Overall Score: n/a (affects all 94 pages) (corpus mean: 6.06)

Flagged Dimensions:

Dimension Score Benchmark Delta
checkpoint_quality 0.0 on 92/94 pages ≥ 4 items → 10 −10
scaffolding 5.0 on 94/94 pages 10 if section present −5

Root Cause (≤ 2 sentences):
CHECKPOINT_RE matches the literal ✅ emoji and the prerequisite regex matches literal 📋, but workshop headings use the GitHub shortcodes :white_check_mark: and :clipboard:. A grep confirms 92 workshop files contain :white_check_mark: Checkpoint and 87 contain :clipboard: Before You Start, yet the report shows has_checkpoint=true for only 2 and has_prereq_section=true for none.

Evidence (quoted from the file):

CHECKPOINT_RE = re.compile(r"##\s+✅\s*Checkpoint", re.IGNORECASE) ... re.search(r"##\s+📋\s*Before You Start", raw, re.IGNORECASE)

Learning Science Rationale:
Valid measurement is a precondition for evidence-based improvement. Systematic false negatives deflate the weighted overall score by ~1.8 points (checkpoint 2.0 weight × 10, scaffolding 1.5 weight × 5), hide the real drivers described by Cognitive Load Theory (length, concept count) and Mayer's coherence/segmenting principles, and cause spurious trend swings (e.g. two pages dropped 2.00 points in history when a heading changed form).

Improvement Prompt (for an agent):

In .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, update CHECKPOINT_RE to match both "## ✅ Checkpoint" and "## :white_check_mark: Checkpoint", and update the has_prereq_section regex to match both "## 📋 Before You Start" and "## :clipboard: Before You Start" (plus "## Prerequisites"). Use alternation, e.g. r"##\s+(?:✅|:white_check_mark:)\s*Checkpoint". Also apply the same fix to the bloom "activity:checkpoint" cue. Re-run the assessment and confirm has_checkpoint is true for ≥ 90 files and has_prereq_section for ≥ 85 files. Add or update a unit test covering both heading forms. Do not edit workshop content.

Expected Score After Fix: ~7.9 / 10.0 corpus mean (up ~1.8)

Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · ~48 AIC · ⌖ ~1 AIC · ⊞ 5K · ◷

  • expires on Nov 8, 2026, 3:03 AM UTC
主要语言
JavaScript
星标
58
派生
40
平均合并
4 天 4 小时
30 天内合并 PR
8

环境准备

在 Codespaces 中打开

在浏览器里用你自己的 GitHub 账号启动这个项目的开发容器。

  • 没有 Dockerfile 或 Docker Compose 文件
  • 没有 Pull Request 模板
  • 没有贡献指南

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

githubnext/gh-aw-workshop 的其他 Issue

查看 githubnext/gh-aw-workshop 的全部 Issue

相似的 Issue

更多 JavaScript Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。