[curriculum-eval] curriculum_assessment.py: checkpoint_quality — regex misses `:white_check_mark:` shortcode, 92/94 pages falsely scored 0

未关闭 适合新手
  • 哪里不对？
#5,321 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 3 天内回复

还没有人认领这个 Issue。

评估

难度
2/5
预计耗时
1-3 小时
新手友好度
74/100
Issue 类型
缺陷
描述清晰度
描述清楚
活跃度
活跃
技术栈
python
领域
tooling

调研方向

从 .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py 开始，检查 CHECKPOINT_RE、先决条件部分的检测，以及 issue 中提到的其他依赖 emoji 的正则表达式。针对 workshop/*.md 运行评估，并为包含 emoji 和 shortcode 的标题添加一个小型单元测试。两种标题形式都能被检测到，且受影响的指标反映 workshop 内容时，即为完成。

由索引模型根据 Issue 内容生成。

描述

curriculum documentation quality

File: .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py (affects all workshop/*.md)
Overall Score: 6.06 / 10.0 corpus mean (understated)

Flagged Dimensions:

Dimension Score Benchmark Delta
checkpoint_quality 0.0 (92/94 pages) ≥ 7.5 (≥ 3 items) −7.5 or more
scaffolding 5.0 (94/94 pages) 10.0 −5.0

Root Cause (≤ 2 sentences):
CHECKPOINT_RE is ##\s+✅\s*Checkpoint and the prerequisite check is ##\s+📋\s*Before You Start, but workshop pages (per AGENTS.md conventions) use GitHub shortcodes :white_check_mark: and :clipboard:. Result: has_checkpoint and has_prereq_section are false everywhere, deflating scores by ~2–2.5 points and hiding real quality differences.

Evidence (quoted from the file):

## :white_check_mark: Checkpoint — workshop/04-github-actions-intro.md (5 checklist items), also present in 05-agentic-workflows-intro.md, side-quest-01-02-environment-reference.md, side-quest-11-06-anthropic-key.md, side-quest-17-07-repo-poisoning.md; and ## :clipboard: Before You Start in the same pages. Metrics report has_checkpoint: false, has_prereq_section: false for all of them.

Learning Science Rationale:
Valid measurement is a precondition for applying any instructional-design framework. Formative checkpoints support retrieval practice and the testing effect (Roediger & Karpicke), and "Before You Start" sections provide advance organisers (Ausubel) that reduce extraneous load. A rubric that cannot see these features will misdirect remediation toward content that already follows the best practice, and will also produce spurious trend swings (e.g. −2.00 on side-quest-11-09-agent-session-phases.md and side-quest-12-01-iterate-agent-output.md).

Improvement Prompt (for an agent):

In .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, update CHECKPOINT_RE (line ~10) to match both the emoji and shortcode forms, e.g. r"##\s+(?:✅|:white_check_mark:)\s*Checkpoint", and update the has_prereq_section detection (line ~203) to match r"##\s+(?:📋|:clipboard:)\s*Before You Start" as well as "## Prerequisites". Check any other emoji-dependent regexes in the file (HEADING/learning-objective/activity cues). Re-run the assessment script against workshop/*.md, confirm has_checkpoint is true for pages containing "## :white_check_mark: Checkpoint", add a small unit test covering both forms, and report the new corpus mean and flagged findings.

Expected Score After Fix: ~8.0 / 10.0 corpus mean (from 6.06)

Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · ~47 AIC · ⌖ ~1 AIC · ⊞ 5K · ◷

  • expires on Nov 5, 2026, 4:05 AM UTC
主要语言
JavaScript
星标
58
派生
40
平均合并
4 天 4 小时
30 天内合并 PR
8

环境准备

在 Codespaces 中打开

在浏览器里用你自己的 GitHub 账号启动这个项目的开发容器。

  • 没有 Dockerfile 或 Docker Compose 文件
  • 没有 Pull Request 模板
  • 没有贡献指南

从这里开始

  1. 先读完整个 Issue，再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库，在一个分支上完成修改。
  4. 提交 Pull Request，并在描述里引用这个 Issue 编号。

githubnext/gh-aw-workshop 的其他 Issue

查看 githubnext/gh-aw-workshop 的全部 Issue

相似的 Issue

更多 JavaScript Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。