[curriculum-eval] curriculum_assessment.py: checkpoint_quality & scaffolding — regexes miss :white_check_mark: / :clipboard: headings
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 72/100
Research direction
Start in .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py and look at CHECKPOINT_RE and the prerequisite regex (has_prereq_section). Confirm the miss by running the assessment over workshop/04-github-actions-intro.md, which uses ## :white_check_mark: Checkpoint. Done when has_checkpoint is true for that page, the shortcode forms are matched alongside the emoji ones, and the corpus mean rises. Update any tests or docs in the same skill directory.
Written by the indexing model from the issue text.
Description
File: .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py
Overall Score: 6.1 / 10.0 (corpus mean: 6.06) — affects 93 of 95 pages
Flagged Dimensions:
| Dimension | Score | Benchmark | Delta |
|---|---|---|---|
| checkpoint_quality | 0.0 (on 93 pages) | ≥ 4 items → 10 | -10.0 |
| scaffolding | 5.0 (on ~88 pages) | section present → 10 | -5.0 |
Root Cause (≤ 2 sentences):
CHECKPOINT_RE matches the literal ✅ glyph and the prerequisite regex matches 📋, but the workshop headings use the GitHub shortcodes :white_check_mark: and :clipboard:. Every page is therefore scored has_checkpoint: false and without scaffolding, so the dashboards report false missing_checkpoint flags and understate scores by ~2–3.5 points.
Evidence (quoted from the file):
CHECKPOINT_RE = re.compile(r"##\s+✅\s*Checkpoint", re.IGNORECASE)...re.search(r"##\s+📋\s*Before You Start", raw, re.IGNORECASE)
versus workshop/04-github-actions-intro.md: ## :white_check_mark: Checkpoint (it has 5 checklist items, yet scored checkpoint_quality: 0.0).
Learning Science Rationale:
Valid measurement is a precondition for acting on rubric output. Checkpoints support retrieval practice and formative feedback (Roediger & Karpicke's testing effect), and scaffolding supports Vygotsky-style guided progression. When the tool reports these as absent everywhere, genuine gaps cannot be separated from artefacts, and improvement agents waste effort adding duplicate checkpoints.
Improvement Prompt (for an agent):
In .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, update CHECKPOINT_RE to match both the emoji and shortcode forms, e.g. r"##\s+(?:✅|:white_check_mark:)\s*Checkpoint", and update the prerequisite/scaffolding regex (has_prereq_section) to r"##\s+(?:📋|:clipboard:)\s*(?:Before You Start|Prerequisites)". Also check any other emoji-based regexes in the file (e.g. :pencil2:, :dart:) for the same mismatch. Then re-run the assessment over workshop/*.md and confirm has_checkpoint is true for pages containing "## :white_check_mark: Checkpoint" and that corpus mean_score rises. Update any tests or docs under .github/skills/curriculum-quantitative-assessment/ accordingly.
Expected Score After Fix: 8.3 / 10.0 (estimated corpus mean once checkpoint and scaffolding are detected)
Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · ~39 AIC · ⌖ ~1 AIC · ⊞ 5K · ◷
- expires on Nov 22, 2026, 3:31 AM UTC
- Dominant language
- JavaScript
- Stars
- 61
- Forks
- 43
- Avg merge
- 10h 38m
- Merged PRs (30d)
- 12
Getting set up
Starts the project's dev container in your browser, under your own GitHub account.
- No Dockerfile or Docker Compose file
- No pull request template
- No contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from githubnext/gh-aw-workshop
-
[workshop-sim] Repair: Strengthen checkpoints and lock-file prerequisite in Agentic intro (Step 5)Openfeedback simulation workshop
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
githubnext/gh-aw-workshop#5973 ·
Maintainers usually reply within 1 day
-
curriculum documentation quality
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
githubnext/gh-aw-workshop#5972 ·
Maintainers usually reply within 1 day
-
documentation
Difficulty 1/5 Under an hour Newbie friendliness 88/100
githubnext/gh-aw-workshop#5965 ·
Maintainers usually reply within 1 day
-
documentation
Difficulty 1/5 Under an hour Newbie friendliness 88/100
githubnext/gh-aw-workshop#5964 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
githubnext/gh-aw-workshop#5959 ·
Maintainers usually reply within 1 day
All issues in githubnext/gh-aw-workshop
Similar issues
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
swc-project/swc-ai-issues#995 ·
-
Development server fails with webpack-dev-server 6.1.0Possibly taken @utsxvrai claimed this today. Openbug
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
rabbitmq/rabbitmq-website#2733 ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 80/100
kentcdodds/kcd-skills#32 ·
-
Edit: Cool ChannelOpenapproved channels:edit check:passed
Difficulty 1/5 Under an hour Newbie friendliness 72/100
Maintainers usually reply within 1 day
-
area:frontend priority:normal type:enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Mystify7777/aquaveda-v2#241 ·
Maintainers usually reply within 1 day