Hacktoberfest 2026: the issues maintainers tagged for October, open and beginner-friendly. Browse Hacktoberfest issues

[curriculum-eval] curriculum_assessment.py: checkpoint_quality — regex misses :white_check_mark: headings (90/93 false negatives)

Closed Beginner friendly
  • Is something wrong?
#4,673 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
2/5
Estimated time
1-3 hours
Newbie friendliness
82/100
Issue type
Bug
Clarity
Clearly specified
Activity status
Active
Tech stack
python
Domain
testing-qa

Research direction

Read .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, focusing on CHECKPOINT_RE and checklist-item extraction. Update the matching so both heading forms are recognized, then rerun the assessment as the issue describes. Done means the shortcode headings are detected and the reported checkpoint findings reflect the corrected results.

Written by the indexing model from the issue text.

Description

curriculum documentation quality

File: .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py
Overall Score: n/a (corpus mean: 6.09)

Flagged Dimensions:

Dimension Score Benchmark Delta
checkpoint_quality 0.0 on 90 pages ≥ 7.5 (≥ 3 items) −7.5+

Root Cause (≤ 2 sentences):
CHECKPOINT_RE is ##\s+✅\s*Checkpoint (line 10), but workshop files write the heading as ## :white_check_mark: Checkpoint. Only 3/93 pages are detected as having a checkpoint, while 90/93 actually have one.

Evidence (quoted from the file):

## :white_check_mark: Checkpoint (e.g. workshop/04-github-actions-intro.md line 138, which the scorer flags as missing_checkpoint)

Learning Science Rationale:
Retrieval practice (Roediger & Karpicke) depends on end-of-step self-checks, so a rubric that falsely reports their absence misdirects authors toward non-problems and hides real gaps such as concept overload and low activity density. Fixing measurement validity comes first.

Improvement Prompt (for an agent):

In .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, update CHECKPOINT_RE so it matches both "## ✅ Checkpoint" and "## :white_check_mark: Checkpoint" (e.g. r"##\s+(?:✅|:white_check_mark:)\s*Checkpoint", case-insensitive). Check that checklist-item extraction also works on the shortcode form. Re-run the assessment and confirm ~90 pages now have has_checkpoint=true, then report the new corpus mean and the updated findings list.

Expected Score After Fix: ~8.0 / 10.0 corpus mean (checkpoint weight 2.0 recovered on ~90 pages)

Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · 22.1 AIC · ⌖ 0.759 AIC · ⊞ 10.4K · ◷

  • expires on Oct 18, 2026, 6:48 AM UTC
Dominant language
JavaScript
Stars
53
Forks
35
Avg merge
1d 6h
Merged PRs (30d)
15

Getting set up

Open in Codespaces

Starts the project's dev container in your browser, under your own GitHub account.

  • No Dockerfile or Docker Compose file
  • No pull request template
  • No contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from githubnext/gh-aw-workshop

All issues in githubnext/gh-aw-workshop

Similar issues

More JavaScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.