[curriculum-eval] curriculum-scorecard: overall page scores and trend analysis
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 66/100
- Issue type
- Documentation
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- github-actions, javascript
- Domain
- analytics, documentation
Research direction
The scorecard lists affected pages under workshop/ and says the checkpoint detector confuses emoji with :white_check_mark: and :clipboard: shortcodes. Start by reading the detector issue filed alongside this scorecard and inspect the curriculum scoring entry point that produces these tables. Done when the reported scores and trend analysis account for the shortcode mismatch; confirm against the named pages and corpus totals.
Written by the indexing model from the issue text.
Description
Part Summary
| Part | Files | Mean Score | Std Dev |
|---|---|---|---|
| Part 1 — core path (lessons 00–14) | 55 |
6.13 / 10.0 |
±0.63 |
| Part 2 — advanced (lessons 15+) | 38 |
5.98 / 10.0 |
±0.36 |
| Overall corpus | 94 |
6.06 / 10.0 |
±0.54 |
Flag threshold: 5.52. Five files fall below it (see findings). Systemic caveat: the rubric reports 92 of 94 learning pages as missing a checkpoint and all 94 as missing "Before You Start", but the pages do have them. The detector regexes match the literal emoji ✅ / 📋, while the workshop writes :white_check_mark: / :clipboard:. Absolute scores are deflated by roughly 2.5–3 points. See the detector issue filed alongside this scorecard.
Part 1 Scores (lessons 00–14)
| File | Overall Score |
|---|---|
workshop/side-quest-01-02-environment-reference.md |
4.93 / 10.0 |
workshop/side-quest-11-06-anthropic-key.md |
5.37 / 10.0 |
workshop/04-github-actions-intro.md |
5.39 / 10.0 |
workshop/05-agentic-workflows-intro.md |
5.43 / 10.0 |
workshop/14b-pr-reviewer-workflow.md |
5.45 / 10.0 |
workshop/side-quest-05-03-two-file-structure.md |
5.50 / 10.0 |
workshop/side-quest-11-08-frontmatter-tools-outputs.md |
5.55 / 10.0 |
workshop/side-quest-11-01b-workflow-structure.md |
5.59 / 10.0 |
workshop/side-quest-13-04-token-optimization.md |
5.59 / 10.0 |
workshop/08-run-your-workflow.md |
5.67 / 10.0 |
workshop/side-quest-11-04-annotated-workflow.md |
5.67 / 10.0 |
workshop/side-quest-11-09-agent-session-phases.md |
5.69 / 10.0 |
workshop/05b-agentic-workflows-security.md |
5.75 / 10.0 |
workshop/side-quest-06-03a-copilot-requests-permission.md |
5.75 / 10.0 |
workshop/side-quest-11-05-event-triggers.md |
5.77 / 10.0 |
workshop/side-quest-05-01-actions-power-user.md |
5.81 / 10.0 |
workshop/14-next-steps.md |
5.83 / 10.0 |
workshop/side-quest-06-03-copilot-token.md |
5.83 / 10.0 |
workshop/side-quest-10-02-jailbreak-brief.md |
5.85 / 10.0 |
workshop/side-quest-09-02-schedule-expressions.md |
5.87 / 10.0 |
workshop/side-quest-11-07-openai-key.md |
5.87 / 10.0 |
workshop/side-quest-09-01f-debugging-checklist.md |
5.90 / 10.0 |
workshop/side-quest-12-01-iterate-agent-output.md |
5.91 / 10.0 |
workshop/side-quest-10-03-skill-dispatcher.md |
5.95 / 10.0 |
workshop/08b-interpret-your-run.md |
5.99 / 10.0 |
workshop/09-agentic-editing.md |
5.99 / 10.0 |
workshop/side-quest-08-01-codespaces-actions-write.md |
6.01 / 10.0 |
workshop/02a-setup-codespace.md |
6.09 / 10.0 |
workshop/side-quest-10-01-agent-brief.md |
6.09 / 10.0 |
workshop/side-quest-09-01-debug-output.md |
6.11 / 10.0 |
workshop/side-quest-09-01a-pattern-long-plan-chain.md |
6.12 / 10.0 |
workshop/side-quest-05-02-aw-deep-dive.md |
6.13 / 10.0 |
workshop/side-quest-07d-billing-paths.md |
6.13 / 10.0 |
workshop/05c-agentic-workflows-practice.md |
6.22 / 10.0 |
workshop/side-quest-11-03-better-prompts.md |
6.24 / 10.0 |
workshop/07-your-first-workflow.md |
6.25 / 10.0 |
workshop/07d-confirm-model-access.md |
6.25 / 10.0 |
workshop/side-quest-02-01-local-terminal.md |
6.25 / 10.0 |
workshop/side-quest-01-01-terminal-basics.md |
6.26 / 10.0 |
workshop/side-quest-09-01c-pattern-safe-output-blocked.md |
6.31 / 10.0 |
workshop/side-quest-09-01b-pattern-empty-results.md |
6.33 / 10.0 |
workshop/side-quest-09-01d-pattern-permission-denied.md |
6.35 / 10.0 |
workshop/side-quest-06-01-install-troubleshooting.md |
6.39 / 10.0 |
workshop/side-quest-09-01e-pattern-done-no-write.md |
6.39 / 10.0 |
workshop/side-quest-06-03c-copilot-github-token-ui-only.md |
6.45 / 10.0 |
workshop/side-quest-07-01-compile-workflow.md |
6.45 / 10.0 |
workshop/side-quest-13-03-pr-checklist-pattern.md |
6.45 / 10.0 |
workshop/side-quest-01-03-permission-errors.md |
6.53 / 10.0 |
workshop/side-quest-06-04-install-local.md |
6.67 / 10.0 |
workshop/side-quest-06-03b-copilot-github-token.md |
6.71 / 10.0 |
workshop/side-quest-11-02-yaml-frontmatter.md |
6.82 / 10.0 |
workshop/side-quest-11-01-frontmatter-deep-dive.md |
6.97 / 10.0 |
workshop/side-quest-06-02-cca-codespace.md |
7.19 / 10.0 |
workshop/side-quest-13-02-pr-summary-pattern.md |
8.39 / 10.0 |
workshop/side-quest-13-01-pr-labeler-pattern.md |
8.59 / 10.0 |
Part 2 Scores (lessons 15+)
| File | Overall Score |
|---|---|
workshop/side-quest-17-07-repo-poisoning.md |
4.95 / 10.0 |
workshop/15-conditional-logic.md |
5.53 / 10.0 |
workshop/side-quest-20-01-memory-patterns.md |
5.53 / 10.0 |
workshop/side-quest-22-01-failure-modes.md |
5.57 / 10.0 |
workshop/17-add-mcp-tools.md |
5.61 / 10.0 |
workshop/20-persistent-memory.md |
5.67 / 10.0 |
workshop/29-skills-and-domain-knowledge.md |
5.69 / 10.0 |
workshop/16-connect-data-source.md |
5.71 / 10.0 |
workshop/side-quest-16-02-secrets-and-permissions.md |
5.75 / 10.0 |
workshop/side-quest-17-02-security-architecture.md |
5.75 / 10.0 |
workshop/side-quest-16-03-token-exfiltration.md |
5.77 / 10.0 |
workshop/side-quest-17-03-prompt-injection.md |
5.81 / 10.0 |
workshop/18-share-and-reuse.md |
5.82 / 10.0 |
workshop/side-quest-23-01-ab-roundrobin.md |
5.83 / 10.0 |
workshop/26-manage-costs-and-budgets.md |
5.85 / 10.0 |
workshop/side-quest-17-01-mcp-concepts.md |
5.87 / 10.0 |
workshop/side-quest-17-04-permission-escalation.md |
5.89 / 10.0 |
workshop/side-quest-16-05-long-lived-credentials.md |
5.93 / 10.0 |
workshop/side-quest-25-01-audit-reference.md |
5.93 / 10.0 |
workshop/21-inline-sub-agents.md |
5.97 / 10.0 |
workshop/side-quest-17-06-output-injection.md |
5.97 / 10.0 |
workshop/side-quest-16-04-deterministic-vs-agentic-data-ops.md |
6.01 / 10.0 |
workshop/side-quest-17-05-supply-chain-mcp.md |
6.01 / 10.0 |
workshop/side-quest-15-01-expressions-and-contexts.md |
6.03 / 10.0 |
workshop/30-preview-with-staged-mode.md |
6.05 / 10.0 |
workshop/side-quest-24-01-runner-infrastructure.md |
6.07 / 10.0 |
workshop/side-quest-29-01-skill-injection-strategies.md |
6.09 / 10.0 |
workshop/28-orchestrate-workflows.md |
6.13 / 10.0 |
workshop/25-audit-and-observability.md |
6.15 / 10.0 |
workshop/side-quest-26-01-forecast-costs.md |
6.20 / 10.0 |
workshop/side-quest-15-02-chaining-conditions.md |
6.21 / 10.0 |
workshop/19-research-driven-training-node.md |
6.37 / 10.0 |
workshop/22-error-handling-and-resilience.md |
6.37 / 10.0 |
workshop/side-quest-16-01-github-output.md |
6.44 / 10.0 |
workshop/24-self-hosted-runners.md |
6.45 / 10.0 |
workshop/27-evaluate-workflow-quality.md |
6.57 / 10.0 |
workshop/23-ab-experiments.md |
6.67 / 10.0 |
workshop/side-quest-21-01-sub-agent-syntax.md |
6.91 / 10.0 |
Other Scores (no lesson number)
| File | Overall Score |
|---|---|
workshop/side-quest-enterprise-setup.md |
5.71 / 10.0 |
Score Trends (history window: 20 commits)
Only pages with a non-trivial delta are listed individually below; all 94 pages were compared and every page not listed is stable with |delta| ≤ 0.10 (most are exactly +0.00).
| File | Baseline | Latest | Delta | Direction |
|---|---|---|---|---|
workshop/side-quest-11-09-agent-session-phases.md |
7.69 |
5.69 |
-2.00 |
declining |
workshop/side-quest-12-01-iterate-agent-output.md |
7.91 |
5.91 |
-2.00 |
declining |
workshop/18-share-and-reuse.md |
6.15 |
5.82 |
-0.33 |
declining |
workshop/side-quest-01-03-permission-errors.md |
6.79 |
6.53 |
-0.26 |
declining |
workshop/side-quest-11-05-event-triggers.md |
5.87 |
5.77 |
-0.10 |
stable |
workshop/side-quest-11-08-frontmatter-tools-outputs.md |
5.64 |
5.55 |
-0.09 |
stable |
workshop/side-quest-09-01a-pattern-long-plan-chain.md |
6.20 |
6.12 |
-0.08 |
stable |
workshop/29-skills-and-domain-knowledge.md |
5.75 |
5.69 |
-0.06 |
stable |
workshop/side-quest-24-01-runner-infrastructure.md |
6.13 |
6.07 |
-0.06 |
stable |
workshop/side-quest-11-02-yaml-frontmatter.md |
6.88 |
6.82 |
-0.06 |
stable |
workshop/side-quest-06-02-cca-codespace.md |
7.25 |
7.19 |
-0.06 |
stable |
workshop/side-quest-09-01f-debugging-checklist.md |
5.96 |
5.90 |
-0.06 |
stable |
workshop/22-error-handling-and-resilience.md |
6.35 |
6.37 |
+0.02 |
stable |
workshop/23-ab-experiments.md |
6.65 |
6.67 |
+0.02 |
stable |
workshop/side-quest-01-02-environment-reference.md |
4.93 |
4.93 |
+0.00 |
stable |
workshop/side-quest-17-07-repo-poisoning.md |
4.97 |
4.95 |
-0.02 |
stable |
workshop/04-github-actions-intro.md |
5.39 |
5.39 |
+0.00 |
stable |
workshop/05-agentic-workflows-intro.md |
5.43 |
5.43 |
+0.00 |
stable |
The two −2.00 drops (side-quest-11-09, side-quest-12-01) match the exact weight of the checkpoint dimension, so a checkpoint was probably lost or reformatted (for example to the :white_check_mark: shortcode) in those files. That is consistent with the detector bug above.
Overall Trend
- Baseline mean score:
6.13 - Latest mean score:
6.06 - Delta:
-0.07 - Direction:
stable
Bloom's Taxonomy audit
Distribution (94 files): remember 8, understand 15, apply 51, analyze 7, evaluate 5, create 8. The shape is a healthy pyramid with a heavy Apply base. has_min_understand_steps = true (15) and has_min_analyze_steps = true (7), so there are no gap proposals.
Per-file reclassification (justification is the one-sentence cue from corpus.bloom_reclassification; all files use "Primary cues: ..."):
- remember (8):
21-inline-sub-agents(title/intro: reference),29-skills-and-domain-knowledge(intro: reference, glossary),side-quest-01-02-environment-reference(title/intro: reference),side-quest-11-01-frontmatter-deep-dive,side-quest-11-02-yaml-frontmatter,side-quest-20-01-memory-patterns,side-quest-21-01-sub-agent-syntax,side-quest-25-01-audit-reference(all reference-style cues) - understand (15):
04-github-actions-intro,05-agentic-workflows-intro,side-quest-05-01,05-02,05-03,10-02-jailbreak-brief,11-01b-workflow-structure,11-09-agent-session-phases,15-01-expressions-and-contexts,16-03-token-exfiltration,16-04-deterministic-vs-agentic-data-ops,17-02-security-architecture,17-03-prompt-injection,17-04-permission-escalation,17-05-supply-chain-mcp(title/intro: intro, introduction, explain-style cues) - apply (51): all remaining install/setup/run/configure/schedule pages, including
02a,05b,05c,07d,08,08b,14,15,16,17,18,20,22,24,25,26,30, and 34 side quests (cues: install, run, configure, use, schedule, commands_or_code) - analyze (7):
side-quest-09-01-debug-output,09-01c,09-01d,09-01f,12-01-iterate-agent-output,16-01-github-output,17-06-output-injection - evaluate (5):
09-agentic-editing(review/test),23-ab-experiments(test),27-evaluate-workflow-quality(evaluate/review),side-quest-13-01,13-03(checkpoint/review cues) - create (8):
07-your-first-workflow(create/write),14b-pr-reviewer-workflow(create/build),19-research-driven-training-node,28-orchestrate-workflows(build/compose),side-quest-09-01e,11-03-better-prompts,13-02-pr-summary-pattern,17-07-repo-poisoning
Caveat: the classifier is keyword-based. side-quest-17-07-repo-poisoning is an attack-and-defend exercise and reads more like Analyze/Evaluate than Create.
Corpus-level observations
- Checkpoint/scaffolding coverage: the real coverage is high, but the rubric cannot see it (detector bug).
- Length variance:
side-quest-01-02(1,433 words) andside-quest-17-07(1,234 words) are well over the 800-word ideal; most steps are 650–800 words. - Active learning: concept-heavy pages (
04,05) have density < 4 because their activities are tables and reflection prompts rather than code blocks.
Fix prompt for the corpus: see the detector issue ("curriculum_assessment.py: checkpoint and prerequisite detection ignores :white_check_mark: / :clipboard: shortcodes").
Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · ~40 AIC · ⌖ ~1 AIC · ⊞ 5K · ◷
- expires on Oct 28, 2026, 3:43 AM UTC
- Dominant language
- JavaScript
- Stars
- 55
- Forks
- 36
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 17
Getting set up
Starts the project's dev container in your browser, under your own GitHub account.
- No Dockerfile or Docker Compose file
- No pull request template
- No contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from githubnext/gh-aw-workshop
-
curriculum documentation quality
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
githubnext/gh-aw-workshop#5038 ·
Maintainers usually reply within 1 day
-
curriculum documentation quality
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
githubnext/gh-aw-workshop#5039 ·
Maintainers usually reply within 1 day
-
curriculum documentation quality
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
githubnext/gh-aw-workshop#5037 ·
Maintainers usually reply within 1 day
-
documentation
Difficulty 1/5 Under an hour Newbie friendliness 90/100
githubnext/gh-aw-workshop#5036 ·
Maintainers usually reply within 1 day
-
curriculum documentation quality
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
githubnext/gh-aw-workshop#5033 ·
Maintainers usually reply within 1 day
All issues in githubnext/gh-aw-workshop
Similar issues
-
enhancement javascript python
Difficulty 2/5 1-3 hours Newbie friendliness 66/100
jlab-sensing/ENTS-backend#851 ·
Maintainers usually reply within 2 days
-
Difficulty 1/5 1-3 hours Newbie friendliness 86/100
guilhermerodz/input-otp#157 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
davidjerleke/embla-carousel#1414 ·
Maintainers usually reply within 4 days
-
0. Needs triage bug
Difficulty 2/5 1-3 hours Newbie friendliness 67/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
Maintainers usually reply within 1 day