[curriculum-eval] curriculum-scorecard: overall page scores and trend analysis
I maintainer di solito rispondono entro 1 giorno
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 2/5
- Tempo stimato
- 1-3 ore
- Idoneità per principianti
- 66/100
- Tipo di issue
- Documentazione
- Chiarezza
- Abbastanza chiara
- Stato di attività
- Attiva
- Stack tecnologico
- github-actions, javascript
- Ambito
- analytics, documentation
Direzione di ricerca
La scheda di valutazione elenca le pagine interessate sotto workshop/ e afferma che il rilevatore dei checkpoint confonde le emoji con gli shortcode :white_check_mark: e :clipboard:. Inizia leggendo il ticket del rilevatore presentato insieme a questa scheda e ispeziona il punto di ingresso del calcolo dei punteggi del curriculum che genera queste tabelle. Il lavoro è completo quando i punteggi riportati e l’analisi delle tendenze tengono conto della discrepanza degli shortcode; verifica i risultati sulle pagine indicate e sui totali del corpus.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Part Summary
| Part | Files | Mean Score | Std Dev |
|---|---|---|---|
| Part 1 — core path (lessons 00–14) | 55 |
6.13 / 10.0 |
±0.63 |
| Part 2 — advanced (lessons 15+) | 38 |
5.98 / 10.0 |
±0.36 |
| Overall corpus | 94 |
6.06 / 10.0 |
±0.54 |
Flag threshold: 5.52. Five files fall below it (see findings). Systemic caveat: the rubric reports 92 of 94 learning pages as missing a checkpoint and all 94 as missing "Before You Start", but the pages do have them. The detector regexes match the literal emoji ✅ / 📋, while the workshop writes :white_check_mark: / :clipboard:. Absolute scores are deflated by roughly 2.5–3 points. See the detector issue filed alongside this scorecard.
Part 1 Scores (lessons 00–14)
| File | Overall Score |
|---|---|
workshop/side-quest-01-02-environment-reference.md |
4.93 / 10.0 |
workshop/side-quest-11-06-anthropic-key.md |
5.37 / 10.0 |
workshop/04-github-actions-intro.md |
5.39 / 10.0 |
workshop/05-agentic-workflows-intro.md |
5.43 / 10.0 |
workshop/14b-pr-reviewer-workflow.md |
5.45 / 10.0 |
workshop/side-quest-05-03-two-file-structure.md |
5.50 / 10.0 |
workshop/side-quest-11-08-frontmatter-tools-outputs.md |
5.55 / 10.0 |
workshop/side-quest-11-01b-workflow-structure.md |
5.59 / 10.0 |
workshop/side-quest-13-04-token-optimization.md |
5.59 / 10.0 |
workshop/08-run-your-workflow.md |
5.67 / 10.0 |
workshop/side-quest-11-04-annotated-workflow.md |
5.67 / 10.0 |
workshop/side-quest-11-09-agent-session-phases.md |
5.69 / 10.0 |
workshop/05b-agentic-workflows-security.md |
5.75 / 10.0 |
workshop/side-quest-06-03a-copilot-requests-permission.md |
5.75 / 10.0 |
workshop/side-quest-11-05-event-triggers.md |
5.77 / 10.0 |
workshop/side-quest-05-01-actions-power-user.md |
5.81 / 10.0 |
workshop/14-next-steps.md |
5.83 / 10.0 |
workshop/side-quest-06-03-copilot-token.md |
5.83 / 10.0 |
workshop/side-quest-10-02-jailbreak-brief.md |
5.85 / 10.0 |
workshop/side-quest-09-02-schedule-expressions.md |
5.87 / 10.0 |
workshop/side-quest-11-07-openai-key.md |
5.87 / 10.0 |
workshop/side-quest-09-01f-debugging-checklist.md |
5.90 / 10.0 |
workshop/side-quest-12-01-iterate-agent-output.md |
5.91 / 10.0 |
workshop/side-quest-10-03-skill-dispatcher.md |
5.95 / 10.0 |
workshop/08b-interpret-your-run.md |
5.99 / 10.0 |
workshop/09-agentic-editing.md |
5.99 / 10.0 |
workshop/side-quest-08-01-codespaces-actions-write.md |
6.01 / 10.0 |
workshop/02a-setup-codespace.md |
6.09 / 10.0 |
workshop/side-quest-10-01-agent-brief.md |
6.09 / 10.0 |
workshop/side-quest-09-01-debug-output.md |
6.11 / 10.0 |
workshop/side-quest-09-01a-pattern-long-plan-chain.md |
6.12 / 10.0 |
workshop/side-quest-05-02-aw-deep-dive.md |
6.13 / 10.0 |
workshop/side-quest-07d-billing-paths.md |
6.13 / 10.0 |
workshop/05c-agentic-workflows-practice.md |
6.22 / 10.0 |
workshop/side-quest-11-03-better-prompts.md |
6.24 / 10.0 |
workshop/07-your-first-workflow.md |
6.25 / 10.0 |
workshop/07d-confirm-model-access.md |
6.25 / 10.0 |
workshop/side-quest-02-01-local-terminal.md |
6.25 / 10.0 |
workshop/side-quest-01-01-terminal-basics.md |
6.26 / 10.0 |
workshop/side-quest-09-01c-pattern-safe-output-blocked.md |
6.31 / 10.0 |
workshop/side-quest-09-01b-pattern-empty-results.md |
6.33 / 10.0 |
workshop/side-quest-09-01d-pattern-permission-denied.md |
6.35 / 10.0 |
workshop/side-quest-06-01-install-troubleshooting.md |
6.39 / 10.0 |
workshop/side-quest-09-01e-pattern-done-no-write.md |
6.39 / 10.0 |
workshop/side-quest-06-03c-copilot-github-token-ui-only.md |
6.45 / 10.0 |
workshop/side-quest-07-01-compile-workflow.md |
6.45 / 10.0 |
workshop/side-quest-13-03-pr-checklist-pattern.md |
6.45 / 10.0 |
workshop/side-quest-01-03-permission-errors.md |
6.53 / 10.0 |
workshop/side-quest-06-04-install-local.md |
6.67 / 10.0 |
workshop/side-quest-06-03b-copilot-github-token.md |
6.71 / 10.0 |
workshop/side-quest-11-02-yaml-frontmatter.md |
6.82 / 10.0 |
workshop/side-quest-11-01-frontmatter-deep-dive.md |
6.97 / 10.0 |
workshop/side-quest-06-02-cca-codespace.md |
7.19 / 10.0 |
workshop/side-quest-13-02-pr-summary-pattern.md |
8.39 / 10.0 |
workshop/side-quest-13-01-pr-labeler-pattern.md |
8.59 / 10.0 |
Part 2 Scores (lessons 15+)
| File | Overall Score |
|---|---|
workshop/side-quest-17-07-repo-poisoning.md |
4.95 / 10.0 |
workshop/15-conditional-logic.md |
5.53 / 10.0 |
workshop/side-quest-20-01-memory-patterns.md |
5.53 / 10.0 |
workshop/side-quest-22-01-failure-modes.md |
5.57 / 10.0 |
workshop/17-add-mcp-tools.md |
5.61 / 10.0 |
workshop/20-persistent-memory.md |
5.67 / 10.0 |
workshop/29-skills-and-domain-knowledge.md |
5.69 / 10.0 |
workshop/16-connect-data-source.md |
5.71 / 10.0 |
workshop/side-quest-16-02-secrets-and-permissions.md |
5.75 / 10.0 |
workshop/side-quest-17-02-security-architecture.md |
5.75 / 10.0 |
workshop/side-quest-16-03-token-exfiltration.md |
5.77 / 10.0 |
workshop/side-quest-17-03-prompt-injection.md |
5.81 / 10.0 |
workshop/18-share-and-reuse.md |
5.82 / 10.0 |
workshop/side-quest-23-01-ab-roundrobin.md |
5.83 / 10.0 |
workshop/26-manage-costs-and-budgets.md |
5.85 / 10.0 |
workshop/side-quest-17-01-mcp-concepts.md |
5.87 / 10.0 |
workshop/side-quest-17-04-permission-escalation.md |
5.89 / 10.0 |
workshop/side-quest-16-05-long-lived-credentials.md |
5.93 / 10.0 |
workshop/side-quest-25-01-audit-reference.md |
5.93 / 10.0 |
workshop/21-inline-sub-agents.md |
5.97 / 10.0 |
workshop/side-quest-17-06-output-injection.md |
5.97 / 10.0 |
workshop/side-quest-16-04-deterministic-vs-agentic-data-ops.md |
6.01 / 10.0 |
workshop/side-quest-17-05-supply-chain-mcp.md |
6.01 / 10.0 |
workshop/side-quest-15-01-expressions-and-contexts.md |
6.03 / 10.0 |
workshop/30-preview-with-staged-mode.md |
6.05 / 10.0 |
workshop/side-quest-24-01-runner-infrastructure.md |
6.07 / 10.0 |
workshop/side-quest-29-01-skill-injection-strategies.md |
6.09 / 10.0 |
workshop/28-orchestrate-workflows.md |
6.13 / 10.0 |
workshop/25-audit-and-observability.md |
6.15 / 10.0 |
workshop/side-quest-26-01-forecast-costs.md |
6.20 / 10.0 |
workshop/side-quest-15-02-chaining-conditions.md |
6.21 / 10.0 |
workshop/19-research-driven-training-node.md |
6.37 / 10.0 |
workshop/22-error-handling-and-resilience.md |
6.37 / 10.0 |
workshop/side-quest-16-01-github-output.md |
6.44 / 10.0 |
workshop/24-self-hosted-runners.md |
6.45 / 10.0 |
workshop/27-evaluate-workflow-quality.md |
6.57 / 10.0 |
workshop/23-ab-experiments.md |
6.67 / 10.0 |
workshop/side-quest-21-01-sub-agent-syntax.md |
6.91 / 10.0 |
Other Scores (no lesson number)
| File | Overall Score |
|---|---|
workshop/side-quest-enterprise-setup.md |
5.71 / 10.0 |
Score Trends (history window: 20 commits)
Only pages with a non-trivial delta are listed individually below; all 94 pages were compared and every page not listed is stable with |delta| ≤ 0.10 (most are exactly +0.00).
| File | Baseline | Latest | Delta | Direction |
|---|---|---|---|---|
workshop/side-quest-11-09-agent-session-phases.md |
7.69 |
5.69 |
-2.00 |
declining |
workshop/side-quest-12-01-iterate-agent-output.md |
7.91 |
5.91 |
-2.00 |
declining |
workshop/18-share-and-reuse.md |
6.15 |
5.82 |
-0.33 |
declining |
workshop/side-quest-01-03-permission-errors.md |
6.79 |
6.53 |
-0.26 |
declining |
workshop/side-quest-11-05-event-triggers.md |
5.87 |
5.77 |
-0.10 |
stable |
workshop/side-quest-11-08-frontmatter-tools-outputs.md |
5.64 |
5.55 |
-0.09 |
stable |
workshop/side-quest-09-01a-pattern-long-plan-chain.md |
6.20 |
6.12 |
-0.08 |
stable |
workshop/29-skills-and-domain-knowledge.md |
5.75 |
5.69 |
-0.06 |
stable |
workshop/side-quest-24-01-runner-infrastructure.md |
6.13 |
6.07 |
-0.06 |
stable |
workshop/side-quest-11-02-yaml-frontmatter.md |
6.88 |
6.82 |
-0.06 |
stable |
workshop/side-quest-06-02-cca-codespace.md |
7.25 |
7.19 |
-0.06 |
stable |
workshop/side-quest-09-01f-debugging-checklist.md |
5.96 |
5.90 |
-0.06 |
stable |
workshop/22-error-handling-and-resilience.md |
6.35 |
6.37 |
+0.02 |
stable |
workshop/23-ab-experiments.md |
6.65 |
6.67 |
+0.02 |
stable |
workshop/side-quest-01-02-environment-reference.md |
4.93 |
4.93 |
+0.00 |
stable |
workshop/side-quest-17-07-repo-poisoning.md |
4.97 |
4.95 |
-0.02 |
stable |
workshop/04-github-actions-intro.md |
5.39 |
5.39 |
+0.00 |
stable |
workshop/05-agentic-workflows-intro.md |
5.43 |
5.43 |
+0.00 |
stable |
The two −2.00 drops (side-quest-11-09, side-quest-12-01) match the exact weight of the checkpoint dimension, so a checkpoint was probably lost or reformatted (for example to the :white_check_mark: shortcode) in those files. That is consistent with the detector bug above.
Overall Trend
- Baseline mean score:
6.13 - Latest mean score:
6.06 - Delta:
-0.07 - Direction:
stable
Bloom's Taxonomy audit
Distribution (94 files): remember 8, understand 15, apply 51, analyze 7, evaluate 5, create 8. The shape is a healthy pyramid with a heavy Apply base. has_min_understand_steps = true (15) and has_min_analyze_steps = true (7), so there are no gap proposals.
Per-file reclassification (justification is the one-sentence cue from corpus.bloom_reclassification; all files use "Primary cues: ..."):
- remember (8):
21-inline-sub-agents(title/intro: reference),29-skills-and-domain-knowledge(intro: reference, glossary),side-quest-01-02-environment-reference(title/intro: reference),side-quest-11-01-frontmatter-deep-dive,side-quest-11-02-yaml-frontmatter,side-quest-20-01-memory-patterns,side-quest-21-01-sub-agent-syntax,side-quest-25-01-audit-reference(all reference-style cues) - understand (15):
04-github-actions-intro,05-agentic-workflows-intro,side-quest-05-01,05-02,05-03,10-02-jailbreak-brief,11-01b-workflow-structure,11-09-agent-session-phases,15-01-expressions-and-contexts,16-03-token-exfiltration,16-04-deterministic-vs-agentic-data-ops,17-02-security-architecture,17-03-prompt-injection,17-04-permission-escalation,17-05-supply-chain-mcp(title/intro: intro, introduction, explain-style cues) - apply (51): all remaining install/setup/run/configure/schedule pages, including
02a,05b,05c,07d,08,08b,14,15,16,17,18,20,22,24,25,26,30, and 34 side quests (cues: install, run, configure, use, schedule, commands_or_code) - analyze (7):
side-quest-09-01-debug-output,09-01c,09-01d,09-01f,12-01-iterate-agent-output,16-01-github-output,17-06-output-injection - evaluate (5):
09-agentic-editing(review/test),23-ab-experiments(test),27-evaluate-workflow-quality(evaluate/review),side-quest-13-01,13-03(checkpoint/review cues) - create (8):
07-your-first-workflow(create/write),14b-pr-reviewer-workflow(create/build),19-research-driven-training-node,28-orchestrate-workflows(build/compose),side-quest-09-01e,11-03-better-prompts,13-02-pr-summary-pattern,17-07-repo-poisoning
Caveat: the classifier is keyword-based. side-quest-17-07-repo-poisoning is an attack-and-defend exercise and reads more like Analyze/Evaluate than Create.
Corpus-level observations
- Checkpoint/scaffolding coverage: the real coverage is high, but the rubric cannot see it (detector bug).
- Length variance:
side-quest-01-02(1,433 words) andside-quest-17-07(1,234 words) are well over the 800-word ideal; most steps are 650–800 words. - Active learning: concept-heavy pages (
04,05) have density < 4 because their activities are tables and reflection prompts rather than code blocks.
Fix prompt for the corpus: see the detector issue ("curriculum_assessment.py: checkpoint and prerequisite detection ignores :white_check_mark: / :clipboard: shortcodes").
Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · ~40 AIC · ⌖ ~1 AIC · ⊞ 5K · ◷
- expires on Oct 28, 2026, 3:43 AM UTC
- Lingua principale
- JavaScript
- Stelle
- 55
- Fork
- 36
- Merge medio
- 2g 8h
- PR unite (30g)
- 17
Preparare l'ambiente
Avvia il container di sviluppo del progetto nel browser, con il tuo account GitHub.
- Nessun Dockerfile né file Docker Compose
- Nessun modello di pull request
- Nessuna guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di githubnext/gh-aw-workshop
-
curriculum documentation quality
Difficoltà 2/5 1-3 ore Idoneità per principianti 84/100
githubnext/gh-aw-workshop#5038 ·
I maintainer di solito rispondono entro 1 giorno
-
curriculum documentation quality
Difficoltà 2/5 1-3 ore Idoneità per principianti 76/100
githubnext/gh-aw-workshop#5039 ·
I maintainer di solito rispondono entro 1 giorno
-
curriculum documentation quality
Difficoltà 2/5 1-3 ore Idoneità per principianti 82/100
githubnext/gh-aw-workshop#5037 ·
I maintainer di solito rispondono entro 1 giorno
-
documentation
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 90/100
githubnext/gh-aw-workshop#5036 ·
I maintainer di solito rispondono entro 1 giorno
-
curriculum documentation quality
Difficoltà 2/5 1-3 ore Idoneità per principianti 78/100
githubnext/gh-aw-workshop#5033 ·
I maintainer di solito rispondono entro 1 giorno
Tutte le issue di githubnext/gh-aw-workshop
Issue simili
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
evi0s/WMPFDebugger#303 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 76/100
HakanSeven12/OpenCADStudio#2257 · 1 commento ·
I maintainer di solito rispondono entro 1 giorno
-
[bug] extension mappingAperta
Difficoltà 2/5 1-3 ore Idoneità per principianti 64/100
-
bug good first issue
Difficoltà 2/5 1-3 ore Idoneità per principianti 85/100
-
bug code-annotation
Difficoltà 2/5 1-3 ore Idoneità per principianti 76/100
quarto-dev/quarto-cli#15215 ·
I maintainer di solito rispondono entro 1 giorno