[curriculum-eval] curriculum_assessment.py: checkpoint_quality — regex misses :white_check_mark: shortcode, 93/95 pages scored 0

Abierto Apto para principiantes
#5,997 0 comentarios 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
2/5
Tiempo estimado
1-3 horas
Aptitud para principiantes
78/100
Tipo de issue
Error
Claridad
Bien especificado
Estado de actividad
Activo
Stack tecnológico
python
Área
tooling

Línea de trabajo

Abre .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py y busca CHECKPOINT_RE y la detección de scaffolding / "Before You Start"; ahí están los patrones de solo emoji. Amplía ambos para aceptar las formas de shortcode de GitHub (:white_check_mark:, :clipboard:) y luego actualiza o añade las pruebas que los cubren. Está terminado cuando, al volver a ejecutar la evaluación sobre workshop/, workshop/04-github-actions-intro.md informa has_checkpoint: true y un checkpoint_quality distinto de cero, y la lista de hallazgos ya no marca missing_checkpoint en las páginas que tienen uno.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

curriculum documentation quality

File: .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py (affects all workshop/*.md)
Overall Score: corpus mean 6.06 / 10.0 (artificially depressed)

Flagged Dimensions:

Dimension Score Benchmark Delta
checkpoint_quality 0.0 on 93/95 pages ≥ 10 with ≥ 4 items -10
scaffolding 5.0 on most pages 10 when "Before You Start" present -5

Root Cause (≤ 2 sentences):
CHECKPOINT_RE is ##\s+✅\s*Checkpoint, but workshop pages (per AGENTS.md conventions) write ## :white_check_mark: Checkpoint; the same applies to :clipboard: Before You Start. As a result checkpoint_quality and scaffolding are mis-scored and missing_checkpoint is flagged on pages that have valid checkpoints.

Evidence (quoted from the file):

:white_check_mark: Checkpoint
  • You can identify on, jobs, and steps in a workflow file

(from workshop/04-github-actions-intro.md, which the rubric reports as has_checkpoint: false, checkpoint_quality: 0.0)

Learning Science Rationale:
Metrics only support instructional decisions if they measure what they claim to. Formative-assessment research (Black & Wiliam) values frequent check-for-understanding points, and this workshop has them; a false "missing checkpoint" signal sends effort toward non-problems and masks real weaknesses such as low activity density and long pages.

Improvement Prompt (for an agent):

In .github/skills/curriculum-quantitative-assessment/curriculum_assessment.py, update CHECKPOINT_RE to also match the GitHub shortcode form, e.g. r"##\s+(?:✅|:white_check_mark:)\s*Checkpoint", and update the scaffolding/"Before You Start" detection to accept both ":clipboard:" and "📋" prefixes. Add or update tests, re-run the assessment against workshop/, and confirm that pages such as 04-github-actions-intro.md now report has_checkpoint=true and checkpoint_quality>0. Then re-check the findings list for pages that were flagged only because of missing_checkpoint.

Expected Score After Fix: corpus mean about 7.3 / 10.0 (most pages gain ~+10 on checkpoint_quality ×2.0 weight and +5 on scaffolding ×1.5 weight, over total weight 10)

Generated by 🔬 Curriculum Quality Evaluator · copilot · auto · ~40 AIC · ⌖ ~1 AIC · ⊞ 5K · ◷

  • expires on Nov 23, 2026, 3:32 AM UTC
Lenguaje dominante
JavaScript
Estrellas
61
Forks
43
Merge medio
10 h 38 min
PR fusionados (30 d)
12

Preparar el entorno

Abrir en Codespaces

Inicia el contenedor de desarrollo del proyecto en tu navegador, con tu propia cuenta de GitHub.

  • Sin Dockerfile ni archivo de Docker Compose
  • Sin plantilla de pull request
  • Sin guía de contribución

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de githubnext/gh-aw-workshop

Todos los issues de githubnext/gh-aw-workshop

Issues similares

Más issues de JavaScript

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.