[workshop-sim] Workshop Simulation Report — 2026-10-25 (Run #106000, 1000×Monte Carlo)
Los mantenedores suelen responder en 1 día
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 4/5
- Tiempo estimado
- 3-5 días
- Aptitud para principiantes
- 45/100
- Tipo de issue
- Documentación
- Claridad
- Necesita aclaración
- Estado de actividad
- Activo
- Stack tecnológico
- github-actions, markdown
- Área
- documentation
Línea de trabajo
Read the step files cited in the report (04-github-actions-intro.md, 05-agentic-workflows-intro.md, 07-your-first-workflow.md) and the template that sets copilot-requests: write. First map the reported drop-off causes to the page content, then apply the listed repairs. Done means the billing contradiction is merged and Steps 04–05 gain hands-on practice with verifiable checkpoints.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Overview
- Date: 2026-10-25
- Students simulated: 46 × 1000 Monte Carlo runs
- Workshop steps available: 31/31
- Overall success rate: 22.3% (95% Monte Carlo interval: 21.9%–22.6%)
- Highest-dropout step:
07-first-workflow(26.6% conditional dropout among 22,399 at-risk runs; 95% interval: 26.1%–27.2%). Part 1. - Lowest curriculum quality step:
04-github-actions-intro.md(overall score 5.4/10) - Learning KPI index: 2.9/10 (active_learning 4.2 · checkpoint_quality 0.0 · scaffolding 5.0)
- Model:
2026-07-survival-model-v2/2026-07-assumption-model-v2(parameter hash2024391902) - Limitation: synthetic results reflect explicit model assumptions; intervals exclude model and population-assumption uncertainty. Rates are not observed human outcomes.
Part Summary
| Part | Files | Mean Score | Std Dev |
|---|---|---|---|
| Part 1 — core path (lessons 00–14) | 15 |
6.69 / 10.0 |
±1.74 |
| Part 2 — advanced (lessons 15+) | 16 |
6.04 / 10.0 |
±0.36 |
| Overall corpus | 31 |
6.35 / 10.0 |
— |
No pages are classified as other.
Critical Findings
- Nearly all attrition is in Part 1 (steps 04–07). Step 07 (Write Your First Workflow, incl. 07d model access) has the highest conditional dropout (26.6%), driven by Copilot access/billing friction (3,693 failures) and workflow-authoring friction (2,273). The most important repair belongs to Part 1.
- Step 04 and Step 05 are the largest absolute drop-off sources (7,215 and 6,564 dropouts) from concept overload and concept gaps; they are also the lowest-scoring pages (5.39, 5.43) with active_learning 3.9 and 2.4. Beginners (0.6% success) and CCA-tool learners (8.4%) are hit hardest; UI-preferring learners average 11.3% vs 32.3%.
- Learning quality health is weak: KPI index 2.9/10.
checkpoint_qualityis 0.0 on every step even though pages end with a checkpoint section, so the rubric likely sees checkpoints as unverifiable; learners who stay are not getting measurable skill checks. - Step 08 shows 1.8% conditional dropout after the agent-insight rerun (down from 100% under the baseline's missing-lock-file assumption); the evaluated Step 07 pages confirm create, compile, and push of both files for the terminal path.
Top Repairs to Prioritize
Note: some dropout is expected. Repairs must maintain or improve the learning KPI index.
- Resolve the Step 07/07d billing contradiction (template adds
copilot-requests: write, personal billing must remove it) and merge the duplicated access check (completion ↑ · learning KPI ↔/↑) - Add practice and verifiable checkpoints to Step 05 with a prerequisite recovery path (completion ↑ · learning KPI ↑)
- Add hands-on practice and a self-check to Step 04 to cut concept overload (completion ↑ · learning KPI ↑)
Dropout by step
| Step | At-risk runs | Dropouts | Rate | 95% interval | Failure mode | Top reason |
|---|---|---|---|---|---|---|
| 07-first-workflow | 22,399 | 5,966 | 26.6% | 26.1–27.2% | access barrier | Copilot access missing (3,693) |
| 05-agentic-intro | 36,929 | 6,564 | 17.8% | 17.4–18.2% | learning barrier | Agentic concept gap (4,311) |
| 04-actions-intro | 44,144 | 7,215 | 16.3% | 16.0–16.7% | learning barrier | Concept overload (7,215) |
| 05c-agentic-practice | 30,365 | 3,749 | 12.3% | 12.0–12.7% | learning barrier | Cannot classify agentic workflows (3,749) |
| 05b-agentic-security | 26,616 | 2,642 | 9.9% | 9.6–10.3% | learning barrier | Security concept gap (2,642) |
| 06-install-gh-aw | 23,974 | 1,575 | 6.6% | 6.3–6.9% | access barrier | Extension install friction (1,575) |
Curriculum quality and learning KPIs
| Step file | Overall | active_learning | checkpoint_quality | scaffolding | KPI index | Lowest dimension | Priority |
|---|---|---|---|---|---|---|---|
| 04-github-actions-intro | 5.39 | 3.9 | 0.0 | 5.0 | 2.78 | checkpoint_quality | High |
| 05-agentic-workflows-intro | 5.43 | 2.4 | 0.0 | 5.0 | 2.24 | checkpoint_quality | High |
| 07-your-first-workflow | 6.25 | 6.3 | 0.0 | 5.0 | 3.65 | checkpoint_quality | High (access) |
| 08-run-your-workflow | 5.67 | 3.0 | 0.0 | 5.0 | 2.45 | checkpoint_quality | Medium |
| Cohort mean (31 steps) | 6.35 | 4.15 | 0.0 | 5.0 | 2.87 | checkpoint_quality | — |
Segment breakdowns
| Level | Mean success | n |
|---|---|---|
| beginner | 0.6% | 11 |
| github-basic | 14.8% | 19 |
| actions-user | 45.5% | 11 |
| advanced | 46.9% | 5 |
| Personality | Mean success | n |
|---|---|---|
| curious | 19.4% | 15 |
| confused | 21.5% | 6 |
| skeptical | 22.7% | 7 |
| methodical | 24.7% | 12 |
| impatient | 24.8% | 6 |
Tool: CLI 34.5%, VS Code 28.2%, CCA 8.4%. UI-preferred 11.3% vs terminal-preferred 32.3%.
Notable student journeys (3)
- Surprising success: Learner 024 (advanced, devops, UI-preferred, vscode) reaches 58.2% despite preferring the UI, showing the Codespace terminal transition is manageable with strong background.
- Unexpected dropout: Learner 038 (beginner, no-coding, methodical, CLI) succeeds 0% of runs, failing at Step 04 from concept overload; being methodical does not offset the dense refresher with no hands-on practice.
- Content gap: Learner 043 (github-basic, program-manager, CCA, UI-preferred) fails at Step 04; the page gives no reduced-path or checkpoint for learners without YAML background.
Generated by 🔬 Workshop Student Simulator · copilot · auto · ~41 AIC · ⌖ ~1 AIC · ⊞ 15.4K · ◷
- expires on Oct 26, 2026, 8:04 AM UTC
- Lenguaje dominante
- JavaScript
- Estrellas
- 55
- Forks
- 36
- Merge medio
- 2 d 8 h
- PR fusionados (30 d)
- 17
Preparar el entorno
Inicia el contenedor de desarrollo del proyecto en tu navegador, con tu propia cuenta de GitHub.
- Sin Dockerfile ni archivo de Docker Compose
- Sin plantilla de pull request
- Sin guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de githubnext/gh-aw-workshop
-
[workshop-sim] Improve: Strengthen practice and checkpoints in Step 05 (What Are Agentic Workflows?)Abiertofeedback simulation workshop
Dificultad 2/5 1-3 horas Aptitud para principiantes 85/100
githubnext/gh-aw-workshop#4972 ·
Los mantenedores suelen responder en 1 día
-
feedback simulation workshop
Dificultad 2/5 1-3 horas Aptitud para principiantes 70/100
githubnext/gh-aw-workshop#4971 ·
Los mantenedores suelen responder en 1 día
-
curriculum documentation quality
Dificultad 2/5 1-3 horas Aptitud para principiantes 85/100
githubnext/gh-aw-workshop#4969 ·
Los mantenedores suelen responder en 1 día
-
curriculum documentation quality
Dificultad 2/5 Medio día Aptitud para principiantes 85/100
githubnext/gh-aw-workshop#4966 ·
Los mantenedores suelen responder en 1 día
-
curriculum documentation quality
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
githubnext/gh-aw-workshop#4964 ·
Los mantenedores suelen responder en 1 día
Todos los issues de githubnext/gh-aw-workshop
Issues similares
-
Dificultad 1/5 Menos de una hora Aptitud para principiantes 85/100
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 72/100
vercel-labs/agent-skills#348 ·
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 65/100
NanmiCoder/dsh-agent-teams#289 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 1/5 Menos de una hora Aptitud para principiantes 70/100
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 83/100
c1overzz/dsh-bili-scroll#124 ·
Los mantenedores suelen responder en 1 día