Add a two-stage assessment and review process for community PRs
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 5/5
- Tiempo estimado
- Más de una semana
- Aptitud para principiantes
- 48/100
Línea de trabajo
Empieza leyendo la bug extension existente y el feature-assess workflow para entender los staged artifacts y la instalación de extensiones en tiempo de ejecución. Después, sigue cómo un community-pr-review workflow propuesto podría utilizar el label gate, el read-only context, las SHA checks y los constrained outputs. Se considera terminado cuando se cumplen los criterios de aceptación para assessment, conditional review, stale revisions, permissions y comment limits.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Summary
Add a reusable Spec Kit extension and label-triggered agentic workflow for assessing pull requests submitted by community contributors.
The proposed process has two stages:
assessment → project fit?
├─ no or unclear → stop
└─ yes → review
This follows the staged artifact model used by the bug extension and the runtime extension installation used by the feature-assess workflow, while keeping maintainers responsible for acceptance.
Proposed extension
Add a contribution extension with two commands:
speckit.contribution.assesswrites.specify/contributions/pr-<number>-<short-head-sha>/assessment.md. It captures PR intent, linked issue or specification, scope, contribution-policy compliance, AI disclosure, architectural fit, risks, and required checks.speckit.contribution.reviewconsumes the assessment and existing CI evidence, then writesreview.mdwith prioritized findings, contributor actions, and a recommendation for maintainers.
Both commands are read-only with respect to repository source. Every artifact records the PR base and head SHAs and refuses to consume stale artifacts after the contributor pushes another revision.
Proposed agentic workflow
Add a community-pr-review workflow triggered when a maintainer applies a community-review label to an open PR.
The workflow posts at most two top-level comments:
- Community contribution assessment — Stage 1/2: summarizes fit, scope, policy compliance, risks, and the assessed head SHA.
- Community contribution review — Stage 2/2: summarizes findings, CI evidence, contributor actions, and the maintainer recommendation.
If assessment returns out-of-scope, invalid, or needs-clarification, the workflow posts only the assessment comment, applies the corresponding outcome label, and stops. Review runs only when assessment determines that the contribution fits the project and has enough information to evaluate.
Each comment should identify its stage and PR head SHA. Configure safe outputs with add-comment: max: 2 and constrained outcome labels.
Guardrails
- Use a human-applied label as the execution gate.
- Never modify or push to the contributor's branch.
- Never formally approve, request changes, merge, or resolve review threads.
- Use the
pull_requestsecurity context, notpull_request_target. - Keep repository and pull-request permissions read-only and expose no secrets.
- Treat PR descriptions, comments, diffs, and changed files as untrusted data rather than instructions.
- Consume existing CI results instead of executing contributor-controlled commands in the agentic workflow.
- Record the head SHA and stop when assessment or CI evidence is stale.
Suggested outcomes
Assessment can conclude:
fits-project— continue to review.needs-clarification— request information and stop.out-of-scope— explain why and stop.invalid— explain why and stop.
Review can conclude:
ready-for-maintainer-review.needs-contributor-action.blocked.
These are recommendations only; a maintainer remains the final decision-maker.
Acceptance criteria
- A maintainer can trigger the process against a community PR by applying one label.
- Assessment always posts first and clearly identifies itself as Stage 1/2.
- Review runs and posts Stage 2/2 only when assessment returns
fits-project. - At most two comments are created per run.
- Both outputs identify the exact PR head SHA they evaluated.
- Source files and the contributor's branch are never modified.
- Re-running after a new push cannot reuse stale assessment artifacts.
AI disclosure
This issue was drafted and filed on behalf of @mnriem by GitHub Copilot (model: GPT-5.6 Sol).
- Lenguaje dominante
- Python
- Estrellas
- 138k
- Forks
- 12.4k
- Merge medio
- 3 d 4 h
- PR fusionados (30 d)
- 154
Guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de github/spec-kit
-
enhancement needs-triage
Dificultad 2/5 1-3 horas Aptitud para principiantes 68/100
-
enhancement needs-triage
Dificultad 2/5 1-3 horas Aptitud para principiantes 74/100
-
enhancement needs-triage
Dificultad 2/5 1-3 horas Aptitud para principiantes 68/100
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 84/100
-
enhancement needs-triage triage-can-wait
Dificultad 2/5 1-3 horas Aptitud para principiantes 76/100
Todos los issues de github/spec-kit
Issues similares
-
essnmx good first issue
Dificultad 1/5 Menos de una hora Aptitud para principiantes 95/100
-
[Feature] 奇物选择添加优先级 Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 65/100
syfoud/Simulated_Scepter#174 ·
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
Giskard-AI/giskard-oss#2840 · 1 comentario ·
-
A claim comment carrying the issue number is silently declined while the workflow reports success Abiertoarea: repo bug perceived difficulty: 2
Dificultad 2/5 1-3 horas Aptitud para principiantes 70/100
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
yeti-platform/yeti#1380 ·