Add a two-stage assessment and review process for community PRs
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 5/5
- Tempo stimato
- Più di una settimana
- Idoneità per principianti
- 48/100
Direzione di ricerca
Inizia leggendo la bug extension esistente e il feature-assess workflow per comprendere gli staged artifacts e l’installazione delle estensioni a runtime. Traccia quindi come un community-pr-review workflow proposto potrebbe utilizzare il label gate, il read-only context, gli SHA checks e i constrained outputs. Il lavoro è completato quando i criteri di accettazione sono soddisfatti per assessment, conditional review, stale revisions, permissions e comment limits.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Summary
Add a reusable Spec Kit extension and label-triggered agentic workflow for assessing pull requests submitted by community contributors.
The proposed process has two stages:
assessment → project fit?
├─ no or unclear → stop
└─ yes → review
This follows the staged artifact model used by the bug extension and the runtime extension installation used by the feature-assess workflow, while keeping maintainers responsible for acceptance.
Proposed extension
Add a contribution extension with two commands:
speckit.contribution.assesswrites.specify/contributions/pr-<number>-<short-head-sha>/assessment.md. It captures PR intent, linked issue or specification, scope, contribution-policy compliance, AI disclosure, architectural fit, risks, and required checks.speckit.contribution.reviewconsumes the assessment and existing CI evidence, then writesreview.mdwith prioritized findings, contributor actions, and a recommendation for maintainers.
Both commands are read-only with respect to repository source. Every artifact records the PR base and head SHAs and refuses to consume stale artifacts after the contributor pushes another revision.
Proposed agentic workflow
Add a community-pr-review workflow triggered when a maintainer applies a community-review label to an open PR.
The workflow posts at most two top-level comments:
- Community contribution assessment — Stage 1/2: summarizes fit, scope, policy compliance, risks, and the assessed head SHA.
- Community contribution review — Stage 2/2: summarizes findings, CI evidence, contributor actions, and the maintainer recommendation.
If assessment returns out-of-scope, invalid, or needs-clarification, the workflow posts only the assessment comment, applies the corresponding outcome label, and stops. Review runs only when assessment determines that the contribution fits the project and has enough information to evaluate.
Each comment should identify its stage and PR head SHA. Configure safe outputs with add-comment: max: 2 and constrained outcome labels.
Guardrails
- Use a human-applied label as the execution gate.
- Never modify or push to the contributor's branch.
- Never formally approve, request changes, merge, or resolve review threads.
- Use the
pull_requestsecurity context, notpull_request_target. - Keep repository and pull-request permissions read-only and expose no secrets.
- Treat PR descriptions, comments, diffs, and changed files as untrusted data rather than instructions.
- Consume existing CI results instead of executing contributor-controlled commands in the agentic workflow.
- Record the head SHA and stop when assessment or CI evidence is stale.
Suggested outcomes
Assessment can conclude:
fits-project— continue to review.needs-clarification— request information and stop.out-of-scope— explain why and stop.invalid— explain why and stop.
Review can conclude:
ready-for-maintainer-review.needs-contributor-action.blocked.
These are recommendations only; a maintainer remains the final decision-maker.
Acceptance criteria
- A maintainer can trigger the process against a community PR by applying one label.
- Assessment always posts first and clearly identifies itself as Stage 1/2.
- Review runs and posts Stage 2/2 only when assessment returns
fits-project. - At most two comments are created per run.
- Both outputs identify the exact PR head SHA they evaluated.
- Source files and the contributor's branch are never modified.
- Re-running after a new push cannot reuse stale assessment artifacts.
AI disclosure
This issue was drafted and filed on behalf of @mnriem by GitHub Copilot (model: GPT-5.6 Sol).
- Lingua principale
- Python
- Stelle
- 138k
- Fork
- 12.4k
- Merge medio
- 3g 4h
- PR unite (30g)
- 154
Guida per i contributori
Apri la guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di github/spec-kit
-
enhancement needs-triage
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
-
enhancement needs-triage
Difficoltà 2/5 1-3 ore Idoneità per principianti 74/100
-
enhancement needs-triage
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 84/100
-
enhancement needs-triage triage-can-wait
Difficoltà 2/5 1-3 ore Idoneità per principianti 76/100
Tutte le issue di github/spec-kit
Issue simili
-
essnmx good first issue
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 95/100
-
[Feature] 奇物选择添加优先级 Aperta
Difficoltà 2/5 1-3 ore Idoneità per principianti 65/100
syfoud/Simulated_Scepter#174 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
Giskard-AI/giskard-oss#2840 · 1 commento ·
-
A claim comment carrying the issue number is silently declined while the workflow reports success Apertaarea: repo bug perceived difficulty: 2
Difficoltà 2/5 1-3 ore Idoneità per principianti 70/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
yeti-platform/yeti#1380 ·