Pipeline quality gates: mandatory audit steps between pipeline stages
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 45/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Quiet
- Tech stack
- javascript
Research direction
Start with the pipeline definitions in manifest.yaml, then trace how the bootstrap engine runs stages and how the npx promptkit assemble CLI handles pipeline stages. Map where gate entries, severity, pass/fail behavior, and the recommended-gate note would be represented. Done means the schema, interactive execution, and CLI behavior consistently support the proposed mandatory or recommended gates.
Written by the indexing model from the issue text.
Description
Summary
Add quality gates as a first-class pipeline concept — mandatory or recommended audit/verification steps that run between pipeline stages before the next stage can proceed.
Motivation
GitHub Spec Kit builds quality gates directly into its workflow:
- Spec quality checklist — After specification creation, validates completeness, testability, and ambiguity
- Constitution compliance — Before planning, checks that the spec doesn't violate project principles
- Pre-implementation checklist — Before coding, verifies all checklist items pass (stops and asks if failures exist)
- Consistency analysis — After task breakdown, validates spec ↔ plan ↔ tasks alignment with severity levels (CRITICAL > HIGH > MEDIUM > LOW)
These gates are mandatory, not opt-in, which is what makes them effective.
PromptKit already has the building blocks:
audit-traceability— validates cross-document alignmentaudit-spec-alignment— checks spec ↔ implementation alignmentaudit-code-compliance— checks code ↔ spec alignmentaudit-test-compliance— checks test ↔ spec alignment
The gap: pipelines don't declare which audits should run between stages.
Proposed Design
-
Pipeline schema extension: Add an optional
gatefield to pipeline stage transitions inmanifest.yaml:pipelines: document-lifecycle: stages: - template: author-requirements-doc output_contract: requirements-document - gate: audit-traceability # ← NEW: must pass before next stage severity: warning # or "blocking" - template: author-design-doc input_contract: requirements-document output_contract: design-document - gate: audit-spec-alignment severity: blocking -
Bootstrap engine integration: When running a pipeline interactively, the bootstrap engine would execute gate templates between stages and report pass/fail before proceeding
-
CLI integration:
npx promptkit assemblecould emit a note about recommended gates when assembling a pipeline stage
Credit
This pattern is inspired by GitHub Spec Kit's built-in quality checkpoints. See their plan-template.md (constitution compliance gate) and checklist-template.md (pre-implementation quality validation) for the original implementation.
- Dominant language
- JavaScript
- Stars
- 105
- Forks
- 23
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from microsoft/PromptKit
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
Difficulty 5/5 Over a week Newbie friendliness 38/100
-
Difficulty 5/5 Over a week Newbie friendliness 30/100
All issues in microsoft/PromptKit
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
docToolchain/docToolchain#1705 ·
-
Timezone select lists one option per character; duplicate "Failed" reason; shared tracker popover id Openbug
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
nightscout/nocturne#1414 ·
-
bug v2
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
modelcontextprotocol/inspector#2458 · 1 comment ·
-
Mend: dependency security vulnerability status: needs triage 🕵️♀️
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
carbon-design-system/ibm-products#9907 ·