[Conformance] SEP-2484: Wire SEP traceability files into conformance test runner; surface per-SEP pass rates
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 38/100
Research direction
Start with tests/Conformance/ and the Docker-based conformance runner, then review commits f12ea0a and 3e45b1f for the existing score calculation and README badges. Trace how sep-NNNN.yaml files from the conformance repository could provide per-SEP results. Done means per-SEP pass rates are surfaced and CI distinguishes failures when a new traceability file is added.
Written by the indexing model from the issue text.
Description
Implements SEP-2484 for the MCP Spec 2026-07-28 release.
Tracked by umbrella #339.
Spec summary
Before any Standards Track SEP touching observable protocol behavior moves Accepted → Final, a tagged conformance scenario must be merged in the
modelcontextprotocol/conformancerepo with asep-NNNN.yamltraceability file mapping each MUST/MUST NOT requirement.
PHP SDK changes
- No direct code change, but materially affects how the SDK tracks SEP adoption. The conformance suite at
tests/Conformance/(Docker-based) becomes the ground truth for "feature implemented." - Use SEP traceability YAMLs to drive PHP coverage: each newly-Final SEP maps to a set of conformance scenarios that should pass against the PHP SDK before claiming support.
- Build on commits
f12ea0a(conformance score calculation) and3e45b1f(README badges): surface per-SEP pass rates next to the overall score. - CI gate: when conformance suite adds a
sep-NNNN.yaml, surface failures distinctly so adoption can be tracked SEP-by-SEP.
Related
- Umbrella #339
- Supports SDK Tier classification (SEP-1730)
- Dominant language
- PHP
- Stars
- 1.6k
- Forks
- 173
- Avg merge
- 2d 49m
- Merged PRs (30d)
- 23
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from modelcontextprotocol/php-sdk
-
[Server] Handler type uses bare Closure, hard to decorate RegistryInterface under strict PHPStan OpenServer
Difficulty 1/5 Under an hour Newbie friendliness 78/100
modelcontextprotocol/php-sdk#468 · 2 comments ·
-
needs confirmation needs maintainer action Server
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
modelcontextprotocol/php-sdk#398 · 1 reaction ·
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
modelcontextprotocol/php-sdk#370 ·
-
enhancement
Difficulty 4/5 3-5 days Newbie friendliness 55/100
modelcontextprotocol/php-sdk#510 · 1 comment ·
-
bug
Difficulty 4/5 3-5 days Newbie friendliness 45/100
modelcontextprotocol/php-sdk#504 ·
All issues in modelcontextprotocol/php-sdk
Similar issues
-
priority: p3
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
googleapis/librarian#7636 ·
-
0. Needs triage bug
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
nextcloud/fulltextsearch#1011 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
phpstan/phpstan-doctrine#794 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
Automattic/static-site-importer#1767 ·