mcp-tools audit: add an eval case for C4 description length
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 75/100
- Issue type
- Feature
- Clarity
- Clearly specified
- Activity status
- Active
- Tech stack
- json
- Domain
- testing
Research direction
Start with plugins/mcp-tools/skills/audit/evals/evals.json and copy the structure of an existing case. Add a fixture with one tool description and one server instructions field, each over 2,048 characters, then add a case expecting C4 WARN for each, checking the critical-details-near-the-start guidance. Done when the new case is in evals.json and the audit eval run reports C4 WARN for both fields.
Written by the indexing model from the issue text.
Description
The /mcp-tools:audit evals (plugins/mcp-tools/skills/audit/evals/evals.json) have no case exercising C4, the tool description and server instructions length criterion. #6779 re-grades an over-2,048-character description from FAIL to WARN after a source conflict between the mcp page, env-vars page and changelog 2.1.295/2.1.296; nothing checks that the audit applies the new grade.
Add a fixture with one tool description and one server instructions field over 2,048 characters, and an eval case expecting C4 WARN for each, with the critical-details-near-the-start guidance.
Found during the Claude Code v2.1.265..v2.1.296 changelog apply.
- Dominant language
- Shell
- Stars
- 22
- Forks
- 2
- Avg merge
- 6h 42m
- Merged PRs (30d)
- 902
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from melodic-software/claude-code-plugins
-
needs-triage priority: medium
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
melodic-software/claude-code-plugins#7288 · 1 comment ·
Maintainers usually reply within 1 day
-
knowledge: docpage-digest dual verification defines no verdict vocabulary or pass/fail thresholdOpenneeds-human needs-triage
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
melodic-software/claude-code-plugins#7286 · 1 comment ·
Maintainers usually reply within 1 day
-
needs-triage priority: low
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
melodic-software/claude-code-plugins#7282 · 1 comment ·
Maintainers usually reply within 1 day
-
needs-triage priority: medium
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
melodic-software/claude-code-plugins#7273 · 1 comment ·
Maintainers usually reply within 1 day
-
needs-human needs-triage
Difficulty 2/5 1-3 hours Newbie friendliness 79/100
melodic-software/claude-code-plugins#7232 · 1 comment ·
Maintainers usually reply within 1 day
All issues in melodic-software/claude-code-plugins
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
Maintainers usually reply within 1 day
-
[Linux] --calibrate combined with --model silently falls through to plain re-setup (setup.py:4958)Open
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 84/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 77/100
Maintainers usually reply within 1 day