planning evals: reorder-points case expects a MEDIUM blast radius and no reviewer dispatch, which main's plan skill cannot both satisfy
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 66/100
- Issue type
- Bug
- Clarity
- Clearly specified
- Activity status
- Active
- Tech stack
- shell
- Domain
- ai-infra-agents
Research direction
Read plugins/planning/skills/plan/SKILL.md under “Reviewer” and compare it with the two graders and fixture named in the issue. Then inspect sibling plan-reviewer-cut cases from #15465 for the same conflict. Update the case so both graders reflect main’s shipped rule, and verify that both pass in one run across three runs.
Written by the indexing model from the issue text.
Description
Problem
Two graders of the eval case plugins/planning/evals/plan-reviewer-cut-medium-reorder-points cannot both pass on main:
graders/blast-radius-medium.mdrequires the plan to rate the blast radius MEDIUM (patternblast[ -]radius[^\n]{0,12}?\bMEDIUM\b).graders/reviewer-not-dispatched.mdrequires that noplan-revieweragent is dispatched (min: 0,max: 0,arm: both).plugins/planning/skills/plan/SKILL.md("Reviewer"): underautothe reviewer "runs when the Step 3b blast radius is MEDIUM or higher". The case's scaffold setsverification: standard(plugins/planning/evals/fixtures/plan-reviewer-cut/init-repo.sh), so a MEDIUM rating dispatches the reviewer.
Both graders came in #15465, written for a cut of the reviewer at MEDIUM. That cut did not ship: the reviewer stays on at MEDIUM until measured. In the run recorded for #16921, blast-radius-medium failed 3 of 3 runs and reviewer-not-dispatched passed 3 of 3. Each grader weighs 0.001, so no score moved, but the case's name no longer says what it exercises.
Options
- (a) Drop
max: 0fromreviewer-not-dispatchedin this case, so it matches the shipped rule that MEDIUM runs the reviewer. Recommended (basis:plugins/planning/skills/plan/SKILL.md, "Reviewer"). - (b) Retarget the case to LOW: rename it and change
blast-radius-medium, if the scaffold's four changed files with a clean revert are meant to rate LOW (plugins/planning/skills/plan/context/stress-test-triggers.mdrates 3 to 10 files MEDIUM and "Git revert works" lower).
Done when
- Both graders can pass in one run on main's plan skill, and a run of 3 shows it.
- The sibling
plan-reviewer-cutcases from #15465 are checked for the same conflict.
Source: workshop 01 close-out audit.
- Dominant language
- Shell
- Stars
- 22
- Forks
- 2
- Avg merge
- 1h 47m
- Merged PRs (30d)
- 942
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from melodic-software/claude-code-plugins
-
Own-agent checks: reject the Actions bot id in admit.mjs and test the source label in pr-verifyOpen
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
melodic-software/claude-code-plugins#17374 · 2 comments ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 71/100
melodic-software/claude-code-plugins#17364 · 4 comments ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
melodic-software/claude-code-plugins#16931 · 3 comments ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 67/100
melodic-software/claude-code-plugins#15498 · 3 comments ·
Maintainers usually reply within 1 day
-
session-flow: remove a delivered absence's away state so idle hook cost returns to the cheap pathPossibly taken @kyle-sexton claimed this today. Open
Difficulty 3/5 1-2 days Newbie friendliness 18/100
melodic-software/claude-code-plugins#17389 · 4 comments ·
Maintainers usually reply within 1 day
All issues in melodic-software/claude-code-plugins
Similar issues
-
application-issue
Difficulty 1/5 Under an hour Newbie friendliness 82/100
Installomator/Installomator#3657 · 1 comment ·
Maintainers usually reply within 3 days
-
Difficulty 2/5 1-3 hours Newbie friendliness 64/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
nekko-labs/nekko-agent#2998 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 60/100
kenzok8/openwrt-honk#35 ·
Maintainers usually reply within 1 day
-
bug severity:medium triage:confirmed triage:in-progress
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
Cotal-AI/Cotal#7795 · 1 comment ·
Maintainers usually reply within 1 day