v0.2 follow-ups: effective-model cache staleness, host-runner integration test, substitution conservatism
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 45/100
- Issue type
- Bug
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- shell, typescript
- Domain
- security, testing-qa, tooling
Research direction
This issue combines independent follow-ups rather than one bounded change. Start by tracing the verdict cache signature and resolved-model handling, then inspect tests/fixtures.ts for the current direct tool_call path; the cache fix is done when effective-model changes cannot reuse stale verdicts, while the host-runner test and substitution refinement depend on the stated scope decisions.
Written by the indexing model from the issue text.
Description
Accepted limitations and follow-ups from the v0.2 landing (PR #5, luna reviews pass 1-3). The merge gate is green CI + all three blocking findings from the reviews fixed; the items below are known scope edges, deliberately not blockers.
-
Effective-model cache staleness. Cached verdicts key on config fields (enabled/model/timeoutMs/maxCommandLength) and clear on change, but the RESOLVED model can change mid-session (@tiny role remap or a session-model switch) without changing the signature. A cached SAFE survives an effective model change for commands outside the moderate-risk overlay. Fix direction: include the resolved model id in the cache signature.
-
Host-runner integration test. The suite drives the captured tool_call handler directly through tests/fixtures.ts, so host handler aggregation, timeout conversion, and native approval are not exercised end-to-end. Acceptable while the host is externally owned; revisit if the fork ships this plugin.
-
Command-substitution conservatism. Any command containing $( or a backtick plus a risk verb spelled anywhere is flagged (prompt), because tokenizeShellSegments explicitly excludes command substitution. Benign forms like
echo $(date)stay clean;grep $(git rev-parse HEAD) logwould prompt. If prompts get noisy, narrow to substitutions containing a risk verb INSIDE the parens rather than anywhere in the text. -
Later-handler input revision (documented, not fixable plugin-side): another extension's tool_call handler can revise the command after this plugin judges it; native approval applies to the revised command outside yolo. README "Gate integrity and its limits".
-
Lexical matcher ceiling. The overlay normalizes quotes, backslash-newline, wrappers, attached redirects, and git option positions, but exotic spellings ($'\t' escapes, aliases, base64 | sh chains) remain a classifier-judgment matter by design. The fail-closed path is: anything unparseable still reaches the human via UNSURE/PARSE_ERROR.
- Dominant language
- TypeScript
- Stars
- 0
- Forks
- 1
- Avg merge
- 1h 20m
- Merged PRs (30d)
- 32
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from STRML/omp-classifier
-
Difficulty 2/5 1-3 hours Newbie friendliness 85/100
STRML/omp-classifier#81 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
STRML/omp-classifier#80 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
STRML/omp-classifier#78 ·
-
Difficulty 5/5 Over a week Newbie friendliness 30/100
STRML/omp-classifier#84 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 72/100
STRML/omp-classifier#82 ·
All issues in STRML/omp-classifier
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
copse-dev/agent-pane#2953 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
Eynzof/Hermes-CN-Desktop#610 ·
-
bug clawsweeper:linked-pr-open clawsweeper:needs-live-repro clawsweeper:no-new-fix-pr impact:message-loss issue-rating: 🐚 platinum hermit P2 regression
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
calcite-components needs triage refactor
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
Esri/calcite-design-system#15203 ·