🤖 tests: bug-bash harness notes from the #5721 final check
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 72/100
- Issue type
- Bug
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- typescript
- Domain
- testing
Research direction
Start with tests/bugbash/reproSelection.ts to understand how make test-bugbash-repros locates each phase's report.json and how BUGBASH_REPRO_ARGS are used. Then review the caller lists in src/node/utils/agentToolsDisabled.ts and tests/bugbash/startApp.ts, along with the named workspace generators. Done when the output-folder behavior is documented or handled, and both comments accurately describe the callers.
Written by the indexing model from the issue text.
Description
Two non-blocking notes from the final readiness check of #5721 (bug-bash harness follow-ups). Neither affects CI or the safety claims.
-
--outputinBUGBASH_REPRO_ARGSnow fails the target.make test-bugbash-reprosreads each phase'sreport.jsonfrom its fixed--outputfolder (tests/bugbash/reproSelection.ts). A user-supplied--outputsends the reports elsewhere, so the selection check fails on a missing report. It fails loudly, not silently, but on main such an override worked. Fix: document "do not pass--output", or read the output folder from the arguments. Size S. - Incomplete caller list in two comments.
src/node/utils/agentToolsDisabled.tsand thetests/bugbash/startApp.tsheader list the callers that pass their ownstreamTexttools and do not checkXUM_DISABLE_AGENT_TOOLS. They leave outworkspaceStatusGenerator.ts(propose_status) andworkspaceTitleGenerator.ts(propose_name). Those tools only return structured output, so "none of them runs shell commands" still holds. Add them, or write "for example". Size XS.
Owner: the next change to tests/bugbash/.
Generated with xum • Model: anthropic:claude-opus-5-5 • Thinking: high • Cost: $66.42
- Dominant language
- TypeScript
- Stars
- 2k
- Forks
- 140
- Avg merge
- 5h 59m
- Merged PRs (30d)
- 935
Getting set up
- Ships a Dockerfile or Docker Compose file
- No pull request template
- No contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from coder/xum
-
backlog
Difficulty 1/5 Under an hour Newbie friendliness 84/100
Maintainers usually reply within 1 day
-
backlog
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
Maintainers usually reply within 1 day
-
backlog
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
Maintainers usually reply within 1 day
-
backlog
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
Maintainers usually reply within 1 day
-
backlog
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
Maintainers usually reply within 1 day
Similar issues
-
ble-needs-fable-review bug mobile priority:P2
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
ColeMurray/background-agents#2305 ·
Maintainers usually reply within 1 day
-
bug from-studio
Difficulty 2/5 1-3 hours Newbie friendliness 63/100
esengine/DeepSeek-Reasonix#12355 ·
Maintainers usually reply within 1 day
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
oblien/openship#1086 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day