Enhancement: Cross-Engine Compatibility and Cross-Platform Conformance Tests
Maintainers usually reply within 1 day
@agentvivekkumar is already working on this.
Since Oct 10, 2026.
Assessment
This issue has not been assessed yet.
Description
Problem / motivation
As Don't Be Michael expands beyond Claude Code to support Codex, Gemini, and additional operating systems, differences in CLI behavior, authentication, streaming output, cancellation, and error handling could cause inconsistent behavior across engine and OS combinations.
Proposed solution
Introduce a shared engine conformance test suite that validates the expected execution lifecycle for every supported AI engine and operating system.
The suite would cover:
-- Engine startup and successful task execution.
-- Streaming output and completion reporting.
-- Missing credentials, authentication failures, and quota limits.
-- Cancellation, process termination, and cleanup.
-- Recovery from interrupted tasks where supported.
-- Consistent error reporting and capability detection across platforms.
Use mocked engine processes for deterministic unit tests, with optional integration tests for installed CLIs. Run the appropriate test matrix through CI on Windows, macOS, and Linux as platform support becomes available.
Screenshot, mockup or recording
No response
Alternatives considered
A provider-specific test suite for each AI engine was considered, but it would duplicate test logic and make it harder to maintain consistent behavior as new engines are added.
Relying only on manual testing was also considered, but it could miss regressions across different engine and operating system combinations.
A shared, provider-neutral conformance suite with mocked process responses and optional integration tests would provide repeatable validation without requiring paid API calls for every test.
Area
Other
Pre-flight
- I attached a screenshot, mockup or recording above.
- I searched existing issues and discussions, and this isn't a duplicate.
- Dominant language
- TypeScript
- Stars
- 273
- Forks
- 211
- Avg merge
- 13h
- Merged PRs (30d)
- 197
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from agentvivekkumar/dontbemichael
-
Windows: a hidden Claude call cannot start when the CLI path has a spacePossibly taken @theshloksschauhan claimed this 1 day ago. Open
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
agentvivekkumar/dontbemichael#426 ·
Maintainers usually reply within 1 day
-
Raise Home and Manager setup text to the 14px floorPossibly taken @glenmiracle18 claimed this 1 day ago. Openbug os:windows
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
agentvivekkumar/dontbemichael#416 · 1 comment ·
Maintainers usually reply within 1 day
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 18/100
agentvivekkumar/dontbemichael#472 ·
Maintainers usually reply within 1 day
-
Run a scheduled job now, to see it work without waiting for its clockPossibly taken @19BEC0802 claimed this today. Openenhancement
Difficulty 4/5 3-5 days Newbie friendliness 15/100
agentvivekkumar/dontbemichael#467 ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 8/100
agentvivekkumar/dontbemichael#466 ·
Maintainers usually reply within 1 day
All issues in agentvivekkumar/dontbemichael
Similar issues
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 80/100
aws/agentcore-cli#2606 ·
Maintainers usually reply within 1 day
-
ai-driven-qa bug Cosmetic
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
Maintainers usually reply within 1 day
-
ai-driven-qa bug claude Minor
Difficulty 2/5 1-3 hours Newbie friendliness 64/100
linagora/twake-mail-admin#301 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
Maintainers usually reply within 1 day
-
reproduced
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
anomalyco/opencode#56038 · 1 comment ·
Maintainers usually reply within 1 day