0.22: extract replay and test into a vetted first-party plugin
Mantenedores costumam responder em até 1 dia
Ninguém assumiu esta issue ainda.
Avaliação
- Dificuldade
- 5/5
- Tempo estimado
- Mais de uma semana
- Facilidade para iniciantes
- 24/100
- Tipo de issue
- Funcionalidade
- Clareza
- Razoavelmente clara
- Status de atividade
- Ativa
- Stack de tecnologia
- node.js, typescript
Direção de pesquisa
Start with ADR 0034 for plugin lifecycle and failure isolation, then read ADR 0012, 0015, 0016, and 0017 alongside #3377's Maestro extraction work. Map the current replay and suite entry points, plugin contract, backend seam, and CI device lanes before proposing package boundaries. Done means the listed CLI, MCP, compatibility, recovery, and script-preservation conditions are validated; the issue does not identify specific source files or tests.
Escrita pelo modelo de indexação a partir do texto da issue.
Descrição
Purpose
Ship replay and its lightweight test runner as an optional, first-party plugin in 0.22. Keep agent-device focused on device automation, while preserving explicit .ad workflows and agent-supervised repair for their users. Goal-based test orchestration and replay caching can remain in frameworks such as TesterArmy e2e; this extraction must not replace deterministic .ad execution with model-driven behavior.
Required behavior
- Keep
replay,test, replay export, their flags, and the relevant help/MCP/client schemas discoverable without installing executable plugin code. Label optional capabilities as plugins that require separate installation. - Keep a bundled catalog of vetted capability/package declarations. Use one declaration for help and missing-plugin recovery. The catalog describes capabilities; the runtime registry remains the authority for installed and working implementations. Do not infer an npm package from an unknown command or provider.
- When the plugin is absent, fail before device actions with a typed
plugin-not-installedreason, the exact package and installation command, and instructions to retry the original invocation with its arguments intact. For example, the error details include{ reason: "plugin-not-installed", package: "<chosen first-party package>", installCommand: "agent-device plugins add <chosen first-party package>" }. - Distinguish a missing installation from a selected package that fails loading, validation, or setup, and from a running daemon that retains an older plugin set. Preserve typed failure details and give the corresponding repair or restart instructions. Do not install packages or terminate sessions automatically.
- Preserve existing
.adsyntax, variable handling, source bundles, target identity verification, divergence reports, resume, session retention, repair transactions, timeouts, cancellation, suite results, reporters, and artifact behavior after explicit installation. Preserve all supported platform routes, including desktop platforms. - Keep sessions, device dispatch, selector/ref authority, recording authority, policy enforcement, cancellation, and cleanup with their existing core owners. Extract replay execution, suite orchestration, and format engines through explicit host contracts; do not give a plugin parallel ownership of session state.
- Specify the recording boundary: ordinary
open/close --save-scriptcapture remains usable in core; replay-specific repair requires the replay plugin. Keep shared.addata contracts independent of the executable engine. - Extend the plugin contract for replay capabilities instead of making a replay engine pretend to be a device provider. Integrate the separate replay-backend seam with managed plugin loading and lifecycle ownership. Do not retain a hidden bundled replay engine or silently fall back to a different engine.
- Choose and document the first-party package names, supported core/plugin version range, compatibility checks, and maintainer-owned validation before publication. Define where plugins must be installed when a client uses a remote or embedded daemon; local installation must not imply remote availability.
Observable completion conditions
- A clean core install lists the optional replay/test capability in help without importing its implementation.
- Missing-plugin text and JSON errors give an executable installation command and continuation instructions. CLI, MCP, and typed-client paths preserve the same failure classification.
- After installation, representative existing
.adscripts and suites work without rewriting; repair/resume and Maestro routes preserve their contracts. - Missing, broken, incompatible, and stale-daemon cases have distinct, tested recovery paths; unknown names do not produce guessed installation commands.
- Core no longer bundles replay execution, suite orchestration, or format engines. Package-closure evidence demonstrates the split without expanding startup imports or adding interaction round trips/captures.
- CI explicitly installs the required first-party plugins. Replay compatibility, provider integration, target-identity guarantees, and device lanes still exercise the extracted implementation.
- CLI help, plugin docs, migration instructions, owning ADRs, and package/layering checks describe the 0.22 boundaries. Existing scripts need installation, not a syntax migration.
Dependencies and sequencing
- Build on the TestMu help and missing-plugin guidance fix linked by its PR.
- Coordinate with #3377, which owns Maestro engine extraction and its existing backend seam. Share contracts and package loading rather than introducing competing registries or duplicating its work.
- Coordinate with #3309, #3310, and #3311 for provider catalog entries and with #3759 for removal of superseded plugin APIs in 0.22.
- Read ADR 0012 for replay identity, divergence, resume, and repair, ADR 0015 for Maestro behavior/performance, ADR 0016/0017 for recording, and ADR 0034 for plugin lifecycle and failure isolation.
- Linguagem predominante
- TypeScript
- Estrelas
- 5.1k
- Forks
- 339
- Merge médio
- 11h 54min
- PRs com merge (30d)
- 745
Preparar o ambiente
- Sem Dockerfile nem arquivo Docker Compose
- Sem modelo de pull request
- Ler o guia de contribuição
Primeiros passos
- Leia a issue inteira e depois o guia de contribuição do projeto.
- Comente na issue dizendo que vai assumir — evita que duas pessoas façam o mesmo trabalho.
- Faça um fork do repositório e trabalhe em uma branch.
- Abra um pull request que referencie o número da issue.
Mais de callstack/agent-device
-
Limrun iOS fill reports success but drops non-ASCII textTalvez já em andamento @mvanhorn assumiu há 2 dias. Abertabug ready-for-agent
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 87/100
callstack/agent-device#3819 · 2 comentários ·
Mantenedores costumam responder em até 1 dia
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 68/100
callstack/agent-device#1869 ·
Mantenedores costumam responder em até 1 dia
-
iOS: XCTest runner publishes window-relative frames and shifted taps for an iPad app that does not fill the screen (Windowed Apps / Stage Manager)Talvez já em andamento @thymikee assumiu hoje. Abertaneeds-triage
Dificuldade 4/5 3-5 dias Facilidade para iniciantes 20/100
callstack/agent-device#3899 ·
Mantenedores costumam responder em até 1 dia
-
iOS 27: `_UIFloatingBarContainerView` still marks content "covered" when the container matches its parent or sits a few points below the viewport topTalvez já em andamento @jonstuebe assumiu hoje. Abertabug
Dificuldade 4/5 1-2 dias Facilidade para iniciantes 68/100
callstack/agent-device#3883 · 1 comentário ·
Mantenedores costumam responder em até 1 dia
-
Proxy lease by device spec: --os and --image-tag, honoured or refused by the backendTalvez já em andamento @V3RON assumiu há 2 dias. Abertaenhancement
Dificuldade 5/5 Mais de uma semana Facilidade para iniciantes 25/100
callstack/agent-device#3864 · 2 comentários ·
Mantenedores costumam responder em até 1 dia
Todas as issues de callstack/agent-device
Issues semelhantes
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 66/100
db-ux-design-system/core-web#8613 ·
Mantenedores costumam responder em até 1 dia
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 82/100
Mantenedores costumam responder em até 1 dia
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 62/100
foxglove/mcap#1907 · 1 comentário ·
Mantenedores costumam responder em até 1 dia
-
bug internal-plugin pr-welcome upstream
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 78/100
dsh-tauri-desk/deepseek-harness-desktop#1225 · 1 comentário ·
-
enhancement
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 68/100
Mantenedores costumam responder em até 1 dia