Validate desktop tool use in Ace and track known gaps
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 5/5
- Tempo stimato
- Più di una settimana
- Idoneità per principianti
- 8/100
- Tipo di issue
- Funzionalità
- Chiarezza
- Abbastanza chiara
- Stato di attività
- Attiva
- Stack tecnologico
- macos, typescript
- Ambito
- desktop-dev, testing
Direzione di ricerca
This is a tracking issue for validating desktop tools in a signed Canary, not a single change. The one open check is the sharing path: a teammate's invocation with sharing on should reach desktop tools as the owner allowed, and with sharing off it should be refused. The upstream engine and its gaps live in githubnext/desktop-tools, so start with native/patches/README.md there for the Peekaboo patch state. Done means every check passes in a Canary with a real provider run and each gap is fixed or accepted.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Validate the desktop tools as Ace ships them, and keep the known gaps in one place. The engine and its roadmap live in githubnext/desktop-tools (the former meta is githubnext/desktop-tools#11). This issue covers only what Ace owns: the pinned package, the channel setting, sharing, and the agent's experience in real runs.
Done when: every check below has passed in a signed Canary with a real provider run, with that Canary's version noted, and every gap is fixed or explicitly accepted.
Validation
- An agent drives TextEdit, then screenshots and reads its window. The screenshots stream to a teammate. (Study scenario 20, 0.0.36.)
- The agent fills a Save sheet's name, picks a folder and saves (#378 via githubnext/ace#382 and desktop-tools#8, 20b, 0.0.38).
-
desktop_inserttypes into a Save sheet's filename field (#390 via githubnext/ace#402 and desktop-tools#9, 20c). - Turning desktop tools off refuses every
desktop_*call. The refusal is clear, and turning them back on works without restarting the channel. (Study D2, 0.0.46.50.) - A teammate's invocation with sharing on reaches desktop tools as the owner allowed. With sharing off it is refused. The sharing text matches what happens.
- Stopping a run, or losing the connection, during a desktop action settles it as completed, refused or unknown, and the action isn't replayed after the worker reopens. (Study D3b/D3c, 0.0.46.50.)
- Two channels with desktop tools on at the same time don't act on each other's targets. (Study D4 and R1, 0.0.46.51 and .52. Agents can't yet tell whose new window is whose: githubnext/desktop-tools#17.)
- Peekaboo patch tests pass at the pinned commit (desktop-tools#10, Ace githubnext/ace#425). Every pin bump re-runs them. (8801b31 in full; 4618b33 adds one bridge patch, and its bridge tests pass.)
Known gaps
- Shell capture: with desktop tools off, the shell can still capture the screen with Ace's macOS permissions. Isolating that is not planned (#379). The wording in githubnext/ace#380 and githubnext/ace#389 documents it.
- Background key presses:
desktop_keycan't verify a background Cmd+W. The recovery hint suggests--foreground, which the tool doesn't expose (githubnext/desktop-tools#11, comment from October 7). - Engine gaps, tracked in desktop-tools:
- focus and paste in WebKit (githubnext/desktop-tools#5);
- temporary clipboard paste (githubnext/desktop-tools#3);
- pointer delivery and multiple displays (githubnext/desktop-tools#2);
- Chrome's Accessibility titles (githubnext/desktop-tools#6);
- why inspection is unavailable (githubnext/desktop-tools#1);
- window, menu and dialog workflows, including Ace's own Open Folder picker (githubnext/desktop-tools#4);
- patch drift in dev builds (githubnext/desktop-tools#7).
- Not available everywhere: cloud compute channels have no desktop, so their toggle is hidden (#422). Hosted channels use the workspace host's desktop. Operating a teammate's desktop is deferred (#202).
- Upstream test failures: two Peekaboo tests fail on unpatched 4.8.0 as well (
native/patches/README.mdin desktop-tools).
Tracked by githubnext/ace#5.
- Lingua principale
- TypeScript
- Stelle
- 1
- Fork
- 0
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Preparare l'ambiente
- Nessun Dockerfile né file Docker Compose
- Ha un modello di pull request
- Nessuna guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di githubnext/ace2
-
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 94/100
githubnext/ace2#487 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 90/100
githubnext/ace2#486 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 67/100
githubnext/ace2#459 ·
-
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 88/100
githubnext/ace2#437 ·
-
Difficoltà 4/5 3-5 giorni Idoneità per principianti 35/100
githubnext/ace2#442 ·
Tutte le issue di githubnext/ace2
Issue simili
-
documentation
Difficoltà 2/5 1-3 ore Idoneità per principianti 74/100
components-web-app/docs#260 ·
-
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 65/100
521xueweihan/HelloGitHub#4025 ·
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 72/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
ctrf-io/playwright-ctrf-json-reporter#117 ·
I maintainer di solito rispondono entro 1 giorno
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 82/100
voidzero-dev/void#478 ·
I maintainer di solito rispondono entro 1 giorno