Explain native inspection failure when the desktop or target window becomes unavailable
Los mantenedores suelen responder en 1 día
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 4/5
- Tiempo estimado
- 3-5 días
- Aptitud para principiantes
- 15/100
- Tipo de issue
- Error
- Claridad
- Necesita aclaración
- Estado de actividad
- Activo
- Stack tecnológico
- macos, swift
- Área
- accessibility, desktop
Línea de trabajo
The payload names no source files. Start from the inventory fields observation_capability, observation_reason, and is_on_screen, and from the typed target_unavailable refusal shipped in #87. Reproduce the offscreen-versus-locked-desktop distinction on macOS, then add the recovery check that githubnext/ace2#8 requires. Done means that check passes and the unavailable-desktop limitation can be removed.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Status (Oct 6)
Shipped: pixels-mode inspection and target availability reporting (#71), and typed target_unavailable refusal for a known locked session with unlock-and-refresh guidance (#87, details). Remaining: a reliable distinction and recovery path for an offscreen/other-desktop target versus an unavailable desktop versus incomplete Accessibility, sparse initial WKWebView Accessibility trees (seen in #73), and the real recovery check below. The Chrome window-title mismatch is tracked separately in githubnext/desktop-tools#6.
Original report
During real desktop-action dogfooding for githubnext/ace2#8 / githubnext/ace2#63, native inspection became unavailable after previously passing against the same live Ace-dev process and window. The agent received an incomplete Accessibility-tree error without an actionable explanation of target availability.
Observed on the signed macOS development app:
- The real local pi click/type/key/button workflow and delivered-input Stop/restart checks had passed.
- A subsequent local Workers/Durable Objects run passed its seed native inspection, then two model
desktop_inspectcalls failed withDESKTOP_ERROR: Warning: AX tree incomplete at incomplete accessibility read. - Fresh native inventory still returned the same process instance/window and bounds, with
is_minimized: false, butis_on_screen: false,observation_capability: pixels_only, andobservation_reason: no_matching_accessibility_window. Inventory itself reported complete. - Codex computer use could still read and capture that test window. Its Raise and Ace's Show Ace action did not restore native availability in the subsequent inventory.
- No mutation ran in the failed hosted workflow. No evidence establishes whether a Space/desktop/controlled-surface change or another macOS condition caused the availability change; this is not yet a confirmed hosted-transport defect.
Expected: give the agent a bounded, useful explanation when native window/Accessibility availability changes, retain the exact target, and require a fresh observation when the target is available again. Do not silently switch to another window, steal focus, or replay uncertain input as recovery.
Investigate which native state reliably distinguishes an offscreen/other-desktop target, a locked/unavailable desktop, and incomplete Accessibility. Add a real recovery check under githubnext/ace2#8's visual targeting and longer-workflow slice. Keep the unavailable-desktop limitation explicit until that check passes.
- Lenguaje dominante
- Swift
- Estrellas
- 0
- Forks
- 0
- Merge medio
- 15 min
- PR fusionados (30 d)
- 94
Preparar el entorno
Este proyecto no incluye contenedor de desarrollo, Dockerfile ni guía de contribución, así que la configuración corre por tu cuenta: empieza por su README y consulta nuestra guía para la primera contribución para los pasos generales.
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de githubnext/desktop-tools
-
Ace: adopt desktopToolRules()Abiertoace documentation
Dificultad 2/5 1-3 horas Aptitud para principiantes 79/100
githubnext/desktop-tools#104 ·
Los mantenedores suelen responder en 1 día
-
Agent task coverage auditAbiertodocumentation
Dificultad 4/5 3-5 días Aptitud para principiantes 35/100
githubnext/desktop-tools#75 · 1 comentario ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 55/100
githubnext/desktop-tools#42 · 29 comentarios ·
Los mantenedores suelen responder en 1 día
-
enhancement
Dificultad 5/5 Más de una semana Aptitud para principiantes 15/100
githubnext/desktop-tools#27 · 3 comentarios ·
Los mantenedores suelen responder en 1 día
-
question
Dificultad 5/5 Más de una semana Aptitud para principiantes 8/100
githubnext/desktop-tools#24 ·
Los mantenedores suelen responder en 1 día
Todos los issues de githubnext/desktop-tools
Issues similares
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 74/100
Emanuele-web04/remodex#203 ·
Los mantenedores suelen responder en 1 día
-
bug
Dificultad 2/5 1-3 horas Aptitud para principiantes 92/100
Los mantenedores suelen responder en 1 día
-
test(BrainBar): inject synthetic observabilityCadence in BackupsHealth/one-page fixtures (DCI-1)Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 74/100
EtanHey/brainlayer#1367 ·
Los mantenedores suelen responder en 1 día
-
cmux-next: new workspaces show no name instead of workspace-NPosiblemente ocupada Un pull request vinculado a esta issue está abierto o ya se fusionó. Abiertoarea: workspaces
Dificultad 2/5 1-3 horas Aptitud para principiantes 82/100
manaflow-ai/cmux#21357 · 1 comentario ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 82/100
Los mantenedores suelen responder en 4 días