iOS Simulator (iPad): press lands a fixed offset away in landscape (0,+52 left; +156,0 right) and reports success

Abierto
  • ¿Algo no está bien?
#4,091 3 comentarios 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

@thymikee ya está trabajando en esto.

Desde el 2/11/2026.

  • #4157 de @thymikee — abierto

Evaluación

Dificultad
4/5
Tiempo estimado
3-5 días
Aptitud para principiantes
55/100
Tipo de issue
Error
Claridad
Bien especificado
Estado de actividad
Activo
Stack tecnológico
ios, typescript
Área
mobile

Línea de trabajo

Start at the press command's touch-dispatch path and trace how it handles iOS Simulator coordinates after an orientation change. Reproduce on an iPad Simulator in both landscape orientations using the coordinates in the issue, then compare the dispatched touch location with the requested point. Done means presses land at the requested coordinates in portrait and landscape, including selector presses.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

bug ready-for-agent

Summary

On an iPad Simulator in landscape, every press lands a fixed distance away from the point asked for, and the command still reports success. The shift depends on the orientation. Portrait is exact. Snapshot rects are correct: the same element's rect from get attrs matches the accessibility frame from another tool, so only the dispatched touch is shifted.

Orientation press at App received the touch at Offset
portrait 120,300 / 600,250 / 760,700 120,300 / 600,250 / 760,700 0,0
landscape-left 120,300 / 600,250 / 300,760 120,352 / 600,302 / 300,812 0,+52
landscape-right 150,300 / 1000,250 306,300 / 1156,250 +156,0

How the landing point was measured: a passive UIGestureRecognizer on the app's key window (cancelsTouchesInView = false) records location(in: window) of every touch. For comparison, the same points tapped through idb/axe (HID) land exactly in every orientation.

Selector presses have the same shift, because they press the (correct) rect centre:

  • press 'label="Settings"' in landscape-left activated the row below it, 52 pt lower.
  • A popup menu pick selected the next menu item.

The settled diff then shows a change, so the wrong tap is reported as ok.

Repro

  1. Boot an iPad Simulator and open any app that fills the screen: agent-device open <bundle-id> --platform ios --udid <udid>.
  2. Rotate: agent-device orientation landscape-left. The app's window becomes 1180x820.
  3. Press a known point: agent-device press 120 300.
  4. The app receives the touch at (120, 352). In landscape-right, press 150 300 arrives at (306, 300).

Our workaround: press a clear spot, read where it landed, and subtract that offset from later presses. After that, taps land exactly in both landscape orientations, so the offset seems to be constant per orientation.

Environment

  • agent-device 0.21.34. The 0.21.35 notes list no related change.
  • Xcode 27.1 (27A9275), iOS 27.1 Simulator runtime, iPad (A16), macOS 27.0.1.
  • The app is a SwiftUI app with full-screen scenes (window "full", not windowed).

This may be related to #1511 (the physical-device unrotated touch space), but on the Simulator the shift is a translation, not a rotation.

Lenguaje dominante
TypeScript
Estrellas
5.2k
Forks
359
Merge medio
13 h 31 min
PR fusionados (30 d)
664

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de callstack/agent-device

Todos los issues de callstack/agent-device

Issues similares

Más issues de TypeScript

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.