iOS Simulator (iPad): press lands a fixed offset away in landscape (0,+52 left; +156,0 right) and reports success

オープン
#4,091 コメント 3 件 リアクション 0 件 担当者 0 名 GitHub で見る

メンテナーはふだん 1 日以内に返信

@thymikee がすでに取り組んでいます。

2026年11月2日 から。

  • #4157 @thymikee による — オープン

評価

難易度
4/5
見積もり時間
3〜5日
初心者へのやさしさ
55/100
issue の種類
バグ
明瞭さ
明確に書かれている
活発さ
活発
技術スタック
ios, typescript
領域
mobile

調査の方向性

Start at the press command's touch-dispatch path and trace how it handles iOS Simulator coordinates after an orientation change. Reproduce on an iPad Simulator in both landscape orientations using the coordinates in the issue, then compare the dispatched touch location with the requested point. Done means presses land at the requested coordinates in portrait and landscape, including selector presses.

索引モデルが issue の本文から書いたものです。

説明

bug ready-for-agent

Summary

On an iPad Simulator in landscape, every press lands a fixed distance away from the point asked for, and the command still reports success. The shift depends on the orientation. Portrait is exact. Snapshot rects are correct: the same element's rect from get attrs matches the accessibility frame from another tool, so only the dispatched touch is shifted.

Orientation press at App received the touch at Offset
portrait 120,300 / 600,250 / 760,700 120,300 / 600,250 / 760,700 0,0
landscape-left 120,300 / 600,250 / 300,760 120,352 / 600,302 / 300,812 0,+52
landscape-right 150,300 / 1000,250 306,300 / 1156,250 +156,0

How the landing point was measured: a passive UIGestureRecognizer on the app's key window (cancelsTouchesInView = false) records location(in: window) of every touch. For comparison, the same points tapped through idb/axe (HID) land exactly in every orientation.

Selector presses have the same shift, because they press the (correct) rect centre:

  • press 'label="Settings"' in landscape-left activated the row below it, 52 pt lower.
  • A popup menu pick selected the next menu item.

The settled diff then shows a change, so the wrong tap is reported as ok.

Repro

  1. Boot an iPad Simulator and open any app that fills the screen: agent-device open <bundle-id> --platform ios --udid <udid>.
  2. Rotate: agent-device orientation landscape-left. The app's window becomes 1180x820.
  3. Press a known point: agent-device press 120 300.
  4. The app receives the touch at (120, 352). In landscape-right, press 150 300 arrives at (306, 300).

Our workaround: press a clear spot, read where it landed, and subtract that offset from later presses. After that, taps land exactly in both landscape orientations, so the offset seems to be constant per orientation.

Environment

  • agent-device 0.21.34. The 0.21.35 notes list no related change.
  • Xcode 27.1 (27A9275), iOS 27.1 Simulator runtime, iPad (A16), macOS 27.0.1.
  • The app is a SwiftUI app with full-screen scenes (window "full", not windowed).

This may be related to #1511 (the physical-device unrotated touch space), but on the Simulator the shift is a translation, not a rotation.

主要言語
TypeScript
スター
5.2k
フォーク
359
平均マージ
13時間 31分
マージ済み PR(30日)
664

環境構築

はじめの一歩

  1. issue を最後まで読み、次にプロジェクトのコントリビューションガイドを読みます。
  2. 着手することを issue にコメントします — 二人が同じ作業をするのを防げます。
  3. リポジトリをフォークし、ブランチを切って変更します。
  4. issue 番号を参照したプルリクエストを送ります。

callstack/agent-device のほかの issue

callstack/agent-device の issue をすべて見る

似ている issue

TypeScript の issue をもっと見る

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。