Android snapshot helper suppresses TalkBack; no verified reader-compatible input path
维护者通常 1 天内回复
还没有人认领这个 Issue。
评估
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 新手友好度
- 18/100
- Issue 类型
- 缺陷
- 描述清晰度
- 基本清楚
- 活跃度
- 活跃
- 技术栈
- android, java
- 领域
- accessibility, mobile
调研方向
Start with the helper connection in android/snapshot-helper/src/main/java/com/callstack/agentdevice/snapshothelper/SnapshotInstrumentation.java, where getUiAutomation() is called without flags, and compare it with the Android UiAutomation flag the report cites. Reproducing needs an Android 16 emulator with TalkBack enabled, so check the report's dumpsys accessibility steps first. Done means TalkBack stays bound across a snapshot and an input, and a reader focus gesture produces the expected focus and speech events.
由索引模型根据 Issue 内容生成。
描述
Android snapshot helper suppresses TalkBack; no verified reader-compatible input path
On Android 16, the T3-managed agent-device 0.21.31 snapshot helper leaves
TalkBack enabled in secure settings but unbound. Closing my own agent-device
session releases UiAutomation and TalkBack binds again. A subsequent long press
leaves it rebinding. This blocks actual TalkBack focus and speech validation.
Environment
- agent-device 0.21.31 through T3's device-bound command and managed daemon.
- Linux host, Android 16 emulator, API 36, 1080 by 2400 display.
- Android Accessibility Suite 16.0.0.738667889, version code 60149353.
- App under test: RenovioMobile debug build, package
io.renovio.mobile. - Observed on 2026-11-02 UTC. No installed helper patches or daemon configuration changes.
Reproduction
DEVICE below denotes the exact device-bound command returned by T3. Commands
must use the same owned session. These are the significant steps extracted from
the retained probes, not a separately executed standalone-daemon reproduction.
-
Open the app and capture a snapshot with TalkBack off:
"$DEVICE" open io.renovio.mobile --no-test-ime "$DEVICE" snapshot -i -
Enable the installed TalkBack service. The observed fixture saved the original
accessibility settings first and enabled TalkBack and touch exploration through
Android secure settings. Inspect the service state without another UI tool:adb -s emulator-5554 shell settings get secure enabled_accessibility_services adb -s emulator-5554 shell dumpsys accessibility -
Observe TalkBack in
Enabled services, emptyBound servicesand an active
Ui Automation[...]entry. Close only this owned session:"$DEVICE" closeTalkBack then appears in
Bound servicesand connects to TTS. -
In a separate probe, closing the named TalkBack package through the same
session preserved the exact app PID. Reopening the app and enabling TalkBack
permitted binding. The next long press left TalkBack inBinding services:"$DEVICE" close com.google.android.marvin.talkback "$DEVICE" open io.renovio.mobile --no-test-ime # Ensure TalkBack is enabled and bound before this input. "$DEVICE" press 300 350 --hold-ms 800
The point in step 4 is the observed probe coordinate. It demonstrates service
interruption, not a successful target-focus test.
Plain-tap countercheck
With no helper active, TalkBack stayed bound across a plain coordinate press.
The visible button had two matching bounds observations, [87,1557][993,1704],
wholly inside the display. Pressing its center, 540 1630, activated Login
instead of producing the button's TalkBack focus and completed speech.
The PID-filtered log contained completed startup utterances, but no accepted and
completed target-focus utterance for Continue as Project Owner. Normal press
may intentionally activate a control; I am not claiming it promises touch
exploration. This countercheck shows that closing the helper and using plain
press did not provide a working reader-testing alternative.
Suspected cause and requested support
Android documents that UiAutomation suppresses accessibility services unless
the caller requests
FLAG_DONT_SUPPRESS_ACCESSIBILITY_SERVICES.
The v0.21.36 helper connection
still calls getUiAutomation() without flags. This supports the suppression
explanation; v0.21.36 was inspected, not executed. The public helper-session
setting controls persistence and does not request non-suppression.
Please provide or document a supported mode that preserves TalkBack and permits
reader exploration and activation. The Android flag is a candidate repair for
service suppression, not a demonstrated fix for the input behavior.
Acceptance check
- TalkBack stays bound with touch exploration enabled across snapshots and input.
- A reader exploration gesture focuses a labelled button without activating it.
- For that gesture, the same TalkBack PID emits
TYPE_VIEW_ACCESSIBILITY_FOCUSED
with the expected label, accepts the TTS request and completes the utterance
within the action's observation window. Startup speech or snapshot labels do
not count. - A deliberate reader double tap activates the focused button once.
- Closing the owned session leaves the reader usable, and the test restores its
original accessibility and developer preferences.
Limits and related work
I have not tested a physical device, a standalone daemon, or v0.21.36 at runtime.
A public minimal APK or upstream test-app reproduction is not attached. The
retained app probes restored all four original accessibility secure keys and
TalkBack developer preferences. No full device logs containing app data are
included here.
Issue #851 concerns helper
ownership of UiAutomation. This report concerns coexistence with the actual
TalkBack service. Searches of issues and pull requests for TalkBack and
DONT_SUPPRESS_ACCESSIBILITY_SERVICES found no matching report on 2026-11-02 UTC.
- 主要语言
- TypeScript
- 星标
- 5.2k
- 派生
- 359
- 平均合并
- 13 小时 23 分钟
- 30 天内合并 PR
- 655
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
callstack/agent-device 的其他 Issue
-
iOS alert wait: the last poll can get ~30 ms and turns "no alert" into a failed read可能已有人在做 @pcbeingused333 于 2 天前认领。 未关闭bug ready-for-agent
难度 2/5 1-3 小时 新手友好度 77/100
callstack/agent-device#4018 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 68/100
callstack/agent-device#1869 ·
维护者通常 1 天内回复
-
Daemon: refuse leased requests that name no session at request admission可能已有人在做 @airowe 今天认领。 未关闭bug ready-for-agent
难度 4/5 3-5 天 新手友好度 25/100
callstack/agent-device#4171 ·
维护者通常 1 天内回复
-
enhancement needs-triage
难度 4/5 3-5 天 新手友好度 35/100
callstack/agent-device#4162 · 1 条评论 ·
维护者通常 1 天内回复
-
enhancement
难度 4/5 3-5 天 新手友好度 43/100
callstack/agent-device#4110 · 2 条评论 ·
维护者通常 1 天内回复
查看 callstack/agent-device 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 1 天内回复
-
ready-for-agent
难度 2/5 1-3 小时 新手友好度 72/100
LucasSantana-Dev/Lucky#2951 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 75/100
danielmiessler/LifeOS#2567 ·
维护者通常 9 天内回复
-
refactor(react-pi): classify base64 images with core's parseBase64可能已有人在做 @jimmyallinai 今天认领。 未关闭maintenance
难度 2/5 1-3 小时 新手友好度 62/100
assistant-ui/assistant-ui#10293 · 2 条评论 · 1 个 reaction ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 70/100
brijeshb42/monaco-vim#175 ·