Cloud agent: viewing any image ends the session with `CAPIError: 400 The image data you provided does not represent a valid image`
還沒有人認領這個 Issue。
評估
- 難度
- 4/5
- 預估耗時
- 3-5 天
- 新手友好度
- 45/100
- Issue 類型
- 缺陷
- 描述清晰度
- 描述清楚
- 活躍度
- 活躍
- 領域
- ai-infra-agents, cli, cloud
研究方向
The issue is in the cloud agent's image handling for data residency tenants. Start by examining the view tool's implementation in the copilot-cli codebase, likely in a tools or commands directory. Look for where images are processed and sent to the model. The error suggests a validation failure in the API call after viewing. Check the session state management and error reporting. Reproduce with the provided PNG generation script. 'Done' is when viewing an image does not cause a session failure, and the error message is accurate.
由索引模型根據 Issue 內容生成。
描述
Describe the bug
Summary
In a Copilot cloud agent session on a GHEC data residency tenant (<tenant>.ghe.com), the view tool on any image file ends the session. The tool itself reports success. The next model call is rejected, and the session dies.
The error names the image as the fault. The image is never the fault. A 4 KB, 1280x720 PNG that Pillow reads as a valid RGB image fails exactly like a real screenshot.
What the session gets
Viewed image file at path /tmp/img-720.png
then
CAPIError: 400 The image data you provided does not represent a valid image.
Please check your input and try again with one of the supported image formats:
['image/jpeg', 'image/png', 'image/gif', 'image/webp']
The session state goes to failed and that message is the task's recorded error.
Reproduction
Any session. No repository state is needed.
python3 - <<'PY'
import zlib, struct
w, h = 1280, 720
row = b'\x00' + bytes([200, 40, 90]) * w
raw = row * h
def chunk(t, d):
c = t + d
return struct.pack('>I', len(d)) + c + struct.pack('>I', zlib.crc32(c) & 0xffffffff)
hdr = struct.pack('>IIBBBBB', w, h, 8, 2, 0, 0, 0)
open('/tmp/img.png', 'wb').write(b'\x89PNG\r\n\x1a\n' + chunk(b'IHDR', hdr) + chunk(b'IDAT', zlib.compress(raw, 6)) + chunk(b'IEND', b''))
PY
Then call view on /tmp/img.png. The file is 4319 bytes. PIL.Image.open reads it as (1280, 720) RGB.
What I ruled out
I made five PNGs of 1280 pixels wide and 720, 1440, 2880, 5760 and 11520 pixels tall, then viewed them one per turn, smallest first. The session died on the first one.
| Variable | Tested | Result |
|---|---|---|
| Height | 720 through 11520 | dies on the smallest |
| Byte size | 4 KB synthetic, 78 KB real screenshot, 128 KB real screenshot | all die |
| Images per turn | one | dies on one |
| Source | hand-written PNG, Playwright page.screenshot |
both die |
| Model | sweagent-capi:gpt-5.6-sol, sweagent-capi:gpt-5.6-terra |
both die |
Why this is worse than it reads
- The failing step reports success.
viewanswersViewed image file at path <path>. The agent has no way to know it has just ended the session. - The error blames the file. Every reader goes and checks the file, and the file is fine.
- It kills a session that already did its work. In our case a session implemented a work item across 24 files, passed 691 unit tests and 6 Playwright end-to-end tests, wrote its screenshots, then viewed three of them and died before it could open the pull request.
- It makes your own guidance fatal. Any instruction that tells an agent to check a screen capture before attaching it now ends the session that follows it.
What I ask for
- Make image input work, or say plainly that a cloud agent session cannot take image input on a data residency tenant.
- If it cannot, make
viewrefuse an image with a clear message instead of accepting it and killing the next model call. - Fix the error text. "The image data you provided does not represent a valid image" is wrong for a valid image, and it sends every reader to the wrong place.
Affected version
No response
Steps to reproduce the behavior
No response
Expected behavior
No response
Additional context
No response
- 主要語言
- Shell
- 星號
- 11.2k
- 分支
- 1.9k
- 平均合併
- 14 小時 16 分鐘
- 30 天內合併 PR
- 6
貢獻指南
從這裡開始
- 先讀完整個 Issue,再讀專案的貢獻指南。
- 在 Issue 下留言說明你要接手 —— 這能避免兩個人做同樣的事。
- Fork 儲存庫,在一個分支上完成修改。
- 送出 Pull Request,並在描述裡引用這個 Issue 編號。
github/copilot-cli 的其他 Issue
-
triage
難度 2/5 1-3 小時 新手友好度 75/100
github/copilot-cli#4932 ·
-
triage
難度 2/5 1-3 小時 新手友好度 78/100
github/copilot-cli#4909 ·
-
triage
難度 2/5 1-3 小時 新手友好度 76/100
github/copilot-cli#4906 ·
-
triage
難度 2/5 1-3 小時 新手友好度 72/100
github/copilot-cli#4848 ·
-
area:agents area:mcp
難度 2/5 1-3 小時 新手友好度 72/100
github/copilot-cli#4729 ·
查看 github/copilot-cli 的全部 Issue
相似的 Issue
-
難度 2/5 1-3 小時 新手友好度 70/100
huggingface/Repo2RLEnv#163 · 1 則留言 ·
-
setup tools wizard offers no GitHub auth path, and setup summary doesn't recognize `gh` CLI auth 未關閉area/auth comp/cli P3 tool/skills type/bug
難度 2/5 1-3 小時 新手友好度 75/100
NousResearch/hermes-agent#121131 ·
-
難度 2/5 1-3 小時 新手友好度 75/100
-
bug
難度 2/5 1-3 小時 新手友好度 75/100
bradcypert/plum#53 ·
-
難度 2/5 1-3 小時 新手友好度 70/100
WingedGuardian/GENesis-AGI#2301 ·