Vertex AI Agent Engine sandbox `:execute` returning 404 NOT_FOUND in us-central1
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 25/100
Research direction
Start by reproducing the failure through client.agent_engines.sandboxes.execute_code(...) and compare it with the sandbox GET response, using the request shapes and SDK versions listed in the issue. Check whether the missing connectionInfo and routing_token can be addressed in the client; done means identifying a client-side change or confirming that a server-side rollout or workaround is required.
Written by the indexing model from the issue text.
Description
Summary
Since 2026-04-28 ~18:51 UTC, calls to the Vertex AI Agent Engine sandbox :execute endpoint return 404 NOT_FOUND ("Requested entity was not found.") for newly created sandboxes in us-central1. The sandbox is verified to be in STATE_RUNNING immediately before the failing call. Affects both production and staging projects, consistent with a server-side rollout.
Versions
google-cloud-aiplatform==1.133.0google-genai==1.73.1google-adk==1.29.0- Python 3.11
Repro
client.agent_engines.sandboxes.execute_code(...) posts:
POST https://us-central1-aiplatform.googleapis.com/v1/<sandbox>/:execute
Content-Type: application/json
{ "inputs": [{ "mimeType": "application/json",
"data": "<base64 of {\"code\":\"...\"}>" }] }
Manual probing confirms :execute is reachable and validates input:
| Body | HTTP |
|---|---|
{"inputs":[{"mimeType":"application/json","data":<...>}]} (current SDK shape) |
404 |
{"inputs":[{"mimeType":"text/x-python","data":<...>}]} |
400 INVALID_ARGUMENT |
{"inputs":[{"mimeType":"text/plain","data":<...>}]} |
400 INVALID_ARGUMENT |
{"inputData": ...} (legacy) |
400, "Unknown name 'inputData'" |
{"code": "..."} |
400, "Unknown name 'code'" |
Legacy :executeCode |
404 (empty body) |
Additional findings
- Race / propagation ruled out. Re-running with a 10s wait after
STATE_RUNNINGreproduces the same 404. GET <sandbox>returns onlyname, displayName, createTime, updateTime, state, spec, expireTime. NoconnectionInfofield. Per commit677b55e,SandboxEnvironmentConnectionInfois whererouting_tokenlives in the new schema. The server isn't returning that block, so no client (old or new) has anything to forward.- HEAD-of-
mainSDK reproduces the same 404. Built python-aiplatform frommainat HEAD (commit0bb2ecd, past677b55e), calledexecute_code()against a fresh staging sandbox inSTATE_RUNNING. Result was identical:ClientError 404 NOT_FOUND. {'error': {'code': 404, 'message': 'Requested entity was not found.', 'status': 'NOT_FOUND'}}. The HEAD SDK still emits themimeType=application/jsonshape because the server never populatesconnectionInfo. - The reproducer ran as the same service account our live staging Cloud Run service runs as, ruling out an IAM artefact specific to a probing identity.
Hypothesis
A server-side rollout to :execute in us-central1 on or around 2026-04-28T18:00 UTC changed the contract to require routing information that the API does not currently expose on the sandbox GET payload. The fix may need to ship server-side.
Asks
- Can you confirm whether a server-side change to Agent Engine sandbox
:executewas rolled out inus-central1on/around 2026-04-28T18:00 UTC. - Any interim server-side workaround / route still accepting the previous shape?
Tracked internally on Google IssueTracker 507490536.
- Dominant language
- Python
- Stars
- 907
- Forks
- 467
- Avg merge
- 1d 8h
- Merged PRs (30d)
- 40
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from googleapis/python-aiplatform
-
api: vertex-ai
Difficulty 1/5 Under an hour Newbie friendliness 85/100
googleapis/python-aiplatform#7132 ·
-
api: vertex-ai
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
googleapis/python-aiplatform#7097 ·
-
CustomContainerTrainingJob.run drops max_wait_duration=0 instead of requesting indefinite DWS wait Openapi: vertex-ai
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
googleapis/python-aiplatform#7067 · 1 comment ·
-
api: vertex-ai
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
googleapis/python-aiplatform#6877 ·
-
api: vertex-ai
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
googleapis/python-aiplatform#6865 · 1 comment ·
All issues in googleapis/python-aiplatform
Similar issues
-
bug confirmed issue
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
open-webui/open-webui#30750 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
OpenwaterHealth/openmotion-bloodflow-app#604 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
-
good first issue
Difficulty 1/5 Under an hour Newbie friendliness 90/100