bug(agents): agent launcher fails --publish-image on transient registry push timeouts
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 76/100
Research direction
Start with scripts/agents/image.sh and inspect deliver_agent_image, where ce push currently fails the launch on any error. Check the launcher’s existing logging and error handling before choosing a bounded retry approach. Done means transient failures log each attempt and can recover while still printing the digest pinned image reference; persistent failures remain actionable and leave sandbox and settings unchanged.
Written by the indexing model from the issue text.
Description
Related to #3469. Found while running the registry delivery path from #4744.
User Story
I run gator against a remote Kubernetes gateway, publishing the tooling image with scripts/agents/run.sh --publish-image. I directly hit push failures that a retry would have absorbed, so that one slow layer upload doesn't throw away a completed build.
Problem Statement
--publish-image runs one ce push and fails the launch on any error (scripts/agents/image.sh, deliver_agent_image: ce push "$image_tag" || fail "image push failed"). Large layer uploads to Artifact Registry intermittently fail with net/http: timeout awaiting response headers. Each failure aborts the launcher after the image is already built and some layers are already uploaded.
Impact / Why This Matters
The gator tooling image is about 450 MB compressed. Two consecutive --publish-image --build-only runs failed on a different large layer each time. A plain docker push of the same local tag then succeeded on its second attempt. That means rerunning the launcher by hand until it works, or pushing outside the launcher and resolving the digest manually. Doing it by hand also bypasses the launcher's digest check.
Acceptance Criteria
- A transient push failure is retried a bounded number of times before the launcher fails.
- Each retry is logged with the attempt number and the underlying error.
- After a successful retry, the launcher still resolves and prints the digest-pinned
Tooling image:reference. - A persistent failure (for example an authentication error) still fails with an actionable error and no sandbox, provider, or settings changes.
Reproduction Steps
- Configure Docker auth for an Artifact Registry repository the user can push to.
- On an arm64 Mac, run
DOCKER_DEFAULT_PLATFORM=linux/amd64 ./scripts/agents/run.sh --agent gator --gateway <gateway> --publish-image <region>-docker.pkg.dev/<project>/<repo>/gator:<tag> --build-only. - Observe intermittent
failed commit on ref "layer-sha256:…": … net/http: timeout awaiting response headersfollowed byerror: image push failed.
Environment
- OpenShell: launcher from #4744 (
c8afb7321); gateway0.1.6-dev.26+g229382e51 - OS: macOS (arm64), Docker with buildx emulating linux/amd64
- Runtime, deployment, or integration: Kubernetes compute driver on a managed cloud cluster; Artifact Registry
Suggested UX (if applicable)
openshell-agent-launcher: Publishing '…/gator:payload-13-7fa522fae'.
openshell-agent-launcher: push attempt 1/3 failed: timeout awaiting response headers; retrying in 5s
openshell-agent-launcher: Tooling image: …/gator@sha256:e88f5a66…
Logs
failed commit on ref "layer-sha256:eda61e0e…": failed to do request: Put "https://<region>-docker.pkg.dev/artifacts-uploads/…": net/http: timeout awaiting response headers
error: image push failed
- Dominant language
- Rust
- Stars
- 17.1k
- Forks
- 1.8k
- Avg merge
- 2d 9h
- Merged PRs (30d)
- 355
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from NVIDIA/OpenShell
-
bug: workspace access hint suggests a --subject command that fails for hyphen-leading OIDC subjectsOpen
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day
-
state:triage-needed
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
Maintainers usually reply within 1 day
-
bug(install): install.sh prints gawk "escape sequence \. treated as plain ." warnings on RPM hostsPossibly taken @ericcurtin claimed this 2 days ago. Openstate:triage-needed
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
Maintainers usually reply within 1 day
-
bug(sdk/go): browser login callback binds 127.0.0.1 but redirect_uri uses localhostMay be free again A pull request for this issue was closed without being merged. Openstate:triage-needed
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
NVIDIA/OpenShell#4518 · 1 comment ·
Maintainers usually reply within 1 day
-
state:triage-needed
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
Maintainers usually reply within 1 day
All issues in NVIDIA/OpenShell
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 85/100
farion1231/cc-switch#8829 ·
Maintainers usually reply within 1 day
-
bug ci good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 92/100
longbridge/gpui-kit#3677 ·
Maintainers usually reply within 1 day
-
E-pr-welcome
Difficulty 2/5 1-3 hours Newbie friendliness 77/100
seanmonstar/reqwest#3121 · 2 comments ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 68/100
ilya-zlobintsev/LACT#1235 ·
Maintainers usually reply within 1 day