feat(testing): support independent gateway and supervisor image overrides
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 4/5
- Tiempo estimado
- 3-5 días
- Aptitud para principiantes
- 52/100
- Tipo de issue
- Nueva funcionalidad
- Claridad
- Bastante claro
- Estado de actividad
- Activo
- Stack tecnológico
- docker, helm, kubernetes, shell
- Área
- devops, documentation, infrastructure, testing
Línea de trabajo
Empieza leyendo e2e/with-kube-gateway.sh, e2e/with-docker-gateway.sh y e2e/with-podman-gateway.sh para seguir cómo fluyen las imágenes de gateway y supervisor a través de Helm, las compilaciones locales y las importaciones de imágenes. Después inspecciona TESTING.md y el manejo existente de los overrides de supervisor, conservando el fallback de registro más etiqueta y definiendo la precedencia. Se considera terminado cuando las referencias independientes con etiqueta o digest funcionan en todos los wrappers, los diagnósticos muestran las imágenes resueltas y se validan los casos de fallback y override.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
User Story
As an OpenShell developer or downstream integrator, I want to configure the gateway and supervisor test images independently, so that I can run OpenShell’s test wrappers against custom, forked, mirrored, or differently named images.
Problem Statement
OpenShell’s test wrappers generally derive gateway and supervisor images from a shared registry prefix and image tag:
${REGISTRY_VALUE}/gateway:${IMAGE_TAG}
${REGISTRY_VALUE}/supervisor:${IMAGE_TAG}
This assumes that both images use the same registry, use the standard gateway and supervisor repository names, and use the same tag.
That assumption is hard-coded across the Kubernetes, Docker, and Podman test setup paths. It prevents testing images such as:
registry.example.com/custom/openshell-gateway:branch-build
registry.example.com/custom/openshell-sandbox:branch-build
or images that are pinned independently by tag or digest.
Impact / Why This Matters
Users testing downstream builds, private registries, forks, rebuilt artifacts, or alternate image layouts must currently retag their images to match OpenShell’s expected repository names or modify the test scripts locally.
This makes test execution harder to reproduce and creates unnecessary friction for CI systems where gateway and supervisor images may be published under different names or built by different pipelines.
The current Docker and Podman wrappers already support some supervisor-specific overrides, but the behavior is inconsistent across wrappers and there is no equivalent general gateway-image override.
Proposed Design
Add independent gateway and supervisor image overrides to all test wrappers that select or construct OpenShell images.
For example:
GATEWAY_IMAGE="registry.example.com/custom/gateway:test"
SUPERVISOR_IMAGE="registry.example.com/custom/supervisor:test"
When the overrides are not set, preserve the existing registry-and-tag behavior:
GATEWAY_IMAGE="${GATEWAY_IMAGE:-${REGISTRY_VALUE}/gateway:${IMAGE_TAG_VALUE}}"
SUPERVISOR_IMAGE="${SUPERVISOR_IMAGE:-${REGISTRY_VALUE}/supervisor:${IMAGE_TAG_VALUE}}"
The resolved full image references should be used consistently across:
e2e/with-kube-gateway.sh;e2e/with-docker-gateway.sh;e2e/with-podman-gateway.sh;- other test setup wrappers that build, select, or deploy gateway and supervisor images;
- Helm chart values;
- local Docker or Podman image builds;
- k3d and kind image imports;
- external-driver image composition;
- generated gateway configuration; and
- diagnostic output.
The implementation should support both tagged and digest-pinned references.
Existing variables such as OPENSHELL_SUPERVISOR_IMAGE and OPENSHELL_DOCKER_SUPERVISOR_IMAGE must remain backward compatible. The implementation should either preserve them as aliases or define clear precedence between existing variables and the new common overrides.
A possible precedence order is:
- wrapper-specific existing override;
- common
SUPERVISOR_IMAGEorGATEWAY_IMAGEoverride; - registry-plus-tag fallback.
Alternatively, the project could use namespaced variables such as OPENSHELL_E2E_GATEWAY_IMAGE and OPENSHELL_E2E_SUPERVISOR_IMAGE to avoid collisions with unrelated tooling. If the simpler names are chosen, the documentation should clearly define their scope as test-wrapper inputs.
Acceptance Criteria
- All relevant OpenShell test wrappers support independent gateway and supervisor image selection.
- A custom gateway image can use a different repository, tag, or digest from the supervisor image.
- Existing workflows using only the registry prefix and image tag continue to resolve the same images as before.
- Kubernetes Helm deployments use the resolved gateway and supervisor image references.
- Local Kubernetes image builds and k3d/kind image loading use the resolved image references.
- Docker and Podman wrappers use the resolved image references consistently.
- Existing Docker and Podman supervisor override variables remain compatible.
- Full image tags and digest references are supported.
- Wrapper output identifies the resolved gateway and supervisor images.
-
TESTING.mddocuments the new overrides, fallback behavior, and precedence rules. - Tests or shell validation cover the default fallback and independent override cases.
Alternatives Considered
Continue requiring image retagging
Users could continue retagging custom images as ${REGISTRY_VALUE}/gateway:${IMAGE_TAG} and ${REGISTRY_VALUE}/supervisor:${IMAGE_TAG}. This avoids changing the wrappers but is inconvenient, obscures the images actually under test, and is difficult to use with immutable or externally managed images.
Add separate registry prefixes
Separate gateway and supervisor registry variables could be added while retaining a shared tag. This would help with different registries but would not support independently tagged or digest-pinned images.
Use additional Helm values files
For Kubernetes, users could provide Helm overrides for the gateway and supervisor images. This would not address Docker or Podman wrappers, local image builds, image imports, or generated gateway configuration.
Related Issues
- Issue #2067 discusses gateway and supervisor version compatibility, but does not address test-wrapper image overrides.
- Issue #1299 discusses Kubernetes supervisor image delivery, but focuses on image-volume sideloading.
- Issue #1597 discusses Kubernetes E2E harness behavior, but not custom gateway and supervisor image selection.
Agent Investigation
The current repository investigation found:
e2e/with-kube-gateway.shderives both images from a shared registry and tag in Helm installation, local builds, k3d imports, and kind image loading.- The Kubernetes wrapper also embeds the supervisor image when building the external Kubernetes driver gateway image.
e2e/with-docker-gateway.shsupportsOPENSHELL_DOCKER_SUPERVISOR_IMAGEandOPENSHELL_SUPERVISOR_IMAGE, but has no equivalent gateway-image override.e2e/with-podman-gateway.shsupportsOPENSHELL_SUPERVISOR_IMAGE, but does not provide a common gateway-image override.- Current CI workflows rely on the registry-plus-tag fallback, so preserving that fallback is required for backward compatibility.
- The repository documentation currently describes
OPENSHELL_REGISTRYandIMAGE_TAGas controlling the gateway/supervisor image pair.
- Lenguaje dominante
- Rust
- Estrellas
- 8.7k
- Forks
- 1.3k
- Merge medio
- 2 d 6 h
- PR fusionados (30 d)
- 301
Guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de NVIDIA/OpenShell
-
area:docs
Dificultad 1/5 Menos de una hora Aptitud para principiantes 88/100
-
state:triage-needed
Dificultad 2/5 1-3 horas Aptitud para principiantes 82/100
-
area:cli state:validated
Dificultad 2/5 1-3 horas Aptitud para principiantes 72/100
-
state:triage-needed
Dificultad 1/5 Menos de una hora Aptitud para principiantes 90/100
-
area:build spike state:review-ready state:stale
Dificultad 2/5 Medio día Aptitud para principiantes 68/100
Todos los issues de NVIDIA/OpenShell
Issues similares
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
TheLarkInn/aipm#2413 ·
-
documentation
Dificultad 1/5 Menos de una hora Aptitud para principiantes 90/100
alexgorbatchev/simple-ptt#15 ·
-
tooling
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
-
todo:ticket
Dificultad 2/5 1-3 horas Aptitud para principiantes 70/100
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 75/100
taikoxyz/taiko-mono#22168 · 1 comentario ·