bug: gator selects an inactive Kubernetes E2E label and CI help promises skipped suites
维护者通常 1 天内回复
@purp 已经在做这个了。
开始于 2026年9月19日。
评估
这个 Issue 还没有评估数据。
描述
User Story
As an OpenShell maintainer using gator to validate a Helm or Kubernetes PR, I want the selected test labels and bot instructions to enable the intended CI jobs, so that I can obtain runtime coverage without reverse-engineering workflow conditions.
Problem Statement
Gator's test-label guidance, the E2E Label Help bot, and CI.md disagree with the executable Branch E2E Checks workflow.
Observed on PR #3459 (feat(helm): make cluster-scoped RBAC optional) at head e876b74eb9a83ecda9d1b1e349981cfea84c6cef:
- Gator applied
test:e2e-kuberneteswithouttest:e2e. Its instructions explicitly recommend the Kubernetes-specific label for Helm, namespace, controller, and related changes. - The help bot told the maintainer to rerun all jobs and promised Kubernetes HA and credential-driver E2E.
- Attempt 2 of the linked workflow completed successfully after metadata resolution, with the build and E2E jobs skipped. Its metadata log contained
LABELS_JSON: ["test:e2e-kubernetes","gator:blocked"]. - The workflow enables standard
kubernetes-e2ethroughtest:e2e. It hardcodes bothrun_kubernetes_ha_e2eandrun_kubernetes_credential_drivers_e2etofalse;test:e2e-kubernetestherefore enables no suite in this revision.
There is no label-promotion step that adds test:e2e. The trusted pull-request/3459 mirror already matched the PR head, so another /ok to test <SHA> comment would not resolve this selection mismatch. Gator remained blocked awaiting test dispatch; this report does not claim it declared the PR validated.
Impact / Why This Matters
Maintainers follow actionable bot instructions and spend another CI attempt without obtaining the advertised coverage. A successful workflow conclusion can obscure that every runtime test was skipped, and gator's handoff remains blocked.
The immediate workaround for standard Kubernetes coverage is to add test:e2e and rerun all jobs. That enables the broader core E2E suite; it does not enable the disabled HA or credential-driver jobs. The workaround requires inspecting workflow source and knowing which similarly named label actually controls the desired tests. It does not correct guidance for subsequent PRs or deliver the specialized coverage the bot promises.
Acceptance Criteria
- Gator's label-selection guidance for Helm/Kubernetes changes agrees with the suites actually available in the applicable workflow revision; requesting standard Kubernetes E2E selects the label that enables it.
- E2E Label Help and
CI.mdaccurately describe each supported label. If HA or credential-driver suites remain disabled, they do not promise those jobs will run, and they explain any supported alternative. - Following the documented label-and-rerun sequence on a current-head PR makes the intended test jobs eligible to execute after successful prerequisite builds.
- Gator distinguishes an intended suite that ran from one whose jobs were all skipped, even when the enclosing workflow concluded successfully, and reports an actionable reason for missing coverage.
- Focused regression coverage detects drift between supported test labels, suite-selection conditions, and the help instructions, including the Kubernetes-label-only case.
Reproduction Steps
- Use a Helm/Kubernetes PR whose trusted mirror matches the current head, with no E2E labels initially set. PR #3459 is the observed example.
- Run gator with its existing label-selection instructions. For #3459, it applied only
test:e2e-kubernetesas the test label. - Follow E2E Label Help's instruction to select Re-run all jobs on the existing Branch E2E Checks run.
- Inspect metadata and job conclusions: the Kubernetes label is present, but
run_core_e2eis false and the specialized Kubernetes switches are also false. Build and test jobs are skipped. - Compare the advertised HA/credential-driver coverage with those workflow conditions.
PR #3459 subsequently received test:e2e manually; use the preserved attempt-2 evidence rather than its current labels to inspect the original failure.
Environment
- Observed: 2026-09-19, NVIDIA/OpenShell GitHub Actions.
- Gator payload: version 9, supervised Codex watch mode; source revision
cb93f62bfe7aef5cae92c8e46cba4ac9b00f9899. - Local gateway:
0.0.117-dev.188+gcb93f62bf, Docker-backed gateway on macOS. The defect is in repository CI/agent instructions, not the local gateway. - Workflow: Branch E2E Checks, push event on
pull-request/3459, run35344440601, attempt 2, heade876b74eb9a83ecda9d1b1e349981cfea84c6cef. - The same label-selection guidance and disabled workflow switches were also observed on the default branch when investigated.
Evidence
- 主要语言
- Rust
- 星标
- 13.2k
- 派生
- 1.6k
- 平均合并
- 1 天 21 小时
- 30 天内合并 PR
- 344
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
NVIDIA/OpenShell 的其他 Issue
-
state:triage-needed
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 1 天内回复
-
state:triage-needed
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 1 天内回复
-
state:triage-needed
难度 1/5 1-3 小时 新手友好度 88/100
维护者通常 1 天内回复
-
area:docs
难度 1/5 1 小时以内 新手友好度 88/100
维护者通常 1 天内回复
-
state:triage-needed
难度 2/5 1-3 小时 新手友好度 82/100
NVIDIA/OpenShell#3400 · 1 条评论 ·
维护者通常 1 天内回复
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 76/100
维护者通常 1 天内回复
-
bug
难度 2/5 1-3 小时 新手友好度 90/100
维护者通常 1 天内回复
-
agent:triaged bug bughunt pm:npm priority:p1
难度 2/5 1-3 小时 新手友好度 82/100
SocketDev/socket-patch#464 · 1 条评论 ·
维护者通常 1 天内回复
-
bug
难度 2/5 1-3 小时 新手友好度 85/100
维护者通常 1 天内回复
-
bug
难度 2/5 1-3 小时 新手友好度 76/100
维护者通常 1 天内回复