Add AGENTS.md guidance for verifying multi-workspace E2E fix coverage
Nobody has claimed this yet.
Assessment
- Difficulty
- 1/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 90/100
- Issue type
- Documentation
- Clarity
- Clearly specified
- Activity status
- Active
- Domain
- documentation, testing-qa
Research direction
Read AGENTS.md, especially the “E2E Nightly Fix Conventions” section around the “Allowed modifications” guidance near line 473. Add the proposed “Multi-workspace fix coverage” subsection, preserving its four verification steps. Done means the guidance explains how to enumerate affected workspaces, cross-reference changes, document exclusions, and verify completeness.
Written by the indexing model from the issue text.
Description
What happened
PR #3354 attempted to fix issue #3347, which listed ~66 test failures across 21+ workspaces with keycloak auth. The code agent modified 14 workspaces (18 files) but missed 3 keycloak-auth workspaces: argocd, intelligent-assistant, and app-defaults. The issue body listed all initially-affected workspaces, and triage recurrence comments on Aug 22–25 added argocd and intelligent-assistant to the affected list. The code agent did not cross-reference its changes against the issue’s affected-workspaces list, resulting in incomplete coverage that would have left those workspaces broken even if the OCI references had been correct.
What could go better
The code agent should systematically verify that its fix covers all components listed as affected in the issue. AGENTS.md has extensive E2E guidance (auto-generation behavior, config file creation, best practices) but no instruction to cross-check fix scope against the issue’s stated impact. When an issue lists 21+ affected workspaces, the code agent should enumerate all of them, verify each is addressed (by the fix or by the framework), and flag any discrepancies. This is especially important for cross-cutting E2E issues where the affected list evolves through triage recurrence comments. Confidence: high — the issue body and triage comments contained the complete affected workspace list, and the 3 missed workspaces (argocd, intelligent-assistant, app-defaults) were all identifiable from available information.
Proposed change
Add a subsection to AGENTS.md under ‘E2E Nightly Fix Conventions’ (after ‘Allowed modifications’, around line 473):
### Multi-workspace fix coverage
When an E2E failure issue lists specific affected workspaces or projects:
1. **Enumerate** all workspaces listed in the issue body and any triage recurrence comments as affected
2. **Cross-reference** each affected workspace against your proposed changes
3. **Document exclusions** — for any affected workspace not covered by the fix, add a comment in your commit message or PR body explaining why (e.g., “relies on auto-generation from metadata; the framework-level fix in e2e-test-utils handles this” or “uses guest auth, not affected by OIDC issue”)
4. **Verify completeness** before committing — `grep -r` for the pattern you’re adding/modifying across all workspace e2e-tests directories to confirm you haven’t missed any existing configs that need the same change
Validation criteria
The next code agent run that fixes an E2E failure affecting multiple workspaces either (a) covers all workspaces listed in the issue or (b) explicitly documents in its commit message or PR body why specific workspaces were excluded. Measurable over the next 3 multi-workspace E2E fix PRs.
Generated by retro agent from https://github.com/redhat-developer/rhdh-plugin-export-overlays/pull/3354
- Dominant language
- TypeScript
- Stars
- 9
- Forks
- 72
- Avg merge
- 3d 9h
- Merged PRs (30d)
- 133
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from redhat-developer/rhdh-plugin-export-overlays
-
documentation non-workspace-changes ready-for-triage ready-to-code
Difficulty 1/5 1-3 hours Newbie friendliness 88/100
redhat-developer/rhdh-plugin-export-overlays#3815 · 3 comments ·
-
documentation non-workspace-changes ready-for-triage ready-to-code
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
redhat-developer/rhdh-plugin-export-overlays#3810 · 3 comments ·
-
Add AGENTS.md review guidance: Prettier/ESLint/TypeScript violations in e2e-tests are CI-blocking Opendocumentation ready-for-triage ready-to-code
Difficulty 1/5 Under an hour Newbie friendliness 88/100
redhat-developer/rhdh-plugin-export-overlays#3792 · 3 comments ·
-
e2e-failure ready-to-code
Difficulty 1/5 Under an hour Newbie friendliness 88/100
redhat-developer/rhdh-plugin-export-overlays#3789 · 1 comment ·
-
e2e-failure ready-to-code
Difficulty 1/5 Under an hour Newbie friendliness 88/100
redhat-developer/rhdh-plugin-export-overlays#3788 · 1 comment ·
All issues in redhat-developer/rhdh-plugin-export-overlays
Similar issues
-
calcite-components needs triage refactor
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
Esri/calcite-design-system#15203 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 91/100
-
community first-timers-only good first issue hacktoberfest help wanted low hanging fruit up-for-grabs
Difficulty 1/5 Under an hour Newbie friendliness 95/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Automattic/studio#4908 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 90/100