Add committed dashboard-copy parity test (automation vs repoman)

Open
#6 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
52/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Active
Tech stack
github, shell
Domain
testing-qa

Research direction

Start with the existing tests/test-vendor-engine.sh to match the shell test style. The new test should fetch automation's dashboard script and lib files with gh api at a pinned SHA kept as a constant, then diff them against the vendored copies in the automation-health-dashboard skill. Done means the test passes on identical copies, fails when either side changes alone, and has an offline escape hatch. The issue does not settle the cache design or the exact file list.

Written by the indexing model from the issue text.

Description

Re-filed from rossoctl/agent-skills#47 (originally opened by @rubambiza) after RepoMan was cloned into this repo. Original discussion/history lives there.

Still applies in repoman: only tests/test-vendor-engine.sh exists; no dashboard-copy parity check. Title updated from "automation vs agent-skills" to "automation vs repoman". Closely related to the standalone-skill resync (#5).


The automation-health-dashboard skill vendors a byte-for-byte copy of the
automation repo's dashboard script + lib set. The RepoMan Phase 5 spec
(§Testing, "Dashboard-copy parity") wants a committed parity assertion so
the copy cannot silently drift — a one-time manual check is exactly how it went
stale before (rossoctl/automation#100, surfaced again by clawgenti on PR #46).

Proposed approach: a committed test that fetches automation's copies via
gh api at a pinned ref/SHA (stored as a constant) and diffs them against the
in-repo copies, failing loudly in CI when either side changes without the
other. Preferred over a vendored snapshot, which is just a second manual copy
that can drift the same way. Costs: a CI network dependency (mitigate with a
short cache or a SKIP_PARITY_CHECK offline escape hatch) and a visible
single-line pinned-SHA bump whenever automation's dashboard changes
intentionally.

Deferred out of PR #46 (verbatim-resync scope); fits the RepoMan Phase 6
dashboard-hardening pass.

Assisted-By: Claude Code


Update: the two inherited github-api.sh correctness bugs that were briefly tracked here have been split out to rossoctl/automation#103 and fixed on the Phase 5 automation branch (re-synced here in f039911). This issue now covers only the committed copy-parity guard (Phase 6).

Dominant language
Shell
Stars
7
Forks
1
Avg merge
5d 10h
Merged PRs (30d)
2

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from rossoctl/repoman

All issues in rossoctl/repoman

Similar issues

More Shell/Bash issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.