random seed: generated finds a greppable-stream counterexample on main too: stdout has 189 gap lines for 190 gaps (seed 333199054)

Aperta
#102 2 commenti 0 reazioni 0 assegnatari Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
4/5
Tempo stimato
3-5 giorni
Idoneità per principianti
30/100
Tipo di issue
Bug
Chiarezza
Abbastanza chiara
Stato di attività
Attiva
Stack tecnologico
javascript, node.js
Ambito
cli, testing

Direzione di ricerca

Start in packages/oracles with the issue's replay command, using --config oracle-gaps/vitest.config.mjs gap-report-oracle; the failing unit is oracle-gaps.report / random seed: generated with seed 333199054 and path 1:1:1:1. Read the gap-report oracle and CLI stream writer to see how gaps are counted versus printed, and where the framework builds its Replay line. Done means the seed reproduces the 189-vs-190 mismatch and both the missing gap line and incorrect replay command are located.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

Summary

The end-to-end gap oracle's random unit random seed: generated found a counterexample in CI: at checkpoint cli, the greppable stream law fails with "the stdout has 189 gap lines for 190 gaps". The base fails the same way, so this is not caused by PR #90. Filed as an issue under P4, not rerun away.

  • CI: run 43688703700 (head 082991d), job Gap report end-to-end oracle (random seed, 3/3). The seed was 333199054, path 1:1:1:1.
  • Replays, each run twice with the same seed and path: on origin/main (5726197), 1 gap line short both times; on PR head 7df4a50, the same.

Replay

cd packages/oracles && ORACLE_SEED=333199054 ORACLE_PATH=1:1:1:1 ORACLE_PROPERTY=oracle-gaps.report ORACLE_UNIT='random seed: generated' pnpm exec vitest --run --config oracle-gaps/vitest.config.mjs gap-report-oracle -t "^oracle-gaps\.report(?: | > )random seed: generated$"

The counterexample history is printed in the failure message (History: {...}).

Two defects in the report

  1. The printed Replay line does not reproduce this unit. The framework prints ORACLE_SEED=... ORACLE_PATH=... ORACLE_PROPERTY=... ORACLE_UNIT=... vitest run -t '...'. In this package, a bare vitest run uses the default config and finds no file: all 173 tests are skipped. The command needs --config oracle-gaps/vitest.config.mjs gap-report-oracle. The framework should print the project's test command, or this package's replay should say so.
  2. The stream lost one gap line. The stdout has one fewer gap line than the gaps reported. The cause is not known. Related but not the same: #87 (Windows, one extra line), and #76 (an intermittent stop with results missing beside the stream log).

Cost

The unit spent 817 s in this failing run, mostly in shrinking, and the job took 14 minutes. That is over the 10-minute budget (P12). A counterexample shrinks through up to six histories, and each one runs the real CLI.

Authority

P4 (register): a counterexample is filed as an issue with its replay line, and a rerun never hides it. Under the M phase-1 decision, a random counterexample that the base also fails is filed, not blocking. The determinism-as-main reading in PR #90 applies the same rule to determinism units. The greppable-stream law (maintainer request 2026-11-12) is the one that fails.

Lingua principale
JavaScript
Stelle
5
Fork
1
Merge medio
8h 31m
PR unite (30g)
60

Preparare l'ambiente

Questo progetto non fornisce container di sviluppo, Dockerfile né guida per i contributori, quindi l'ambiente è a tuo carico: parti dal suo README e consulta la nostra guida al primo contributo per i passaggi generali.

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di TanStack/oracles

Tutte le issue di TanStack/oracles

Issue simili

Altre issue su JavaScript

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.