determinism: the stream-lost-after-note, completed history recorded different traces once (commit 9d71756)

Aperta
#100 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
4/5
Tempo stimato
3-5 giorni
Idoneità per principianti
30/100
Tipo di issue
Bug
Chiarezza
Da chiarire
Stato di attività
Attiva
Stack tecnologico
javascript, typescript
Ambito
testing

Direzione di ricerca

Start from the CLI run r57m-det and the unwritableLog trace emitted for this history; reproduce the pair of runs and diff the full traces, since the reported 2,000-character prefix is identical and #81 truncates what distinguishes them. Read #81 and #84 first, then check whether wall-clock heartbeats enter the CLI output path. Done looks like a full failing/passing trace pair showing the differing field, or a deterministic reproduction.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

Tags: determinism, oracle-gaps, #57 (feat/gap-cli-stream-log).

Commit: 9d71756 (pool run r57m-det, two runs of one history, the same unit as determinism: constructed history: a stream log lost after its note, then completed). Run once; the same unit passed at 7a59640 and 92d7ab0.

Observed: the two runs of the history recorded different unwritableLog traces. The first 2,000 characters of each are identical (the difference is later, which #81 hides):

First run (the 2,000-character prefix, 1986 characters):

unwritableLog {"ending":"complete","exit":0,"signal":null,"stdout":"oracle-gaps: note log <out>/stream.log\noracle-gaps: baseline pass tests/a.test.ts: 1 test\noracle-gaps: baseline pass tests/b.test.ts: 0 tests, 1 skipped\noracle-gaps: baseline pass tests/c.test.ts (ordinary): 0 tests, 1 skipped\noracle-gaps: baseline all 2 oracle files pass\noracle-gaps: summary 395076321439: 44 mutants, 1 killed, 18 gaps, 11 unowned (warnings). 11 source files, 2 oracle files, 1 ordinary test files, 0 authored mutants, seed 1, pool threads.\noracle-gaps: legend unreached: Add an owner test that runs line N and asserts on its result.\noracle-gaps: function fn e0 (..gen/extra.ts)\noracle-gaps: gap unreached L2 ..gen/extra.ts:M1 ` out.push('s19'); ` → ` ; `\noracle-gaps: function fn help (src/es-function.ts)\noracle-gaps: gap unreached L2 es-function.ts:M1 ` out.push('s3'); ` → ` ; `\noracle-gaps: function fn default (src/es-function.ts)\noracle-gaps: gap unreached L5 es-function.ts:M2 ` help(out); ` → ` ; `\noracle-gaps: function fn help (src/es-arrow.ts)\noracle-gaps: gap unreached L2 es-arrow.ts:M1 ` out.push('s5'); ` → ` ; `\noracle-gaps: function fn default (src/es-arrow.ts)\noracle-gaps: gap unreached L5 es-arrow.ts:M2 ` help(out); ` → ` ; `\noracle-gaps: function fn help (src/es-paren.ts)\noracle-gaps: gap unreached L2 es-paren.ts:M1 ` out.push('s7'); ` → ` ; `\noracle-gaps: function fn default (src/es-paren.ts)\noracle-gaps: gap unreached L5 es-paren.ts:M2 ` help(out); ` → ` ; `\noracle-gaps: function fn help (src/cjs.js)\noracle-gaps: gap unreached L2 cjs.js:M1 ` out.push('s9'); ` → ` ; `\noracle-gaps: function fn default (src/cjs.js)\noracle-gaps: gap unreached L5 cjs.js:M2 ` help(out); ` → ` ; `\noracle-gaps: function fn help (src/cjs-chained.js)\noracle-gaps: gap unreached L2 cjs-chained.js:M1 ` out.push('s11'); ` → ` ; `\noracle-gaps: function fn default (src/cjs-chained.js)\noracle-gaps: gap unreached L5 cjs-chained.js:M2 ` help(out); ` → ` ; `\noracle-gaps: function f

Second run (prefix, 1986 characters, identical up to the truncation):

unwritableLog {"ending":"complete","exit":0,"signal":null,"stdout":"oracle-gaps: note log <out>/stream.log\noracle-gaps: baseline pass tests/a.test.ts: 1 test\noracle-gaps: baseline pass tests/b.test.ts: 0 tests, 1 skipped\noracle-gaps: baseline pass tests/c.test.ts (ordinary): 0 tests, 1 skipped\noracle-gaps: baseline all 2 oracle files pass\noracle-gaps: summary 395076321439: 44 mutants, 1 killed, 18 gaps, 11 unowned (warnings). 11 source files, 2 oracle files, 1 ordinary test files, 0 authored mutants, seed 1, pool threads.\noracle-gaps: legend unreached: Add an owner test that runs line N and asserts on its result.\noracle-gaps: function fn e0 (..gen/extra.ts)\noracle-gaps: gap unreached L2 ..gen/extra.ts:M1 ` out.push('s19'); ` → ` ; `\noracle-gaps: function fn help (src/es-function.ts)\noracle-gaps: gap unreached L2 es-function.ts:M1 ` out.push('s3'); ` → ` ; `\noracle-gaps: function fn default (src/es-function.ts)\noracle-gaps: gap unreached L5 es-function.ts:M2 ` help(out); ` → ` ; `\noracle-gaps: function fn help (src/es-arrow.ts)\noracle-gaps: gap unreached L2 es-arrow.ts:M1 ` out.push('s5'); ` → ` ; `\noracle-gaps: function fn default (src/es-arrow.ts)\noracle-gaps: gap unreached L5 es-arrow.ts:M2 ` help(out); ` → ` ; `\noracle-gaps: function fn help (src/es-paren.ts)\noracle-gaps: gap unreached L2 es-paren.ts:M1 ` out.push('s7'); ` → ` ; `\noracle-gaps: function fn default (src/es-paren.ts)\noracle-gaps: gap unreached L5 es-paren.ts:M2 ` help(out); ` → ` ; `\noracle-gaps: function fn help (src/cjs.js)\noracle-gaps: gap unreached L2 cjs.js:M1 ` out.push('s9'); ` → ` ; `\noracle-gaps: function fn default (src/cjs.js)\noracle-gaps: gap unreached L5 cjs.js:M2 ` help(out); ` → ` ; `\noracle-gaps: function fn help (src/cjs-chained.js)\noracle-gaps: gap unreached L2 cjs-chained.js:M1 ` out.push('s11'); ` → ` ; `\noracle-gaps: function fn default (src/cjs-chained.js)\noracle-gaps: gap unreached L5 cjs-chained.js:M2 ` help(out); ` → ` ; `\noracle-gaps: function f

Suspected cause: wall-clock timing in the CLI's output (#84's class). The difference cannot be seen until #81 is fixed. The full traces of a passing/failing pair would settle it; the run's log is not kept.

Links: #81 (the 2,000-character truncation that hides the difference), #84 (wall-clock heartbeats, a suspected cause).

Not blocking: this was one observed flake; the unit passed in two later runs. Filed under P4 (an observed counterexample is filed, not kept as a watch item).

Lingua principale
JavaScript
Stelle
5
Fork
1
Merge medio
6h
PR unite (30g)
56

Preparare l'ambiente

Questo progetto non fornisce container di sviluppo, Dockerfile né guida per i contributori, quindi l'ambiente è a tuo carico: parti dal suo README e consulta la nostra guida al primo contributo per i passaggi generali.

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di TanStack/oracles

Tutte le issue di TanStack/oracles

Issue simili

Altre issue su JavaScript

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.