random seed: a reset check after its warm daemon was replaced: the mid-run check reports an authored mutant as neither cold run did (seed -12515519), on main too

Offen
#165 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen

Maintainer antworten meist innerhalb von 1 Tag

Dieses Issue hat noch niemand übernommen.

Bewertung

Schwierigkeit
5/5
Geschätzter Aufwand
Über eine Woche
Anfängerfreundlichkeit
32/100
Issue-Typ
Bug
Klarheit
Größtenteils klar
Aktivitätsstatus
Aktiv
Bereich
cli, testing

Rechercherichtung

Start by reading the random-seed replay and incremental check paths in the CLI and model, then reproduce the supplied history with ORACLE_SEED=-12515519 ORACLE_PATH=0. Add a regression test that shows whether the CLI or model reports the authored mutant incorrectly when the mid-run edit overlaps, then fix the mismatch and confirm the test passes.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Beschreibung

A random-seed counterexample from #147's PR CI. It reproduces on main, so it is filed and does not block (R42, M-20).

  • Found: #147 at 86d092e6, run 44245048472, job Gap report end-to-end oracle (random seed, 2/4), unit random seed: a reset check after its warm daemon was replaced, ORACLE_SEED=-12515519 ORACLE_PATH=0. The property failed after 1 test and shrank 0 times.
  • Violation: checkpoint incremental, law incremental equals cold: "the check during the mid-run edit reported src/sut.ts#authored:a2 as neither cold run did, before or after the edit".
  • Base replay: replayed as a fixed history on main af156d9e, it fails the same way in 2 of 2 runs on Arclets (16.3 s and 15.4 s). On #147's head it also fails in 2 of 2 runs.
  • Scope: the history has no optional statement. The two fields #147 adds (absentObjects, optionalChains) are removed below; they change nothing in a history without one.
  • Notable fields: authored: {stmt: 4, kind: 'ambiguous'}, secondAuthored: true, steps: ['resetBeforeRead'], laterSteps: ['midrun'], midrunBy: 'b', warmReplaced: true.

History, replay by history (register M), with __proto__: null prefixes removed. laterSteps is a literal ['midrun']. stopRuns is the drawn constant NO_STOPS.

{"functions": [[{"kind": "until", "quote": "'"}, {"kind": "record"}, {"kind": "readData", "shape": "methods"}, {"kind": "oldProbe"}, {"kind": "helperCall", "helper": "reportTwice"}], [{"kind": "valueCall", "target": 1}, {"kind": "valueCall", "target": 0}, {"kind": "if", "op": ">=", "k": 2, "not": true, "quote": "'"}, {"kind": "elseIf", "op": "<", "k": 8, "quote": "'"}, {"kind": "fieldCall", "target": 0}], [{"kind": "flag", "value": true}, {"kind": "helperCall", "helper": "report"}, {"kind": "fieldCall", "target": 3}]], "containers": [], "overloads": [true], "owners": ["a", "both", "b"], "library": [], "libraryOwners": ["b"], "runes": [[{"kind": "runeStateRaw"}]], "derived": null, "sourceSpelling": "dot", "dotGen": false, "ownsSpelling": "plain", "wholeFile": "a", "template": false, "tests": [{"file": "b", "route": "random seed", "registered": true, "name": "route", "fn": 5, "input": 9, "judges": false, "law": "L", "channel": "expect", "flaky": false, "judgeBy": "soft", "hangs": false, "slow": false, "shrinks": false, "draws": false, "ioWait": false, "stops": false, "rawImport": true, "cleanupThrows": false, "asProp": false, "then": {"route": "fixed history", "input": 1}, "work": null, "timed": false}, {"file": "c", "route": "probe calibration", "registered": true, "name": "route", "fn": 6, "input": 1, "judges": false, "law": "reach agreement", "channel": "observe", "flaky": false, "judgeBy": "verdict", "hangs": false, "slow": false, "shrinks": false, "draws": false, "ioWait": false, "stops": false, "rawImport": false, "cleanupThrows": true, "asProp": true, "then": {"route": "random seed", "input": 6}, "work": null, "timed": false}, {"file": "c", "route": "random seed", "registered": true, "name": "route", "fn": 0, "input": 0, "judges": false, "law": "L", "channel": "observe", "flaky": false, "judgeBy": "verdict", "hangs": false, "slow": false, "shrinks": false, "draws": false, "ioWait": false, "stops": false, "rawImport": false, "cleanupThrows": false, "asProp": false, "then": {"route": "probe calibration", "input": 3}, "work": null, "timed": false}, {"file": "c", "route": "determinism", "registered": true, "name": "plain", "fn": 4, "input": 0, "judges": false, "law": "L", "channel": "expect", "flaky": true, "judgeBy": "soft", "hangs": false, "slow": false, "shrinks": false, "draws": false, "ioWait": false, "stops": false, "rawImport": false, "cleanupThrows": false, "asProp": false, "then": {"route": "determinism", "input": 8}, "work": null, "timed": false}], "witness": false, "authored": {"stmt": 4, "kind": "ambiguous"}, "declaration": "oracleProperty", "ownerless": false, "fault": "none", "stability": "none", "ordinary": false, "lazyGate": false, "secondAuthored": true, "consoleOutput": true, "config": "async", "configEnv": false, "setupGlobal": true, "native": "gyp", "depSubpath": true, "unbuiltDep": true, "boot": true, "budget": "two", "stopRuns": [], "onlyRun": false, "pragma": false, "cliPath": "spaced", "concurrentStart": false, "configFile": "vitest.config.ts", "configPlace": "parent", "packageType": "module", "configAwait": false, "configRequire": true, "contexts": 11, "steps": ["resetBeforeRead"], "dataOwners": ["a", "b"], "exportOwners": [], "importer": "a", "midrunBy": "b", "midrunTarget": "helper", "prePlugin": false, "fsRead": "none", "laterSteps": ["midrun"], "tornRows": false, "pauseEngages": true, "warmReplaced": true, "testRoot": "parent", "loadPlugin": false, "rejectBatch": 0, "outMode": "explicit", "logBlocked": false, "overlap": false, "stopWitness": false, "spawnStop": false, "spawnSignal": "SIGINT", "spawnDelay": 139, "spawnOnStart": false, "claimScenario": false, "logLost": false, "supervisorDeath": false, "unsupervised": false, "psMissing": false, "holdOverlap": false, "replyHeld": false, "spinData": true, "siblingDir": false, "hookStops": false, "spinThrows": false, "slowStart": false, "shortWait": false}

Next step, oracle-first: decide whether the CLI or the model is wrong about an ambiguous authored mutant's outcome in the check that a mid-run edit overlaps (R47), show RED, then fix.

This issue was written by Isaac.

Vorherrschende Sprache
JavaScript
Sterne
5
Forks
1
Ø Merge
11 Std. 18 Min.
Gemergte PRs (30 T.)
66

Entwicklungsumgebung

Dieses Projekt bietet weder Dev-Container noch Dockerfile noch Beitragsleitfaden – die Einrichtung liegt bei Ihnen. Beginnen Sie mit der README; die allgemeinen Schritte stehen in unserem Leitfaden für den ersten Beitrag.

Erste Schritte

  1. Lesen Sie das ganze Issue und danach den Beitragsleitfaden des Projekts.
  2. Schreiben Sie ins Issue, dass Sie es übernehmen — das erspart doppelte Arbeit.
  3. Forken Sie das Repository und arbeiten Sie in einem Branch.
  4. Öffnen Sie einen Pull Request, der die Issue-Nummer nennt.

Mehr aus TanStack/oracles

Alle Issues in TanStack/oracles

Ähnliche Issues

Weitere Issues zu JavaScript

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.