random seed: a reset check after its warm daemon was replaced: the mid-run check reports an authored mutant as neither cold run did (seed -12515519), on main too

オープン
#165 コメント 0 件 リアクション 0 件 担当者 0 名 GitHub で見る

メンテナーはふだん 1 日以内に返信

まだ誰も着手していません。

評価

難易度
5/5
見積もり時間
1週間以上
初心者へのやさしさ
32/100
issue の種類
バグ
明瞭さ
おおむね明確
活発さ
活発
技術スタック
javascript, typescript
領域
cli, testing

調査の方向性

Start by reading the random-seed replay and incremental check paths in the CLI and model, then reproduce the supplied history with ORACLE_SEED=-12515519 ORACLE_PATH=0. Add a regression test that shows whether the CLI or model reports the authored mutant incorrectly when the mid-run edit overlaps, then fix the mismatch and confirm the test passes.

索引モデルが issue の本文から書いたものです。

説明

A random-seed counterexample from #147's PR CI. It reproduces on main, so it is filed and does not block (R42, M-20).

  • Found: #147 at 86d092e6, run 44245048472, job Gap report end-to-end oracle (random seed, 2/4), unit random seed: a reset check after its warm daemon was replaced, ORACLE_SEED=-12515519 ORACLE_PATH=0. The property failed after 1 test and shrank 0 times.
  • Violation: checkpoint incremental, law incremental equals cold: "the check during the mid-run edit reported src/sut.ts#authored:a2 as neither cold run did, before or after the edit".
  • Base replay: replayed as a fixed history on main af156d9e, it fails the same way in 2 of 2 runs on Arclets (16.3 s and 15.4 s). On #147's head it also fails in 2 of 2 runs.
  • Scope: the history has no optional statement. The two fields #147 adds (absentObjects, optionalChains) are removed below; they change nothing in a history without one.
  • Notable fields: authored: {stmt: 4, kind: 'ambiguous'}, secondAuthored: true, steps: ['resetBeforeRead'], laterSteps: ['midrun'], midrunBy: 'b', warmReplaced: true.

History, replay by history (register M), with __proto__: null prefixes removed. laterSteps is a literal ['midrun']. stopRuns is the drawn constant NO_STOPS.

{"functions": [[{"kind": "until", "quote": "'"}, {"kind": "record"}, {"kind": "readData", "shape": "methods"}, {"kind": "oldProbe"}, {"kind": "helperCall", "helper": "reportTwice"}], [{"kind": "valueCall", "target": 1}, {"kind": "valueCall", "target": 0}, {"kind": "if", "op": ">=", "k": 2, "not": true, "quote": "'"}, {"kind": "elseIf", "op": "<", "k": 8, "quote": "'"}, {"kind": "fieldCall", "target": 0}], [{"kind": "flag", "value": true}, {"kind": "helperCall", "helper": "report"}, {"kind": "fieldCall", "target": 3}]], "containers": [], "overloads": [true], "owners": ["a", "both", "b"], "library": [], "libraryOwners": ["b"], "runes": [[{"kind": "runeStateRaw"}]], "derived": null, "sourceSpelling": "dot", "dotGen": false, "ownsSpelling": "plain", "wholeFile": "a", "template": false, "tests": [{"file": "b", "route": "random seed", "registered": true, "name": "route", "fn": 5, "input": 9, "judges": false, "law": "L", "channel": "expect", "flaky": false, "judgeBy": "soft", "hangs": false, "slow": false, "shrinks": false, "draws": false, "ioWait": false, "stops": false, "rawImport": true, "cleanupThrows": false, "asProp": false, "then": {"route": "fixed history", "input": 1}, "work": null, "timed": false}, {"file": "c", "route": "probe calibration", "registered": true, "name": "route", "fn": 6, "input": 1, "judges": false, "law": "reach agreement", "channel": "observe", "flaky": false, "judgeBy": "verdict", "hangs": false, "slow": false, "shrinks": false, "draws": false, "ioWait": false, "stops": false, "rawImport": false, "cleanupThrows": true, "asProp": true, "then": {"route": "random seed", "input": 6}, "work": null, "timed": false}, {"file": "c", "route": "random seed", "registered": true, "name": "route", "fn": 0, "input": 0, "judges": false, "law": "L", "channel": "observe", "flaky": false, "judgeBy": "verdict", "hangs": false, "slow": false, "shrinks": false, "draws": false, "ioWait": false, "stops": false, "rawImport": false, "cleanupThrows": false, "asProp": false, "then": {"route": "probe calibration", "input": 3}, "work": null, "timed": false}, {"file": "c", "route": "determinism", "registered": true, "name": "plain", "fn": 4, "input": 0, "judges": false, "law": "L", "channel": "expect", "flaky": true, "judgeBy": "soft", "hangs": false, "slow": false, "shrinks": false, "draws": false, "ioWait": false, "stops": false, "rawImport": false, "cleanupThrows": false, "asProp": false, "then": {"route": "determinism", "input": 8}, "work": null, "timed": false}], "witness": false, "authored": {"stmt": 4, "kind": "ambiguous"}, "declaration": "oracleProperty", "ownerless": false, "fault": "none", "stability": "none", "ordinary": false, "lazyGate": false, "secondAuthored": true, "consoleOutput": true, "config": "async", "configEnv": false, "setupGlobal": true, "native": "gyp", "depSubpath": true, "unbuiltDep": true, "boot": true, "budget": "two", "stopRuns": [], "onlyRun": false, "pragma": false, "cliPath": "spaced", "concurrentStart": false, "configFile": "vitest.config.ts", "configPlace": "parent", "packageType": "module", "configAwait": false, "configRequire": true, "contexts": 11, "steps": ["resetBeforeRead"], "dataOwners": ["a", "b"], "exportOwners": [], "importer": "a", "midrunBy": "b", "midrunTarget": "helper", "prePlugin": false, "fsRead": "none", "laterSteps": ["midrun"], "tornRows": false, "pauseEngages": true, "warmReplaced": true, "testRoot": "parent", "loadPlugin": false, "rejectBatch": 0, "outMode": "explicit", "logBlocked": false, "overlap": false, "stopWitness": false, "spawnStop": false, "spawnSignal": "SIGINT", "spawnDelay": 139, "spawnOnStart": false, "claimScenario": false, "logLost": false, "supervisorDeath": false, "unsupervised": false, "psMissing": false, "holdOverlap": false, "replyHeld": false, "spinData": true, "siblingDir": false, "hookStops": false, "spinThrows": false, "slowStart": false, "shortWait": false}

Next step, oracle-first: decide whether the CLI or the model is wrong about an ambiguous authored mutant's outcome in the check that a mid-run edit overlaps (R47), show RED, then fix.

This issue was written by Isaac.

主要言語
JavaScript
スター
5
フォーク
1
平均マージ
11時間 18分
マージ済み PR(30日)
66

環境構築

このプロジェクトには開発コンテナ、Dockerfile、コントリビューションガイドがありません。まず README を読み、一般的な手順ははじめてのコントリビューションガイドを参照してください。

はじめの一歩

  1. issue を最後まで読み、次にプロジェクトのコントリビューションガイドを読みます。
  2. 着手することを issue にコメントします — 二人が同じ作業をするのを防げます。
  3. リポジトリをフォークし、ブランチを切って変更します。
  4. issue 番号を参照したプルリクエストを送ります。

TanStack/oracles のほかの issue

TanStack/oracles の issue をすべて見る

似ている issue

JavaScript の issue をもっと見る

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。