random seed: every outcome class does not enter three owner-kill states (seed -1851858881), on main too

オープン
#180 コメント 0 件 リアクション 0 件 担当者 0 名 GitHub で見る

メンテナーはふだん 1 日以内に返信

まだ誰も着手していません。

評価

難易度
4/5
見積もり時間
3〜5日
初心者へのやさしさ
35/100
issue の種類
バグ
明瞭さ
おおむね明確
活発さ
活発
技術スタック
javascript
領域
testing-qa

調査の方向性

Start with the gap-report-oracle test and replay the command in the issue using seed -1851858881. Compare the constructed history with the outcome reach checks for the three owner-kill states; the issue says the outcomes match the model but those states are not reached on main. Done means the history reaches all three states without changing the reported outcome agreement.

索引モデルが issue の本文から書いたものです。

説明

Counterexample (main's; found on #99)

Found in CI on #99 at cb1de4ff (run 44462540755, random seed 1/4):

ORACLE_SEED=-1851858881 ORACLE_PATH=0 ORACLE_PROPERTY='oracle-gaps.report' ORACLE_UNIT='random seed: every outcome class' GAP_E2E_SHRINKS=0 vitest run --config oracle-gaps/vitest.config.mjs gap-report-oracle -t '^oracle-gaps\.report(?: | > )random seed: every outcome class$'

constructed history "every outcome class" did not enter killed by a second owner, a kill in one owner after a gap in another, each owner's value change killed its own mutant. The outcomes agree with the model; only the reach is missed.

Attribution: main has it

I replayed the exact history (printed by the driver at cb1de4ff) on main 6d05f05 as a scratch constructed history with the same three states (scratch/fix99c-attr2-main, c91bbcb2). #99's fields take their neutral values; one of this history's tests had pulse: true and slowMs 16000, which main lacks.

Ref Runs Result
main 6d05f05 3 on the pool does not enter the three states, 3 of 3
#99 cb1de4ff (scratch/fix99c-attr2-head, d38050e7) 1 the same

It is main's, so it does not block #99. The cause is probably this base's drawn fields, which keep those witness-module states from being reached: for example stability: insertGuard, secondAuthored, and flaky tests in files b and c. That is not confirmed.

Full history
{"functions":[[{"kind":"call","target":1},{"kind":"helperCall","helper":"reportTwice"}],[{"kind":"factoryCall","target":0},{"kind":"valueCall","target":0},{"kind":"probeIf","op":"!==","k":0},{"kind":"loop","quote":"`"},{"kind":"probeBlock","op":">=","k":0}]],"containers":["C1","free","free"],"overloads":[false,false],"owners":["a"],"library":[[{"kind":"push","quote":"'"},{"kind":"if","op":">","k":3,"not":true,"quote":"'"}]],"libraryOwners":["none"],"runes":[[{"kind":"runeDerived"},{"kind":"runeState","op":">=","k":8},{"kind":"runeStateRaw"}]],"derived":{"params":"plain","field":false,"before":[],"form":"arrow","after":[]},"sourceSpelling":"dot","dotGen":false,"ownsSpelling":"plain","wholeFile":"none","template":true,"tests":[{"file":"c","route":"random seed","registered":false,"name":"route","fn":0,"input":6,"judges":false,"law":"reach agreement","channel":"observe","flaky":true,"judgeBy":"verdict","hangs":false,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"fixed history","input":1},"work":null,"timed":false,"slowMs":3000,"loops":0,"timerWait":null,"pulse":false,"pendingIo":null},{"file":"b","route":"calibration","registered":false,"name":"route","fn":6,"input":3,"judges":false,"law":"L","channel":"observe","flaky":true,"judgeBy":"soft","hangs":true,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"probe calibration","input":1},"work":null,"timed":false,"slowMs":3000,"loops":0,"timerWait":null,"pulse":true,"pendingIo":null},{"file":"c","route":"fixed seed","registered":true,"name":"plain","fn":1,"input":2,"judges":false,"law":"L","channel":"observe","flaky":true,"judgeBy":"soft","hangs":false,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"fixed seed","input":4},"work":null,"timed":false,"slowMs":16000,"loops":0,"timerWait":null,"pulse":false,"pendingIo":null},{"file":"a","route":"enumerated","registered":false,"name":"route","fn":0,"input":3,"judges":false,"law":"reach agreement","channel":"observe","flaky":false,"judgeBy":"soft","hangs":false,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"fixed history","input":3},"work":null,"timed":false,"slowMs":16000,"loops":0,"timerWait":null,"pulse":false,"pendingIo":null}],"witness":"capture","authored":{"stmt":0,"kind":"apply"},"declaration":"wrapper","ownerless":false,"fault":"none","stability":"insertGuard","ordinary":true,"lazyGate":false,"secondAuthored":true,"consoleOutput":true,"config":"async","configEnv":true,"setupGlobal":true,"native":"gyp","depSubpath":true,"unbuiltDep":true,"boot":false,"budget":"two","stopRuns":[{"signal":"SIGTERM","pool":"forks","when":"run"},{"signal":"SIGINT","pool":"threads","when":"run"},{"signal":"SIGINT","pool":"threads","when":"after"}],"onlyRun":false,"pragma":true,"cliPath":"spaced","concurrentStart":false,"configFile":"vitest.config.ts","configPlace":"discovered","packageType":"module","configAwait":false,"configRequire":true,"contexts":4,"steps":null,"dataOwners":["b","b"],"exportOwners":[],"importer":"none","midrunBy":"a","midrunTarget":"data","prePlugin":true,"fsRead":"callback","laterSteps":[],"tornRows":false,"pauseEngages":true,"warmReplaced":true,"testRoot":"tests","loadPlugin":false,"rejectBatch":0,"outMode":"explicit","logBlocked":false,"overlap":false,"stopWitness":false,"spawnStop":false,"spawnSignal":"SIGTERM","spawnDelay":1,"spawnOnStart":false,"claimScenario":false,"logLost":false,"supervisorDeath":false,"unsupervised":false,"psMissing":false,"holdOverlap":false,"replyHeld":false,"spinData":true,"siblingDir":false,"hookStops":true,"spinThrows":false,"slowStart":false,"shortWait":false,"absentObjects":["undefined","undefined","undefined","null","null","null","null","null"],"optionalChains":[],"hangMs":null,"heavy":0}

主要言語
JavaScript
スター
5
フォーク
1
平均マージ
11時間 18分
マージ済み PR(30日)
66

環境構築

このプロジェクトには開発コンテナ、Dockerfile、コントリビューションガイドがありません。まず README を読み、一般的な手順ははじめてのコントリビューションガイドを参照してください。

はじめの一歩

  1. issue を最後まで読み、次にプロジェクトのコントリビューションガイドを読みます。
  2. 着手することを issue にコメントします — 二人が同じ作業をするのを防げます。
  3. リポジトリをフォークし、ブランチを切って変更します。
  4. issue 番号を参照したプルリクエストを送ります。

TanStack/oracles のほかの issue

TanStack/oracles の issue をすべて見る

似ている issue

JavaScript の issue をもっと見る

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。