random seed: every outcome class does not enter three owner-kill states (seed -1851858881), on main too

Aberta
#180 0 comentários 0 reações 0 responsáveis Ver no GitHub

Mantenedores costumam responder em até 1 dia

Ninguém assumiu esta issue ainda.

Avaliação

Dificuldade
4/5
Tempo estimado
3-5 dias
Facilidade para iniciantes
35/100
Tipo de issue
Bug
Clareza
Razoavelmente clara
Status de atividade
Ativa
Stack de tecnologia
javascript
Domínio
testing-qa

Direção de pesquisa

Start with the gap-report-oracle test and replay the command in the issue using seed -1851858881. Compare the constructed history with the outcome reach checks for the three owner-kill states; the issue says the outcomes match the model but those states are not reached on main. Done means the history reaches all three states without changing the reported outcome agreement.

Escrita pelo modelo de indexação a partir do texto da issue.

Descrição

Counterexample (main's; found on #99)

Found in CI on #99 at cb1de4ff (run 44462540755, random seed 1/4):

ORACLE_SEED=-1851858881 ORACLE_PATH=0 ORACLE_PROPERTY='oracle-gaps.report' ORACLE_UNIT='random seed: every outcome class' GAP_E2E_SHRINKS=0 vitest run --config oracle-gaps/vitest.config.mjs gap-report-oracle -t '^oracle-gaps\.report(?: | > )random seed: every outcome class$'

constructed history "every outcome class" did not enter killed by a second owner, a kill in one owner after a gap in another, each owner's value change killed its own mutant. The outcomes agree with the model; only the reach is missed.

Attribution: main has it

I replayed the exact history (printed by the driver at cb1de4ff) on main 6d05f05 as a scratch constructed history with the same three states (scratch/fix99c-attr2-main, c91bbcb2). #99's fields take their neutral values; one of this history's tests had pulse: true and slowMs 16000, which main lacks.

Ref Runs Result
main 6d05f05 3 on the pool does not enter the three states, 3 of 3
#99 cb1de4ff (scratch/fix99c-attr2-head, d38050e7) 1 the same

It is main's, so it does not block #99. The cause is probably this base's drawn fields, which keep those witness-module states from being reached: for example stability: insertGuard, secondAuthored, and flaky tests in files b and c. That is not confirmed.

Full history
{"functions":[[{"kind":"call","target":1},{"kind":"helperCall","helper":"reportTwice"}],[{"kind":"factoryCall","target":0},{"kind":"valueCall","target":0},{"kind":"probeIf","op":"!==","k":0},{"kind":"loop","quote":"`"},{"kind":"probeBlock","op":">=","k":0}]],"containers":["C1","free","free"],"overloads":[false,false],"owners":["a"],"library":[[{"kind":"push","quote":"'"},{"kind":"if","op":">","k":3,"not":true,"quote":"'"}]],"libraryOwners":["none"],"runes":[[{"kind":"runeDerived"},{"kind":"runeState","op":">=","k":8},{"kind":"runeStateRaw"}]],"derived":{"params":"plain","field":false,"before":[],"form":"arrow","after":[]},"sourceSpelling":"dot","dotGen":false,"ownsSpelling":"plain","wholeFile":"none","template":true,"tests":[{"file":"c","route":"random seed","registered":false,"name":"route","fn":0,"input":6,"judges":false,"law":"reach agreement","channel":"observe","flaky":true,"judgeBy":"verdict","hangs":false,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"fixed history","input":1},"work":null,"timed":false,"slowMs":3000,"loops":0,"timerWait":null,"pulse":false,"pendingIo":null},{"file":"b","route":"calibration","registered":false,"name":"route","fn":6,"input":3,"judges":false,"law":"L","channel":"observe","flaky":true,"judgeBy":"soft","hangs":true,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"probe calibration","input":1},"work":null,"timed":false,"slowMs":3000,"loops":0,"timerWait":null,"pulse":true,"pendingIo":null},{"file":"c","route":"fixed seed","registered":true,"name":"plain","fn":1,"input":2,"judges":false,"law":"L","channel":"observe","flaky":true,"judgeBy":"soft","hangs":false,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"fixed seed","input":4},"work":null,"timed":false,"slowMs":16000,"loops":0,"timerWait":null,"pulse":false,"pendingIo":null},{"file":"a","route":"enumerated","registered":false,"name":"route","fn":0,"input":3,"judges":false,"law":"reach agreement","channel":"observe","flaky":false,"judgeBy":"soft","hangs":false,"slow":false,"shrinks":false,"draws":false,"ioWait":false,"stops":false,"rawImport":false,"cleanupThrows":false,"asProp":false,"then":{"route":"fixed history","input":3},"work":null,"timed":false,"slowMs":16000,"loops":0,"timerWait":null,"pulse":false,"pendingIo":null}],"witness":"capture","authored":{"stmt":0,"kind":"apply"},"declaration":"wrapper","ownerless":false,"fault":"none","stability":"insertGuard","ordinary":true,"lazyGate":false,"secondAuthored":true,"consoleOutput":true,"config":"async","configEnv":true,"setupGlobal":true,"native":"gyp","depSubpath":true,"unbuiltDep":true,"boot":false,"budget":"two","stopRuns":[{"signal":"SIGTERM","pool":"forks","when":"run"},{"signal":"SIGINT","pool":"threads","when":"run"},{"signal":"SIGINT","pool":"threads","when":"after"}],"onlyRun":false,"pragma":true,"cliPath":"spaced","concurrentStart":false,"configFile":"vitest.config.ts","configPlace":"discovered","packageType":"module","configAwait":false,"configRequire":true,"contexts":4,"steps":null,"dataOwners":["b","b"],"exportOwners":[],"importer":"none","midrunBy":"a","midrunTarget":"data","prePlugin":true,"fsRead":"callback","laterSteps":[],"tornRows":false,"pauseEngages":true,"warmReplaced":true,"testRoot":"tests","loadPlugin":false,"rejectBatch":0,"outMode":"explicit","logBlocked":false,"overlap":false,"stopWitness":false,"spawnStop":false,"spawnSignal":"SIGTERM","spawnDelay":1,"spawnOnStart":false,"claimScenario":false,"logLost":false,"supervisorDeath":false,"unsupervised":false,"psMissing":false,"holdOverlap":false,"replyHeld":false,"spinData":true,"siblingDir":false,"hookStops":true,"spinThrows":false,"slowStart":false,"shortWait":false,"absentObjects":["undefined","undefined","undefined","null","null","null","null","null"],"optionalChains":[],"hangMs":null,"heavy":0}

Linguagem predominante
JavaScript
Estrelas
5
Forks
1
Merge médio
11h 18min
PRs com merge (30d)
66

Preparar o ambiente

Este projeto não oferece contêiner de desenvolvimento, Dockerfile nem guia de contribuição, então a configuração fica por sua conta: comece pelo README e veja nosso guia da primeira contribuição para os passos gerais.

Primeiros passos

  1. Leia a issue inteira e depois o guia de contribuição do projeto.
  2. Comente na issue dizendo que vai assumir — evita que duas pessoas façam o mesmo trabalho.
  3. Faça um fork do repositório e trabalhe em uma branch.
  4. Abra um pull request que referencie o número da issue.

Mais de TanStack/oracles

Todas as issues de TanStack/oracles

Issues semelhantes

Mais issues de JavaScript

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.