random seed: an ambiguous authored mutant: field-drop judged not-distinguished, owed indeterminate (seed 333199054), on main too

Open
#116 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
48/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Active
Domain
backend, testing

Research direction

In packages/oracles, replay the reported seed and path with the provided Vitest command, then inspect the trace for src/sut.ts:D_OBJ:30:field-drop#0 and compare the expected and reported outcomes. The issue says the cause is not established, so start by determining why the model expects indeterminate while the CLI reports not-distinguished. Done when the counterexample is understood and the replay no longer shows that classification difference.

Written by the indexing model from the issue text.

Description

Summary

The random unit random seed: an ambiguous authored mutant found a classification counterexample on seed 333199054 (path 0:0:0:0:0:0:0) in the random shard 1/3 of PR #90's seed measurement (run 43778881284). The CLI reports src/sut.ts:D_OBJ:30:field-drop#0 as not-distinguished, and the model owes indeterminate.

It reproduces with the same seed and path on origin/main (4d3c8a9): the replay job replay 333199054 an ambiguous authored mutant in run 43782377713 fails with the same difference. So it is a base defect, not caused by PR #90. Filed under P4.

Replay

cd packages/oracles && ORACLE_SEED=333199054 ORACLE_PATH=0:0:0:0:0:0:0 ORACLE_PROPERTY=oracle-gaps.report ORACLE_UNIT='random seed: an ambiguous authored mutant' pnpm exec vitest --run --config oracle-gaps/vitest.config.mjs gap-report-oracle -t "^oracle-gaps\.report(?: | > )random seed: an ambiguous authored mutant$"

The printed Replay line omits the config (#108).

Checked against #115 and #99

#115 (stream law) and #99 (wall-clock cut) do not name field-drop or indeterminate, and #99 has no mention of the indeterminate outcome. The cause is not established. It may be a timing cut that gives indeterminate on one side only, but that is a guess until the trace is read.

Dominant language
JavaScript
Stars
5
Forks
1
Avg merge
6h
Merged PRs (30d)
56

Getting set up

This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from TanStack/oracles

All issues in TanStack/oracles

Similar issues

More JavaScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.