[TS PBT] Evaluate runtime-derived PBT hints for symbolic search
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 5/5
- Tempo stimato
- Più di una settimana
- Idoneità per principianti
- 35/100
Direzione di ricerca
Read #354's sequential HYBRID comparison and dependencies #354, #356, and #384 first; this issue names no implementation files or tests. Identify the existing per-property run artifacts and observation payload entry points, then freeze one bounded hint and budget split. Done means comparing the same properties, backend, seeds, and budgets with useful and misleading fixtures, replay-confirmed results, fallback accounting, unsupported and negative outcomes, and a short decision.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Part of #345. Depends on #354, #356 and the shared contract #384.
Goal
Test whether a small amount of concrete runtime feedback improves symbolic property search enough to justify keeping it.
Scope
- Start with at most one or two observation kinds motivated by the frozen development corpus, such as numeric ranges or array lengths. Do not implement every conceivable type/shape observation before measuring benefit.
- Reuse existing per-property run artifacts and a small optional observation payload. A backend without observations is supported by skipping this experiment.
- Define the selected hint precisely: its measured source, translation and whether it changes ordering or temporarily restricts the input domain. It never becomes a declared property precondition.
- For temporarily restricted search, run a bounded hinted attempt, then restart from the full declared domain without hints if no confirmed violation is found.
- Reserve a positive hint-free budget in advance and include observation, startup, hinted search, fallback and replay in the same total budget.
- A fallback with the remaining budget does not guarantee the same discoveries as a full-budget hint-free run. Report this cost rather than claiming preservation of completeness.
- Keep the hinted attempt and fallback separately attributable.
- Compare with #354's sequential HYBRID on the same properties, backend, seeds and total budgets. Include one useful and one misleading observation fixture.
Definition of Done
- The selected hint mechanism and budget split are frozen before the comparison.
- A misleading hint fixture demonstrates that fallback removes the hint restrictions and can recover a counterexample; it is not a general discovery guarantee.
- Results report replay-confirmed findings, time to confirmation, overhead and fallback frequency. State/solver counters are optional when already available.
- Negative results and unsupported observations remain visible.
- A short decision retains the tested subset, rejects it, or proposes one bounded follow-up.
- No general invariant miner, object-shape framework, relation mining or dynamic engine-selection scheduler is introduced.
This experiment is optional for the baseline article. #357 may proceed without it, explicitly recording that runtime hints were not evaluated. It must not block baseline evaluation merely because an optional production feature has not been built.
- Lingua principale
- Kotlin
- Stelle
- 33
- Fork
- 27
- Merge medio
- 4g 3h
- PR unite (30g)
- 15
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di UnitTestBot/usvm
-
Difficoltà 5/5 Più di una settimana Idoneità per principianti 45/100
UnitTestBot/usvm#388 ·
-
Difficoltà 5/5 Più di una settimana Idoneità per principianti 25/100
UnitTestBot/usvm#384 ·
-
Difficoltà 5/5 Più di una settimana Idoneità per principianti 35/100
UnitTestBot/usvm#382 ·
-
Difficoltà 4/5 3-5 giorni Idoneità per principianti 48/100
UnitTestBot/usvm#379 ·
-
Difficoltà 5/5 Più di una settimana Idoneità per principianti 25/100
UnitTestBot/usvm#373 ·
Tutte le issue di UnitTestBot/usvm
Issue simili
-
autoteam community team/use
Difficoltà 2/5 1-3 ore Idoneità per principianti 78/100
-
android: AlbumArtistDetailViewModel keeps groupKeys of albums that disappeared in expandedAlbums Apertatask
Difficoltà 2/5 1-3 ore Idoneità per principianti 70/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 90/100
aaif-goose/goose#12496 ·
-
Schema rejections are neither logged nor attributed, so the offending object cannot be identified Aperta
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
zotero/zotero-android#350 ·
-
enhancement
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
Richie97/track-history#325 ·