Expose read-only fact-type advice before test expectations are authored
Maintainers usually reply within 1 day
@kikashy is already working on this.
Since Oct 14, 2026.
Assessment
This issue has not been assessed yet.
Description
Desk test snapshots begin as prepared facts with no expected outcome. The existing experimental matrix validator correctly requires each matrix row to declare an expectation, so it cannot serve as the pre-authoring fact-comparability check without fabricating policy.
Expose a bounded, read-only experimental fact-type advisory taking exact pack and facts JSON text (and optional supported extensions). Reuse the evaluator's existing CheckFactTypes implementation. Do not evaluate, coerce inputs, change matrix admission, infer expected results, read the project or write audit records.
Acceptance:
- Missing, false, zero, null, decimal strings and JSON numbers preserve their representation.
- Invalid packs/facts and work limits cannot return a misleading clean check.
- Strict argument admission, runtime-owned findings and contract/version metadata are covered by MCP tests.
- Desk can freeze Inputs snapshots with expectations left unset; tests remain exploratory until independently reviewed.
Required by Judgment-Pack/judgment-pack-desk#391. This is a Runtime tooling interface extension; Spec semantics and Gateway are unchanged.
- Dominant language
- Go
- Stars
- 2
- Forks
- 6
- Avg merge
- 3h 32m
- Merged PRs (30d)
- 73
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from Judgment-Pack/judgment-pack-runtime
-
Pin which layer refuses an evaluation-corpus pack pathMay be free again @soyeladice-svg claimed this 18 days ago, and no pull request is open. Opengo good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
Judgment-Pack/judgment-pack-runtime#120 · 3 comments ·
Maintainers usually reply within 1 day
-
Pin Sanitize's substitution and what it leaves aloneMay be free again @soyeladice-svg claimed this 18 days ago, and no pull request is open. Opengo good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
Judgment-Pack/judgment-pack-runtime#119 · 3 comments ·
Maintainers usually reply within 1 day
-
Boundary-test the decimal comparison operand grammarMay be free again @soyeladice-svg claimed this 18 days ago, and no pull request is open. Opengo good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Judgment-Pack/judgment-pack-runtime#118 · 3 comments ·
Maintainers usually reply within 1 day
-
Add shared offline Policy document tooling after companion adoptionPossibly taken @kikashy claimed this today. Open
Judgment-Pack/judgment-pack-runtime#293 · 1 assignee ·
Maintainers usually reply within 1 day
-
Assert every refusal the `uri` format checker makes, including a truncated percent escapeMay be free again @soyeladice-svg claimed this 18 days ago, and no pull request is open. Opengo good first issue
Difficulty 3/5 1-2 days Newbie friendliness 57/100
Judgment-Pack/judgment-pack-runtime#173 · 3 comments ·
Maintainers usually reply within 1 day
All issues in Judgment-Pack/judgment-pack-runtime
Similar issues
-
documentation priority:p1
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
yeixio/toskar-core#697 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
keyxmakerx/Chronicle#1532 ·
Maintainers usually reply within 1 day
-
The acquisition fixture's search path skips the argument table production enforces (regression from #285)Possibly taken A pull request linked to this issue is open or already merged. Open
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Judgment-Pack/judgment-pack-gateway#293 ·
Maintainers usually reply within 1 day
-
bug desktop v3 windows
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
esengine/DeepSeek-Reasonix#13697 · 1 comment ·
Maintainers usually reply within 1 day
-
good first issue help wanted
Difficulty 1/5 Under an hour Newbie friendliness 95/100
eugenioenko/ttt#959 ·
Maintainers usually reply within 1 day