terraphim_rlm: require a per-sub-result verification plan (recheck / control / independent route)
还没有人认领这个 Issue。
评估
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 新手友好度
- 48/100
- Issue 类型
- 功能
- 描述清晰度
- 描述清楚
- 活跃度
- 活跃
- 技术栈
- rust
- 领域
- ai, testing-qa
调研方向
Start with the RLM design doc and the rlm_* sub-call result definitions, then inspect the RLM test suite and executor paths. Done means the design states the verification requirement, results carry the accepted verified_by values with gated refusal of none, and a control test fails when execution is skipped or silently falls back.
由索引模型根据 Issue 内容生成。
描述
Proposal
Make a verification plan for each sub-result a design requirement for terraphim_rlm decompositions. Decomposition alone does not make a long recursive run trustworthy. Every sub-call that produces a result the parent relies on should declare how that result is checked, for example:
- an exact or deterministic re-check (a recomputation, test, schema or invariant);
- a known-answer control instance run through the same path;
- an independent second route, where it is cheap.
Why
The nine-loop computation (Anthropic, 2026-09-25) is a budget-bounded, decomposable, long-running job of exactly the kind RLM targets. The result was trusted because of its checks, not because of the run itself: an eight-loop control checked against the published value, exact arithmetic modulo several primes, and a cross-check between two representations. The open bugs #3405 (the Firecracker stub reports exit 0 when no VM ran) and #3406 (silent fallback to LocalExecutor) are the failure class this guards against. A sandbox that reports success when nothing ran passes every check except a known-answer control.
Acceptance
- The RLM design doc states the requirement.
rlm_*sub-call results carry averified_byfield:none,recheck,controlorindependent. The parent can refuse results markednonefor gated outputs.- At least one control instance in the RLM test suite fails loudly when the executor does not actually run code (covers #3405 and #3406).
Mirror of Gitea terraphim/terraphim-ai# (source of truth).
- 主要语言
- Rust
- 星标
- 65
- 派生
- 5
- 平均合并
- 1 小时 17 分钟
- 30 天内合并 PR
- 2
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
terraphim/terraphim-ai 的其他 Issue
-
难度 5/5 一周以上 新手友好度 35/100
terraphim/terraphim-ai#968 · 1 条评论 ·
-
难度 5/5 一周以上 新手友好度 35/100
terraphim/terraphim-ai#967 ·
-
难度 4/5 3-5 天 新手友好度 48/100
terraphim/terraphim-ai#966 ·
-
难度 5/5 一周以上 新手友好度 30/100
terraphim/terraphim-ai#965 · 2 条评论 ·
-
难度 5/5 一周以上 新手友好度 25/100
terraphim/terraphim-ai#885 ·
查看 terraphim/terraphim-ai 的全部 Issue
相似的 Issue
-
enhancement
难度 2/5 1-3 小时 新手友好度 78/100
zcashlabs/thus-spoke-zakura#153 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 79/100
topgrade-rs/topgrade#2395 ·
维护者通常 1 天内回复
-
app bug windows-os
难度 2/5 1-3 小时 新手友好度 67/100
维护者通常 1 天内回复
-
editor good first issue
难度 2/5 1-3 小时 新手友好度 65/100
funnyboy-roks/inq#54 ·
-
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 1 天内回复