Hacktoberfest 2026: as issues que os mantenedores marcaram para outubro, abertas e boas para iniciantes. Ver issues do Hacktoberfest

terraphim_rlm: require a per-sub-result verification plan (recheck / control / independent route)

Aberta
  • Algo errado?
#969 1 comentário 0 reações 0 responsáveis Ver no GitHub

Ninguém assumiu esta issue ainda.

Avaliação

Dificuldade
4/5
Tempo estimado
3-5 dias
Facilidade para iniciantes
48/100
Tipo de issue
Funcionalidade
Clareza
Claramente especificada
Status de atividade
Ativa
Stack de tecnologia
rust
Domínio
ai, testing-qa

Direção de pesquisa

Start with the RLM design doc and the rlm_* sub-call result definitions, then inspect the RLM test suite and executor paths. Done means the design states the verification requirement, results carry the accepted verified_by values with gated refusal of none, and a control test fails when execution is skipped or silently falls back.

Escrita pelo modelo de indexação a partir do texto da issue.

Descrição

Proposal

Make a verification plan for each sub-result a design requirement for terraphim_rlm decompositions. Decomposition alone does not make a long recursive run trustworthy. Every sub-call that produces a result the parent relies on should declare how that result is checked, for example:

  • an exact or deterministic re-check (a recomputation, test, schema or invariant);
  • a known-answer control instance run through the same path;
  • an independent second route, where it is cheap.

Why

The nine-loop computation (Anthropic, 2026-09-25) is a budget-bounded, decomposable, long-running job of exactly the kind RLM targets. The result was trusted because of its checks, not because of the run itself: an eight-loop control checked against the published value, exact arithmetic modulo several primes, and a cross-check between two representations. The open bugs #3405 (the Firecracker stub reports exit 0 when no VM ran) and #3406 (silent fallback to LocalExecutor) are the failure class this guards against. A sandbox that reports success when nothing ran passes every check except a known-answer control.

Acceptance

  • The RLM design doc states the requirement.
  • rlm_* sub-call results carry a verified_by field: none, recheck, control or independent. The parent can refuse results marked none for gated outputs.
  • At least one control instance in the RLM test suite fails loudly when the executor does not actually run code (covers #3405 and #3406).

Mirror of Gitea terraphim/terraphim-ai# (source of truth).

Linguagem predominante
Rust
Estrelas
65
Forks
5
Merge médio
1h 17min
PRs com merge (30d)
2

Preparar o ambiente

Primeiros passos

  1. Leia a issue inteira e depois o guia de contribuição do projeto.
  2. Comente na issue dizendo que vai assumir — evita que duas pessoas façam o mesmo trabalho.
  3. Faça um fork do repositório e trabalhe em uma branch.
  4. Abra um pull request que referencie o número da issue.

Mais de terraphim/terraphim-ai

Todas as issues de terraphim/terraphim-ai

Issues semelhantes

Mais issues de Rust

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.