No process-level heap cap: OOM aborts (rc 134); sandbox max_bytes misses general growth
Los mantenedores suelen responder en 1 día
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 5/5
- Tiempo estimado
- Más de una semana
- Aptitud para principiantes
- 35/100
- Tipo de issue
- Nueva funcionalidad
- Claridad
- Bastante claro
- Estado de actividad
- Activo
- Stack tecnológico
- c
- Área
- compilers, documentation
Línea de trabajo
Start by reading docs/PRINCIPLES.md and the existing sandbox_run max_bytes behavior, then trace the eigs_alloc chokepoint and run the supplied OOM reproduction. Compare the proposed cap, error, charging, and trace behavior with the sandbox requirements. Done includes a catchable named error, non-134 exit, stopped sandbox growth, a clean handles_full.eigs run, overhead measurements, and synchronized updates to docs/SPEC.md, docs/BUILTINS.md, docs/EMBEDDING.md, and docs/llms.txt.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Gap
There is no process-level heap cap. An embedder, a CI harness or an agent running generated .eigs cannot bound a whole run's memory. The only tools are OS limits, and both are poor fits:
ulimit -v(RLIMIT_AS) counts reserved address space, not use. Each thread reserves an 8 MiB stack and a 64 MiB malloc arena up front. Measured in #1318:tests/handles_full.eigspeaks at 21 MB RSS, yet it was killed under a 1.5 GB-vcap. That produced false one-sided rows in a differential harness.- cgroups (
systemd-run -p MemoryMax=, container limits) work, but they end in a SIGKILL from outside. The program never sees an error, and the harness cannot tell an OOM from a crash without extra machinery.
When memory does run out, the runtime aborts. Repro on main 94c4c5b:
xs is []
s is "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
i is 0
loop while i < 100000000:
xs is append of [xs, s + (str of i)]
i is i + 1
print of "done"
$ ( ulimit -v 300000; src/eigenscript oom.eigs; echo rc=$? )
eigenscript: out of memory (requested 64 bytes)
Aborted (core dumped)
rc=134
sandbox_run's max_bytes is the one budget that exists (#739), and it has two limits:
- It is reachable only from inside a program, around an assembled chunk. It cannot cover a whole run.
- It charges only the size-controlled allocators (
zeros/fill/buffer/range/concat) and the zlib codecs. General growth like theappendloop above is not charged, so even a sandboxed run can exhaust the host.
Prior art (for the decision)
- Runtime-level heap caps that raise a named error: JVM
-Xmx(OutOfMemoryError), V8--max-old-space-size, the allocator limit in Lua'slua_newstate, wasm max memory pages. - Harness-level RSS monitors: libFuzzer
-rss_limit_mbreports OOM as its own outcome. - AFL documents that its RLIMIT_AS limit (
-m) must benoneunder ASan, which is the same failure as above.
Decision needed
- The knob: an env flag (
EIGS_MAX_HEAP=<bytes>, parsed like the othereigs_env_flagknobs), a CLI flag, an embed API field, or all three. - What gets charged: every
eigs_alloc(a chokepoint charge, which catches theappendloop), or live bytes net of frees (which needs the counter decremented on free). - What happens at the cap: an
rt_errorof a new kind (catchable bytry, a clean exit code distinct from 134), and what the trace tape records. - Whether
sandbox_run'smax_bytesbecomes the same mechanism scoped to the run, which would close its second limitation above.
Done when
- The decision above is recorded in this issue, citing a principle from docs/PRINCIPLES.md.
- Running the repro above with the cap set to 64 MiB ends in a named, documented error with a non-134 exit code, and the program can catch it with
try. - The same program under
sandbox_runwithmax_bytesset is stopped by the budget. It returns{ok: 0}, and the host does not abort. -
tests/handles_full.eigsruns clean under a cap well above its measured peak (for example 64 MiB), proving thread reservations are not charged. - Measured overhead with the cap unset is recorded, taken from the perf-attribution paired samples or the CodSpeed instruction count on the DMG target.
- docs/SPEC.md, docs/BUILTINS.md (
sandbox_run), docs/EMBEDDING.md and docs/llms.txt describe the knob, all in the same PR.
- Lenguaje dominante
- C
- Estrellas
- 3
- Forks
- 7
- Merge medio
- 4 h 15 min
- PR fusionados (30 d)
- 106
Preparar el entorno
Inicia el contenedor de desarrollo del proyecto en tu navegador, con tu propia cuenta de GitHub.
- Incluye un Dockerfile o un archivo de Docker Compose
- Tiene una plantilla de pull request
- Leer la guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de InauguralSystems/EigenScript
-
area:lint-tooling bug
Dificultad 2/5 1-3 horas Aptitud para principiantes 88/100
InauguralSystems/EigenScript#1340 ·
Los mantenedores suelen responder en 1 día
-
area:stdlib found-by:code-review kind:silent-wrong
Dificultad 2/5 1-3 horas Aptitud para principiantes 88/100
InauguralSystems/EigenScript#1338 ·
Los mantenedores suelen responder en 1 día
-
area:lint-tooling found-by:critic kind:docs-drift
Dificultad 2/5 1-3 horas Aptitud para principiantes 76/100
InauguralSystems/EigenScript#1335 ·
Los mantenedores suelen responder en 1 día
-
area:ci found-by:critic kind:gate-defect
Dificultad 2/5 1-3 horas Aptitud para principiantes 86/100
InauguralSystems/EigenScript#1311 ·
Los mantenedores suelen responder en 1 día
-
enrolment: decide test_gc_runner_controls.py (exempt vs enrol) and whether floors need a ratchetAbiertoarea:gates found-by:critic kind:decision
Dificultad 2/5 1-3 horas Aptitud para principiantes 65/100
InauguralSystems/EigenScript#1280 · 1 comentario ·
Los mantenedores suelen responder en 1 día
Todos los issues de InauguralSystems/EigenScript
Issues similares
-
Dificultad 1/5 Menos de una hora Aptitud para principiantes 92/100
sandialabs/seacas#945 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 88/100
ARM-software/sysarch-acs#556 · 1 comentario ·
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 68/100
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
Los mantenedores suelen responder en 1 día
-
bug needs triage
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
netdata/netdata#24062 · 1 comentario ·
Los mantenedores suelen responder en 1 día