No process-level heap cap: OOM aborts (rc 134); sandbox max_bytes misses general growth
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 35/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- c
- Domain
- compilers, documentation
Research direction
Start by reading docs/PRINCIPLES.md and the existing sandbox_run max_bytes behavior, then trace the eigs_alloc chokepoint and run the supplied OOM reproduction. Compare the proposed cap, error, charging, and trace behavior with the sandbox requirements. Done includes a catchable named error, non-134 exit, stopped sandbox growth, a clean handles_full.eigs run, overhead measurements, and synchronized updates to docs/SPEC.md, docs/BUILTINS.md, docs/EMBEDDING.md, and docs/llms.txt.
Written by the indexing model from the issue text.
Description
Gap
There is no process-level heap cap. An embedder, a CI harness or an agent running generated .eigs cannot bound a whole run's memory. The only tools are OS limits, and both are poor fits:
ulimit -v(RLIMIT_AS) counts reserved address space, not use. Each thread reserves an 8 MiB stack and a 64 MiB malloc arena up front. Measured in #1318:tests/handles_full.eigspeaks at 21 MB RSS, yet it was killed under a 1.5 GB-vcap. That produced false one-sided rows in a differential harness.- cgroups (
systemd-run -p MemoryMax=, container limits) work, but they end in a SIGKILL from outside. The program never sees an error, and the harness cannot tell an OOM from a crash without extra machinery.
When memory does run out, the runtime aborts. Repro on main 94c4c5b:
xs is []
s is "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
i is 0
loop while i < 100000000:
xs is append of [xs, s + (str of i)]
i is i + 1
print of "done"
$ ( ulimit -v 300000; src/eigenscript oom.eigs; echo rc=$? )
eigenscript: out of memory (requested 64 bytes)
Aborted (core dumped)
rc=134
sandbox_run's max_bytes is the one budget that exists (#739), and it has two limits:
- It is reachable only from inside a program, around an assembled chunk. It cannot cover a whole run.
- It charges only the size-controlled allocators (
zeros/fill/buffer/range/concat) and the zlib codecs. General growth like theappendloop above is not charged, so even a sandboxed run can exhaust the host.
Prior art (for the decision)
- Runtime-level heap caps that raise a named error: JVM
-Xmx(OutOfMemoryError), V8--max-old-space-size, the allocator limit in Lua'slua_newstate, wasm max memory pages. - Harness-level RSS monitors: libFuzzer
-rss_limit_mbreports OOM as its own outcome. - AFL documents that its RLIMIT_AS limit (
-m) must benoneunder ASan, which is the same failure as above.
Decision needed
- The knob: an env flag (
EIGS_MAX_HEAP=<bytes>, parsed like the othereigs_env_flagknobs), a CLI flag, an embed API field, or all three. - What gets charged: every
eigs_alloc(a chokepoint charge, which catches theappendloop), or live bytes net of frees (which needs the counter decremented on free). - What happens at the cap: an
rt_errorof a new kind (catchable bytry, a clean exit code distinct from 134), and what the trace tape records. - Whether
sandbox_run'smax_bytesbecomes the same mechanism scoped to the run, which would close its second limitation above.
Done when
- The decision above is recorded in this issue, citing a principle from docs/PRINCIPLES.md.
- Running the repro above with the cap set to 64 MiB ends in a named, documented error with a non-134 exit code, and the program can catch it with
try. - The same program under
sandbox_runwithmax_bytesset is stopped by the budget. It returns{ok: 0}, and the host does not abort. -
tests/handles_full.eigsruns clean under a cap well above its measured peak (for example 64 MiB), proving thread reservations are not charged. - Measured overhead with the cap unset is recorded, taken from the perf-attribution paired samples or the CodSpeed instruction count on the DMG target.
- docs/SPEC.md, docs/BUILTINS.md (
sandbox_run), docs/EMBEDDING.md and docs/llms.txt describe the knob, all in the same PR.
- Dominant language
- C
- Stars
- 3
- Forks
- 7
- Avg merge
- 4h 15m
- Merged PRs (30d)
- 106
Getting set up
Starts the project's dev container in your browser, under your own GitHub account.
- Ships a Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from InauguralSystems/EigenScript
-
area:lint-tooling bug
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
InauguralSystems/EigenScript#1340 ·
Maintainers usually reply within 1 day
-
area:stdlib found-by:code-review kind:silent-wrong
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
InauguralSystems/EigenScript#1338 ·
Maintainers usually reply within 1 day
-
area:lint-tooling found-by:critic kind:docs-drift
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
InauguralSystems/EigenScript#1335 ·
Maintainers usually reply within 1 day
-
area:ci found-by:critic kind:gate-defect
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
InauguralSystems/EigenScript#1311 ·
Maintainers usually reply within 1 day
-
enrolment: decide test_gc_runner_controls.py (exempt vs enrol) and whether floors need a ratchetOpenarea:gates found-by:critic kind:decision
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
InauguralSystems/EigenScript#1280 · 1 comment ·
Maintainers usually reply within 1 day
All issues in InauguralSystems/EigenScript
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 85/100
microsoft/ebpf-for-windows#5604 ·
Maintainers usually reply within 3 days
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 84/100
AcademySoftwareFoundation/openexr#2683 ·
Maintainers usually reply within 1 day