inferstep

Issues somebody may already be working on are listed last. List everything by date

• Sandbox: the answer of /execute no longer says that a run was stopped at its time limit

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/sandbox reliability

  Difficulty 4/5 3-5 days Newbie friendliness 45/100

  inferstep/ATLAS#429 · Opened Oct 8, 2026

  Maintainers usually reply within 1 day

• Images: the model server's build depends on the processor of the build machine

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/inference reliability

  Difficulty 4/5 3-5 days Newbie friendliness 56/100

  inferstep/ATLAS#426 · 1 comment · Opened Oct 8, 2026

  Maintainers usually reply within 1 day

• Bootstrap: the last two steps run as the user who owns the install

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/install reliability

  Difficulty 2/5 1-3 hours Newbie friendliness 75/100

  inferstep/ATLAS#412 · Opened Oct 7, 2026

  Maintainers usually reply within 1 day

• First install: check the release before it runs

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/install security

  Difficulty 3/5 1-2 days Newbie friendliness 78/100

  inferstep/ATLAS#410 · Opened Oct 7, 2026

  Maintainers usually reply within 1 day

• Setup guide and security page: say that Method 2 (bare metal) has no container boundary

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/docs area/sandbox documentation status/ready

  Difficulty 3/5 1-2 days Newbie friendliness 66/100

  inferstep/ATLAS#385 · Opened Oct 7, 2026

  Maintainers usually reply within 1 day

• Sandbox: say so, or refuse to start, when it cannot see a command's processes

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/sandbox reliability status/ready

  Difficulty 4/5 3-5 days Newbie friendliness 58/100

  inferstep/ATLAS#384 · Opened Oct 7, 2026

  Maintainers usually reply within 1 day

• Sandbox image: supported Go and Node versions, installed from verified sources

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/sandbox dependencies docker

  Difficulty 4/5 3-5 days Newbie friendliness 50/100

  inferstep/ATLAS#379 · Opened Oct 7, 2026

  Maintainers usually reply within 1 day

• Proxy: one table test for "who is asked" by tool and permission mode

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy reliability

  Difficulty 3/5 1-2 days Newbie friendliness 57/100

  inferstep/ATLAS#375 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Diagnostics bundle: filter service addresses and the calibration reply

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/cli

  Difficulty 2/5 1-3 hours Newbie friendliness 85/100

  inferstep/ATLAS#374 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Validate values from files and service replies before they are passed on

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/cli reliability

  Difficulty 4/5 3-5 days Newbie friendliness 55/100

  inferstep/ATLAS#373 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• V3 service: limit the request size and answer every parse error in one shape

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/v3 reliability

  Difficulty 3/5 1-2 days Newbie friendliness 72/100

  inferstep/ATLAS#372 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• CLI: find the ATLAS root without falling back to the working folder

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/cli reliability

  Difficulty 3/5 1-2 days Newbie friendliness 68/100

  inferstep/ATLAS#371 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Artifact verify: test the signature path and show "hash only" clearly

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/cli artifact

  Difficulty 3/5 1-2 days Newbie friendliness 75/100

  inferstep/ATLAS#370 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Doctor: name the GPU check images by digest

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/cli docker

  Difficulty 3/5 1-2 days Newbie friendliness 72/100

  inferstep/ATLAS#369 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Bench: pin the LiveCodeBench dataset revision and check the cached file

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/cli reliability

  Difficulty 3/5 1-2 days Newbie friendliness 68/100

  inferstep/ATLAS#368 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Model install: check the hash of every file before it is used

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/cli model

  Difficulty 3/5 1-2 days Newbie friendliness 75/100

  inferstep/ATLAS#367 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• A file tool or a session start can wait without end on a file that is not a regular file

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy release-blocker reliability status/ready

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  inferstep/ATLAS#365 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• A `sandbox_subdir` the proxy does not accept is refused, not ignored

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy reliability status/ready

  Difficulty 2/5 1-3 hours Newbie friendliness 83/100

  inferstep/ATLAS#364 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Evaluation runs with Inspect AI

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci

  Difficulty 5/5 Over a week Newbie friendliness 35/100

  inferstep/ATLAS#363 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• docs/quality/rules.md: the rules learned from review, and the two-rounds rule

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci documentation status/ready

  Difficulty 2/5 1-3 hours Newbie friendliness 68/100

  inferstep/ATLAS#362 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Release: check the release safety steps and add build attestations

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci status/ready

  Difficulty 4/5 3-5 days Newbie friendliness 55/100

  inferstep/ATLAS#361 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• The canary is checked on a schedule

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci

  Difficulty 3/5 1-2 days Newbie friendliness 64/100

  inferstep/ATLAS#351 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Proxy host mode: resolve the shell once at start, by absolute path

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy security

  Difficulty 3/5 Half a day Newbie friendliness 72/100

  inferstep/ATLAS#337 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• CI: install the remaining test dependencies from hashed requirements

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci security status/ready

  Difficulty 3/5 1-2 days Newbie friendliness 68/100

  inferstep/ATLAS#335 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Inference images: run as a non-root user

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/inference docker security

  Difficulty 4/5 3-5 days Newbie friendliness 56/100

  inferstep/ATLAS#334 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Lens and V3 images: install Python packages from hashed lock files

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/lens area/v3 docker security status/ready

  Difficulty 3/5 1-2 days Newbie friendliness 74/100

  inferstep/ATLAS#333 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Sandbox image: pin and verify what the build downloads

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/sandbox docker security status/ready

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  inferstep/ATLAS#332 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Completion: close the gaps between "completed" and what was verified

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy area/v3 reliability

  Difficulty 5/5 Over a week Newbie friendliness 35/100

  inferstep/ATLAS#330 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Unchanged tests give no credit to the module they import, and the missing-module hint says to pip-install the project's own package

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy reliability

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  inferstep/ATLAS#329 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Fenced writes: the refusal comes after the model call it discards, and its message contradicts the tool description

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy reliability

  Difficulty 4/5 3-5 days Newbie friendliness 53/100

  inferstep/ATLAS#328 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• A refusal by a guard counts as a failure, and an edit is generated by V3 before its syntax is checked

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy area/v3 reliability

  Difficulty 4/5 3-5 days Newbie friendliness 45/100

  inferstep/ATLAS#327 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Proxy: one ordered list of checks, cheapest first

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy reliability

  Difficulty 4/5 3-5 days Newbie friendliness 32/100

  inferstep/ATLAS#326 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Intake: an allowed-licence list in dependency review, and a cause field on the bug form

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci dependencies status/ready

  Difficulty 4/5 3-5 days Newbie friendliness 52/100

  inferstep/ATLAS#324 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Dry run of the new checks over recent merged pull requests, then require them one at a time

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci status/ready

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  inferstep/ATLAS#316 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Weekly jobs: a cleanup issue from the automatic fixers, and a list of rule bypasses

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  inferstep/ATLAS#315 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• Pull requests: size and risk labels, and a limit on open pull requests for new contributors

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  inferstep/ATLAS#313 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• CI: replay tests that run the proxy against recorded model replies

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci area/proxy status/ready

  Difficulty 4/5 3-5 days Newbie friendliness 50/100

  inferstep/ATLAS#312 · Opened Oct 6, 2026

  Maintainers usually reply within 1 day

• The released lens gives no usable signal: mismatched calibration, and per-token scoring cannot run

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/lens

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  inferstep/ATLAS#281 · 1 comment · Opened Sep 30, 2026

  Maintainers usually reply within 1 day

• A question was told to stop reading and write a file, and its unfinished reply was reported completed

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy reliability

  Difficulty 3/5 1-2 days Newbie friendliness 35/100

  inferstep/ATLAS#273 · 2 comments · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• Eval grading: ignore or reject edits to a benchmark's own test files

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  reliability

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  inferstep/ATLAS#271 · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• Eval driver: a per-suite session budget, the same for both arms

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  inferstep/ATLAS#270 · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• Eval driver: run a task's session and grader in a task-supplied container image

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci area/sandbox

  Difficulty 4/5 3-5 days Newbie friendliness 52/100

  inferstep/ATLAS#269 · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• After the rework: re-run the frozen held-out suite to show nothing changed

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  reliability

  Difficulty 4/5 3-5 days Newbie friendliness 52/100

  inferstep/ATLAS#268 · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• Python services and CLI: apply the code standards

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/cli area/lens area/sandbox area/v3

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  inferstep/ATLAS#267 · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• Proxy: untangle it in place, starting with runAgentLoop

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  inferstep/ATLAS#266 · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• Proxy: split the single package into packages by concern

  May be free again @raggarw004 claimed this 8 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy

  Difficulty 5/5 Over a week Newbie friendliness 35/100

  inferstep/ATLAS#265 · 3 comments · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• Code health: readable code with a conventional structure

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy roadmap status/ready

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  inferstep/ATLAS#262 · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• Long single tool calls end in loops, and the work before the loop is lost

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/proxy performance reliability status/ready

  Difficulty 5/5 Over a week Newbie friendliness 35/100

  inferstep/ATLAS#261 · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• Check: does `atlas lens build` on a host reach the model server for the embedding convention?

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/cli area/lens status/ready

  Difficulty 2/5 Half a day Newbie friendliness 66/100

  inferstep/ATLAS#258 · Opened Sep 29, 2026

  Maintainers usually reply within 1 day

• CI: run each service's Python tests on the Python its image uses

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ci status/ready

  Difficulty 2/5 1-3 hours Newbie friendliness 76/100

  inferstep/ATLAS#245 · 4 comments · Opened Sep 28, 2026

  Maintainers usually reply within 1 day