Build the port inside evals
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 35/100
Research direction
Read ROADMAP.md, SKILL.md step 5, and the existing CI configuration that builds SDL 3.4.18 with CMake. First review the turn-limit issue referenced as #2 and the current eval cases to understand the tradeoffs. Done means the settled answers are recorded as a dated decision in ROADMAP.md and the issue has a milestone with its own checklist.
Written by the indexing model from the issue text.
Description
Install SDL3 on the eval runner, so the agent can build its port and run it headless, as the skill does on a real machine. Graders could then check that the port runs, not just what it says.
Building adds turns: Haiku 4.5 already reaches the 60-turn limit in 3 of 5 whole-program runs.
What has to be settled before this gets a milestone
- What a build would prove. M3 kept builds out of evals because a trap compiles cleanly by definition, so a build changes no trap score, and graders can't see whether a build succeeded.
SKILL.mdstep 5's syntax check against the bundled headers already catches compile errors. The gain is graders that check the port runs: a headless run whose output a grader reads, beside the regex graders on the files. - Turns. Either the build cases get their own, higher turn limit, or building stays out of the single-trap cases and only the whole-program case builds. Haiku's turn count (#2) should settle first.
- Getting SDL3 onto the runner. CI already builds SDL 3.4.18 with CMake. The eval sandbox needs the same version prebuilt, so a run doesn't spend minutes and turns building SDL.
Done when
- The settled answers are a dated decision in ROADMAP.md, and this issue gets a milestone with its own checklist.
- Dominant language
- C
- Stars
- 1
- Forks
- 1
- Avg merge
- 3m
- Merged PRs (30d)
- 1
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from hazeliscoding/sdl3-porter
-
trap-cards check: require every part of a trap cardPossibly taken A pull request linked to this issue is open or already merged. Openenhancement good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
hazeliscoding/sdl3-porter#20 ·
-
documentation good first issue
Difficulty 1/5 1-3 hours Newbie friendliness 83/100
hazeliscoding/sdl3-porter#19 ·
-
Test find_traps.py's search of the committed SDL2 codePossibly taken @ian0318git claimed this 2 days ago. Opengood first issue
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
hazeliscoding/sdl3-porter#18 ·
-
bug good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
hazeliscoding/sdl3-porter#17 ·
-
trap-cards check: require a sample and an eval case for every trapPossibly taken A pull request linked to this issue is open or already merged. Openenhancement good first issue
Difficulty 3/5 1-2 days Newbie friendliness 82/100
hazeliscoding/sdl3-porter#21 ·
All issues in hazeliscoding/sdl3-porter
Similar issues
-
dspromote: /etc/exports uses -alldirs on non-mount-point directories, so mountd exports nothingOpenbug
Difficulty 2/5 1-3 hours Newbie friendliness 83/100
nextbsd/nextbsd-userland#434 ·
Maintainers usually reply within 1 day
-
[YSQL] Local-node initdb reads postgres.bki, but YB clusters bootstrap only from yb_postgres.bkiOpenarea/ysql kind/enhancement priority/low status/awaiting-triage
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
yugabyte/yugabyte-db#35763 ·
Maintainers usually reply within 1 day
-
category:port-update
Difficulty 2/5 1-3 hours Newbie friendliness 66/100
Maintainers usually reply within 2 days
-
emerge failure MARK mark-unstable media-kit
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
macaroni-os/mark-issues#834 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
NVIDIA/open-gpu-kernel-modules#1479 · 2 comments ·
Maintainers usually reply within 1 day