primer/agent-eval

Tools to evaluate agent performance on Primer tasks

Beginner friendly Everything

Open All

9 open issues indexed

[aw] Detection Runs Open

agentic-workflows

Difficulty 1/5 Under an hour Newbie friendliness 1/100

primer/agent-eval#288 · 1 comment · Opened Sep 20, 2026
Find a way to preserve scroll position when switching tabs Open

Difficulty 3/5 1-2 days Newbie friendliness 55/100

primer/agent-eval#286 · Opened Sep 20, 2026
Add support for carousel for walkthrough with multiple images Open

Difficulty 3/5 1-2 days Newbie friendliness 58/100

primer/agent-eval#285 · Opened Sep 20, 2026
Move result artifact validation to the output-loading boundary Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

primer/agent-eval#284 · Opened Sep 20, 2026
Add common examples for deterministic and non-deterministic checks Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

primer/agent-eval#282 · Opened Sep 19, 2026
Add appropriate tests for packages/agent-eval Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

primer/agent-eval#277 · Opened Sep 19, 2026
Add support for reporting on AI usage credits Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

primer/agent-eval#271 · Opened Sep 17, 2026
Update agent-eval from flags-based options to sub-commands Open

primer/agent-eval#252 · 1 reaction · 2 assignees · Opened Sep 11, 2026
Add support for local `--ui` option to view results using our `website` Next.js app Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

primer/agent-eval#243 · Opened Sep 10, 2026

Get new issues in your inbox