Owner

1 indexed repository · View on GitHub

Issues somebody may already be working on are listed last. List everything by date

  • Tests wanted: start here
    Open
    area: tests help wanted tests

    Difficulty 1/5 Under an hour Newbie friendliness 25/100

    patsypppe/meridian#166 ·

    Maintainers usually reply within 1 day

  • Integration test: a credential never reaches a trial
    Open
    area: security area: tests size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 84/100

    patsypppe/meridian#165 ·

    Maintainers usually reply within 1 day

  • Integration test: grader-only files never reach the trial
    Open
    area: grading area: security area: tests size: M tests

    Difficulty 3/5 1-2 days Newbie friendliness 74/100

    patsypppe/meridian#164 ·

    Maintainers usually reply within 1 day

  • Detect flaky integration tests
    Open
    area: ci size: S tests

    Difficulty 3/5 1-2 days Newbie friendliness 66/100

    patsypppe/meridian#163 ·

    Maintainers usually reply within 1 day

  • Run unit tests in random order
    Open
    area: ci good first issue size: XS tests

    Difficulty 3/5 1-2 days Newbie friendliness 72/100

    patsypppe/meridian#162 ·

    Maintainers usually reply within 1 day

  • Mutation testing for the statistics module
    Open
    area: stats area: tests help wanted size: M tests

    Difficulty 3/5 1-2 days Newbie friendliness 67/100

    patsypppe/meridian#161 ·

    Maintainers usually reply within 1 day

  • Dashboard: accept run files with extra fields
    Open
    area: dashboard area: tests good first issue size: XS tests

    Difficulty 1/5 1-3 hours Newbie friendliness 88/100

    patsypppe/meridian#160 ·

    Maintainers usually reply within 1 day

  • Component tests for the dashboard's charts and comparison
    Open
    area: dashboard area: tests good first issue size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 76/100

    patsypppe/meridian#159 ·

    Maintainers usually reply within 1 day

  • Tests for the dashboard's formatting helpers
    Open
    area: dashboard area: tests good first issue size: XS tests

    Difficulty 2/5 1-3 hours Newbie friendliness 88/100

    patsypppe/meridian#158 ·

    Maintainers usually reply within 1 day

  • Test the gate comment with harness-error causes
    Open
    area: gate area: tests good first issue size: S tests

    Difficulty 1/5 1-3 hours Newbie friendliness 85/100

    patsypppe/meridian#157 ·

    Maintainers usually reply within 1 day

  • Test the HTML report with harness-error causes
    Open
    area: tests good first issue size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 86/100

    patsypppe/meridian#156 ·

    Maintainers usually reply within 1 day

  • Golden tests for the importer against real Harbor tasks
    Open
    area: importer area: tests help wanted size: M tests

    Difficulty 3/5 1-2 days Newbie friendliness 74/100

    patsypppe/meridian#155 ·

    Maintainers usually reply within 1 day

  • More translation cases for the OpenAI-compatible proxy
    Open
    area: proxy area: tests good first issue size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 88/100

    patsypppe/meridian#154 ·

    Maintainers usually reply within 1 day

  • Test the grading sandbox's command construction
    Open
    area: grading area: tests good first issue size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 75/100

    patsypppe/meridian#153 ·

    Maintainers usually reply within 1 day

  • Test how the proxy container's environment is built
    Open
    area: proxy area: tests size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 82/100

    patsypppe/meridian#152 ·

    Maintainers usually reply within 1 day

  • Test snapshot digest resolution
    Open
    area: tests good first issue size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 88/100

    patsypppe/meridian#151 ·

    Maintainers usually reply within 1 day

  • Test that replay detects a changed input
    Open
    area: tests size: M tests

    Difficulty 2/5 1-3 hours Newbie friendliness 85/100

    patsypppe/meridian#150 ·

    Maintainers usually reply within 1 day

  • Round-trip test for saving and loading a run archive
    Open
    area: tests good first issue size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 85/100

    patsypppe/meridian#149 ·

    Maintainers usually reply within 1 day

  • Test configuration loading and environment overrides
    Open
    area: tests good first issue size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 78/100

    patsypppe/meridian#148 ·

    Maintainers usually reply within 1 day

  • Unit-test the LangGraph adapter with a fake graph
    Open
    area: agent area: tests good first issue size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 85/100

    patsypppe/meridian#147 ·

    Maintainers usually reply within 1 day

  • Unit-test the subprocess adapter
    Open
    area: tests good first issue size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 86/100

    patsypppe/meridian#146 ·

    Maintainers usually reply within 1 day

  • Unit-test the in-container entrypoint
    Open
    area: runtime area: tests good first issue size: S tests

    Difficulty 2/5 1-3 hours Newbie friendliness 84/100

    patsypppe/meridian#145 ·

    Maintainers usually reply within 1 day

  • Write a threat model
    Open
    area: docs area: security documentation size: M

    Difficulty 2/5 1-3 hours Newbie friendliness 78/100

    patsypppe/meridian#143 ·

    Maintainers usually reply within 1 day

  • Drive the showcase page's real-model section from data
    Open
    area: site enhancement size: S

    Difficulty 2/5 1-3 hours Newbie friendliness 76/100

    patsypppe/meridian#142 ·

    Maintainers usually reply within 1 day

  • Remember the last loaded run
    Open
    area: dashboard enhancement good first issue size: XS

    Difficulty 2/5 1-3 hours Newbie friendliness 82/100

    patsypppe/meridian#141 ·

    Maintainers usually reply within 1 day

  • Light/dark toggle in the dashboard
    Open
    area: dashboard enhancement good first issue size: S

    Difficulty 3/5 1-2 days Newbie friendliness 67/100

    patsypppe/meridian#140 ·

    Maintainers usually reply within 1 day

  • Highlight the drop zone while dragging a file
    Open
    accessibility area: dashboard enhancement good first issue size: XS

    Difficulty 2/5 1-3 hours Newbie friendliness 85/100

    patsypppe/meridian#139 ·

    Maintainers usually reply within 1 day

  • Add an error boundary to the dashboard
    Open
    area: dashboard enhancement good first issue size: XS

    Difficulty 2/5 1-3 hours Newbie friendliness 82/100

    patsypppe/meridian#138 ·

    Maintainers usually reply within 1 day

  • Add ESLint and Prettier to the dashboard
    Open
    area: ci area: dashboard enhancement good first issue size: S

    Difficulty 3/5 1-2 days Newbie friendliness 75/100

    patsypppe/meridian#137 ·

    Maintainers usually reply within 1 day

  • Paired significance test in the comparison view
    Open
    area: dashboard area: stats enhancement size: M

    Difficulty 4/5 3-5 days Newbie friendliness 55/100

    patsypppe/meridian#136 ·

    Maintainers usually reply within 1 day

  • Export the task table and comparison
    Open
    area: dashboard enhancement good first issue size: S

    Difficulty 2/5 1-3 hours Newbie friendliness 84/100

    patsypppe/meridian#135 ·

    Maintainers usually reply within 1 day

  • Show efficiency numbers per task
    Open
    area: dashboard enhancement good first issue size: S

    Difficulty 2/5 1-3 hours Newbie friendliness 85/100

    patsypppe/meridian#134 ·

    Maintainers usually reply within 1 day

  • Show a trial's details when you click it
    Open
    area: dashboard enhancement size: M

    Difficulty 2/5 1-3 hours Newbie friendliness 84/100

    patsypppe/meridian#133 ·

    Maintainers usually reply within 1 day

  • Load a run in the dashboard from a URL
    Open
    area: dashboard enhancement good first issue size: S

    Difficulty 3/5 1-2 days Newbie friendliness 72/100

    patsypppe/meridian#132 ·

    Maintainers usually reply within 1 day

  • Recover efficiency numbers for timed-out trials
    Open
    area: agent area: runtime enhancement size: S

    Difficulty 2/5 1-3 hours Newbie friendliness 85/100

    patsypppe/meridian#131 ·

    Maintainers usually reply within 1 day

  • Make the terminal agent's limits configurable
    Open
    area: agent enhancement good first issue size: S

    Difficulty 2/5 1-3 hours Newbie friendliness 75/100

    patsypppe/meridian#130 ·

    Maintainers usually reply within 1 day

  • Keep the terminal agent's context bounded on long tasks
    Open
    area: agent enhancement size: M

    Difficulty 2/5 1-3 hours Newbie friendliness 82/100

    patsypppe/meridian#129 ·

    Maintainers usually reply within 1 day

  • Give the terminal agent a file-editing tool
    Open
    area: agent enhancement size: M

    Difficulty 3/5 1-2 days Newbie friendliness 75/100

    patsypppe/meridian#128 ·

    Maintainers usually reply within 1 day

  • Docstrings for the remaining packages, then turn the rule on
    Open
    documentation good first issue size: S

    Difficulty 4/5 3-5 days Newbie friendliness 55/100

    patsypppe/meridian#127 ·

    Maintainers usually reply within 1 day

  • Docstrings for `grading` and `manifest`
    Open
    area: grading documentation good first issue size: S

    Difficulty 2/5 1-3 hours Newbie friendliness 85/100

    patsypppe/meridian#126 ·

    Maintainers usually reply within 1 day

  • Docstrings for public APIs in `meridian.models`
    Open
    documentation good first issue size: S

    Difficulty 3/5 1-2 days Newbie friendliness 78/100

    patsypppe/meridian#125 ·

    Maintainers usually reply within 1 day

  • Docstrings for public APIs in `meridian.runtime`
    Open
    area: runtime documentation good first issue size: S

    Difficulty 3/5 1-2 days Newbie friendliness 76/100

    patsypppe/meridian#124 ·

    Maintainers usually reply within 1 day

  • Report run-to-run variance
    Open
    area: stats enhancement needs discussion size: M

    Difficulty 5/5 Over a week Newbie friendliness 35/100

    patsypppe/meridian#123 ·

    Maintainers usually reply within 1 day

  • Detect flaky tasks across runs
    Open
    area: gate enhancement size: M

    Difficulty 4/5 3-5 days Newbie friendliness 55/100

    patsypppe/meridian#121 ·

    Maintainers usually reply within 1 day

  • Stop a gate run early once the verdict is settled
    Open
    area: gate area: stats enhancement needs discussion size: L

    Difficulty 5/5 Over a week Newbie friendliness 35/100

    patsypppe/meridian#120 ·

    Maintainers usually reply within 1 day

  • Correct for multiple comparisons in the gate comment
    Open
    area: gate area: stats enhancement size: M

    Difficulty 3/5 1-2 days Newbie friendliness 72/100

    patsypppe/meridian#119 ·

    Maintainers usually reply within 1 day

  • Show a Wilson interval for each task
    Open
    area: stats enhancement good first issue size: S

    Difficulty 3/5 1-2 days Newbie friendliness 72/100

    patsypppe/meridian#118 ·

    Maintainers usually reply within 1 day

  • Option to grade a trial's final state after a timeout
    Open
    area: grading enhancement needs discussion size: M

    Difficulty 4/5 3-5 days Newbie friendliness 48/100

    patsypppe/meridian#117 ·

    Maintainers usually reply within 1 day

  • SQLite store for zero-setup local runs
    Open
    area: store enhancement needs discussion size: L

    Difficulty 4/5 3-5 days Newbie friendliness 52/100

    patsypppe/meridian#116 ·

    Maintainers usually reply within 1 day

  • Simplify the `gate` command
    Open
    area: cli area: gate refactor size: S

    Difficulty 2/5 1-3 hours Newbie friendliness 78/100

    patsypppe/meridian#115 ·

    Maintainers usually reply within 1 day

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.