Test the gate comment with harness-error causes

Open Beginner friendly
#157 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
1/5
Estimated time
1-3 hours
Newbie friendliness
85/100
Issue type
Bug
Clarity
Clearly specified
Activity status
Active
Tech stack
python
Domain
testing

Research direction

Read src/meridian/gate/comment.py and tests/unit/test_gate_comment.py to see how comments are rendered and tested. Add a test case for a run with model_provider and grader errors, then run the focused test file. Done means the test asserts the harness-error summary line.

Written by the indexing model from the issue text.

Description

area: gate area: tests good first issue size: S tests
Context

gate/comment.py includes the harness-error summary in the pull-request comment, but no test covers a run with causes.

What to do

Render a comment for a run with model_provider and grader errors and assert the line.

Done when

The line is pinned by a test.

Where to look

src/meridian/gate/comment.py, tests/unit/test_gate_comment.py


New here? Read CONTRIBUTING.md and comment on this issue to say you are taking it.


Generated by Claude Code

Dominant language
Python
Stars
0
Forks
0
Avg merge
1h 54m
Merged PRs (30d)
14

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from patsypppe/meridian

All issues in patsypppe/meridian

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.