Add code coverage check to PR build
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- python
- Domain
- ci-cd, testing-qa
Research direction
Start by reading the coverage configuration in generated/nidcpower/tox-system_tests.ini and tox-travis.ini, then inspect the linked Travis and GitHub Actions logs to understand the current PR build. Determine how a coverage threshold should be applied to the existing unit and system-test reports, and consider the work done when a below-threshold PR build fails.
Written by the indexing model from the issue text.
Description
We currently use coverage tool to report the code coverage from unit and system tests. See
e.g:
https://github.com/ni/nimi-python/blob/266e87f372e27d4a05cbc637b0bbe8e5dc305726/generated/nidcpower/tox-system_tests.ini#L32
https://github.com/ni/nimi-python/blob/266e87f372e27d4a05cbc637b0bbe8e5dc305726/tox-travis.ini#L46
Logs:
- https://app.travis-ci.com/github/ni/nimi-python/jobs/576582446#L2052
- https://github.com/ni/nimi-python/runs/7326743697?check_suite_focus=true#step:3:1027
We should looking into setting a threshold and have the PR build fail if the coverage is below it.
- Dominant language
- Python
- Stars
- 128
- Forks
- 110
- Avg merge
- 5d 14h
- Merged PRs (30d)
- 10
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from ni/nimi-python
-
docs nitclk priority-low
Difficulty 1/5 Under an hour Newbie friendliness 68/100
ni/nimi-python#1993 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 45/100
ni/nimi-python#2164 · 1 comment ·
-
bug docs
Difficulty 1/5 Under an hour Newbie friendliness 48/100
ni/nimi-python#2162 ·
-
codegen enhancement
Difficulty 4/5 3-5 days Newbie friendliness 42/100
ni/nimi-python#2148 · 2 comments ·
-
Difficulty 3/5 1-2 days Newbie friendliness 45/100
ni/nimi-python#2122 ·
Similar issues
-
triage/confirmed
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
agentscope-ai/agentscope#2775 ·
-
comp/desktop P3 type/bug
Difficulty 1/5 Under an hour Newbie friendliness 92/100
NousResearch/hermes-agent#118866 ·
-
bug
Difficulty 1/5 Under an hour Newbie friendliness 90/100
apache/cloudstack#14222 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 82/100