Test runner reports success when no solutions are executed
Maintainers usually reply within 1 day
@vivek-3728 is already working on this.
Since Oct 20, 2026.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 76/100
Research direction
Start in run.py, where the problem and language filters select solutions and the final exit status checks failures. Run the two example commands from the issue to reproduce the empty successful runs. Update the handling so an empty selection is reported and exits nonzero; verify that matching solutions still run normally.
Written by the indexing model from the issue text.
Description
I noticed that the test runner reports a successful result even when the requested problem or language doesn't match any solutions.
For example, I tested:
python run.py does-not-exist
python run.py prime --lang rs
Both commands produced:
Summary: 0 passed, 0 failed, 0 skipped
The exit code was 0 in both cases. I repeated the tests twice and got the same results.
I expected the runner to report that no matching solutions were found and exit with a nonzero status, rather than treating an empty test run as successful.
Looking through run.py, the problem and language filters can exclude every available solution. However, the final exit status only checks whether any tests failed.
When nothing runs, the failure counter remains zero, so the runner reports success.
This could cause problems in automated verification. For example, a typo in a CI command or an incorrect language selection could skip every test while the pipeline still appears green.
A successful verification run should confirm that at least one matching solution was actually checked. If the selection is empty, the runner should report that explicitly instead of returning success.
- Dominant language
- Python
- Stars
- 1
- Forks
- 6
- Avg merge
- 22h 23m
- Merged PRs (30d)
- 22
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- No contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from techcsispit/code-corner
-
feat(palindrome): add C solutionPossibly taken @aadiitya2007 claimed this today. Open
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
techcsispit/code-corner#58 · 1 comment ·
Maintainers usually reply within 1 day
-
prime/solution.java doesn't compile: public class PrimeCheck in solution.java, README requires Solution.java with a Solution classPossibly taken @tanujb03 claimed this 10 days ago. Openbug good first issue
Difficulty 1/5 Under an hour Newbie friendliness 82/100
techcsispit/code-corner#35 ·
Maintainers usually reply within 1 day
-
feat(binary-search): add JavaScript solutionPossibly taken @aadiitya2007 claimed this today. Openfeature
techcsispit/code-corner#56 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
-
feat(roman-numerals): add C++ solutionPossibly taken @aadiitya2007 claimed this today. Openfeature
techcsispit/code-corner#54 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
-
Failed compilations always report 0.000 secondsPossibly taken @Nik-2208 claimed this 8 days ago. Openbug good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 35/100
techcsispit/code-corner#37 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
All issues in techcsispit/code-corner
Similar issues
-
[Bug] Unit tests reach real Bedrock call paths without patching the modelPossibly taken @proton0210 claimed this today. Openbug
Difficulty 2/5 1-3 hours Newbie friendliness 67/100
aws-samples/sample-aws-genai-db-modernizer#1318 · 1 comment ·
Maintainers usually reply within 1 day
-
pyarrow-25.0.1-cp310-cp310-manylinux_2_28_x86_64.whl: 1 vulnerabilities (highest severity is: 5.3)OpenMend: dependency security vulnerability
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
capitalone/locopy#394 ·
-
[Bug] Unhandled ValueError terminates watchdog thread when GISRC value contains multiple colonsOpenbug
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
Maintainers usually reply within 1 day
-
sdk-typescript: unquoted COPY globs in shell form are silently dropped from the image build contextOpenbug javascript
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
ietf-tools/datatracker#11922 · 1 comment ·
Maintainers usually reply within 1 day