Wrong count for failed submissions in Resource interface
Maintainers usually reply within 1 day
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 68/100
Research direction
Start by locating the Resource interface code that calculates and displays the failed-submissions count, then trace how it includes failed rows from multi-task submissions. Check for existing tests covering submission counts and run the relevant tests. Done means one failed multi-task submission is counted once, not once for the parent and again for each child.
Written by the indexing model from the issue text.
Description
In the resource interface the failed submisisons count is incorrect when you have failed submissions in a multi-task competition. This is happening because the failed counter counts every failed row, children included, so one failed multi-task submission showed as 3 (parent plus 2 children).
- Dominant language
- Python
- Stars
- 181
- Forks
- 80
- Avg merge
- 2d 17h
- Merged PRs (30d)
- 30
Getting set up
- Ships a Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from codalab/codabench
-
Beginner Enhancement UI
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
Maintainers usually reply within 1 day
-
Failed submission marked as FinishedPossibly taken @ihsaan-ullah claimed this today. OpenBug
Difficulty 3/5 1-2 days Newbie friendliness 56/100
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 42/100
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 55/100
Maintainers usually reply within 1 day
All issues in codalab/codabench
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
UKGovernmentBEIS/inspect_ai#5781 ·
Maintainers usually reply within 2 days
-
Bump .cicd to wamp-cicd 4c2f9ac: `just land` refuses open A18 decisions, `just where` lists themOpen
Difficulty 1/5 Under an hour Newbie friendliness 82/100
crossbario/cfxdb#139 ·
-
Bump .cicd to wamp-cicd 4c2f9ac: `just land` refuses open A18 decisions, `just where` lists themOpen
Difficulty 1/5 Under an hour Newbie friendliness 84/100
crossbario/txaio#241 ·
-
UX
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
mediajunkie/piper-morgan-product#1963 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 64/100