Upgrade to version 3 spec
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 25/100
Research direction
Start by comparing the current version 1 behavior with the linked test runner interface specification, then inspect how results.json is produced and how instructions.md and .meta/config.json could provide task mappings. Done means the runner conforms to the version 3 specification and can emit an optional integer task_id for individual tests.
Written by the indexing model from the issue text.
Description
If possible, this test runner should be updated to version 3 of the test runner interface specification. In version 3, one additional feature is enabled: the ability to link individual tests to tasks.
This allows the website to show which tests belong to which tasks.
The way tests are linked to tasks is via an (optional) task_id field, which is an integer that matches the number of the task as defined in the exercise's instructions.md file (note: the instructions start at index 1).
This is an example of a test in the results.json file:
{
"name": "Expected oven time in minutes",
"status": "pass",
"task_id": 1,
"test_code": "Assert.Equal(40, Lasagna.ExpectedMinutesInOven());"
}
You are completely free in how to implement this. Some options are:
- Add metadata to a test that the test runner can then discover while running the tests (e.g. an attribute or annotation)
- Define a test name/task id mapping (e.g. in the exercise's
.meta/config.jsonfile) - Any other option you can think of...
As this test runner currently implements version 1 of the test runner specification, it might be good to first upgrade to version 2 of the test runner specification before upgrading to version 3.
Let me know if there are any questions.
- Dominant language
- CoffeeScript
- Stars
- 0
- Forks
- 7
- Avg merge
- 10h 35m
- Merged PRs (30d)
- 1
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from exercism/coffeescript-test-runner
-
x:action/improve x:knowledge/advanced x:module/test-runner x:size/large x:type/coding
Difficulty 5/5 Over a week Newbie friendliness 35/100
All issues in exercism/coffeescript-test-runner
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
copse-dev/agent-pane#2953 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
simonw/sqlite-utils#872 ·
-
calcite-components needs triage refactor
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
Esri/calcite-design-system#15203 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
danielmiessler/LifeOS#2218 ·
-
kind/cleanup
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
kubernetes-sigs/kueue#15947 ·