Align test reporting more closely w/ status enums (as it related to "untested")
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 38/100
Research direction
Start by locating TestResult.status, total_untested, and untested_detections, then trace how test results are initialized, reported, and finalized after an unhandled failure. Done means UNSET is the default status, the obsolete untested fields are removed, and remaining UNSET results become ERROR with the specified message when testing ends prematurely.
Written by the indexing model from the issue text.
Description
- the difference between "skipped" and "untested" is not obvious to the unitiated
- we should:
- add a new
UNSETstatus enum that is the default forTestResult.status(also good in that we no longer need to worry about theNonetype) - eliminate
total_untestedanduntested_detections - If testing fails in an unhandled way that causes contentctl to stop altogether, then we iterate over all tests, and for any that remain
UNSETafter testing completes, we mark the status as ERROR with a message likeTEST FAILED (ERROR): testing end state failed to be set, testing may have ended prematurely
- add a new
- Dominant language
- Python
- Stars
- 139
- Forks
- 51
- Avg merge
- 1h 16m
- Merged PRs (30d)
- 3
Getting set up
This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from splunk/contentctl
-
enhancement
Difficulty 3/5 1-2 days Newbie friendliness 45/100
splunk/contentctl#468 · 1 comment ·
-
enhancement
Difficulty 4/5 3-5 days Newbie friendliness 38/100
splunk/contentctl#461 ·
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 48/100
splunk/contentctl#452 ·
-
bug
Difficulty 3/5 1-2 days Newbie friendliness 35/100
splunk/contentctl#464 · 3 comments ·
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 35/100
splunk/contentctl#451 ·
All issues in splunk/contentctl
Similar issues
-
New InternshipOpennew_internship
Difficulty 1/5 Under an hour Newbie friendliness 70/100
-
[BUG] Reports tab: "Unban" button tooltip shows raw `{{ip}}` placeholder instead of the IP addressOpenbug javascript ui
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
bunkerity/bunkerweb#4001 · 1 comment ·
Maintainers usually reply within 1 day
-
bug
Difficulty 1/5 Under an hour Newbie friendliness 92/100
PedestrianDynamics/pyFDS-Evac#476 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
google/differential-privacy#516 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
adobe-fonts/source-serif#153 ·