qiskit-community/qiskit-metriq

Tox env runs in CI can fail silently

Open

#41 opened on Nov 20, 2023

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Python (3 forks)auto 404
good first issue

Repository metrics

Stars
 (3 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

Github Actions summary shows tox command run as successful

Although when inspecting the logs we can see failed runs within that job: image

Action: Set up exceptions for the scripts ran by tox, to trigger job failure in CI accordingly.

Contributor guide

Research direction
Inspect the tox configuration and the GitHub Actions workflow to understand how the tox command is called. Check if the script properly propagates exit codes. Then implement error handling to ensure the CI job fails when tox tests fail.
Tech stack
pythongithub actions
Domain
devopstesting
Issue type
Bug
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GitPythontox
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
70