[Gradle Check Retry] Publish/Record tests which pass after a retry to address flakiness

(2 commentaires) (0 réaction) (0 personne assignée)Java (1 505 forks)batch import

Build Libraries & Interfacesenhancementgood first issuehacktoberfest

Métriques du dépôt

Is your feature request related to a problem? Please describe.

gradle check test failures are now retried as a part of https://github.com/opensearch-project/OpenSearch/pull/2638
This issue addresses the scenarios where the check passes with retries where the flakey tests are lost under the green status

Describe the solution you'd like

As a part of the solution, there should be a record of logs and/or a comment on the PR in case of test failures
The generated report has a log of the tests that fail even though the overall job succeeds
Record the frequent offenders to address and mitigate the underlying root cause for flakiness

Describe alternatives you've considered

Additional context

Direction de recherche: Examinez le mécanisme de réessai de la PR #2638, comprenez comment les échecs de tests sont actuellement gérés et concevez une méthode pour enregistrer et signaler les tests instables qui réussissent après une nouvelle tentative.
Stack technique: java
Domaine: backendtesting qa
Type d'issue: Fonctionnalité
Difficulté: 3
Temps estimé: 1-2 jours
Statut d'activité: Active
Clarté: Plutôt claire
Prérequis: GitJavaGradle
Accessibilité débutant: 40