[Gradle Check Retry] Publish/Record tests which pass after a retry to address flakiness · opensearch-project/OpenSearch#2797

(2 commenti) (0 reazioni) (0 assegnatari)Java (1505 fork)batch import

Build Libraries & Interfacesenhancementgood first issuehacktoberfest

Metriche repository

Is your feature request related to a problem? Please describe.

gradle check test failures are now retried as a part of https://github.com/opensearch-project/OpenSearch/pull/2638
This issue addresses the scenarios where the check passes with retries where the flakey tests are lost under the green status

Describe the solution you'd like

As a part of the solution, there should be a record of logs and/or a comment on the PR in case of test failures
The generated report has a log of the tests that fail even though the overall job succeeds
Record the frequent offenders to address and mitigate the underlying root cause for flakiness

Describe alternatives you've considered

Additional context

Direzione di ricerca: Esamina il meccanismo di riprova dalla PR #2638, comprendere come vengono attualmente gestiti i fallimenti dei test e progettare un metodo per registrare e segnalare i test instabili che superano dopo un nuovo tentativo.
Tech stack: java
Dominio: backendtesting qa
Tipo issue: Funzionalità
Difficoltà: 3
Tempo stimato: 1-2 giorni
Stato attività: Attiva
Chiarezza: Abbastanza chiara
Prerequisiti: GitJavaGradle
Adatta ai principianti: 40