opensearch-project/OpenSearch
[Gradle Check Retry] Publish/Record tests which pass after a retry to address flakiness
オープン
#2,797 opened on 2022/04/06
Build Libraries & Interfacesenhancementgood first issuehacktoberfest
Repository metrics
- Stars
- (8,123 個のスター)
- PR merge metrics
- (平均マージ 5d 9h) (30d で 266 merged PRs)
説明
Is your feature request related to a problem? Please describe.
gradle checktest failures are now retried as a part of https://github.com/opensearch-project/OpenSearch/pull/2638- This issue addresses the scenarios where the check passes with retries where the flakey tests are lost under the green status
Describe the solution you'd like
- As a part of the solution, there should be a record of logs and/or a comment on the PR in case of test failures
- The generated report has a log of the tests that fail even though the overall job succeeds
- Record the frequent offenders to address and mitigate the underlying root cause for flakiness
Describe alternatives you've considered
- Manually keeping track of failed tests from the
gradle checkbot reports
Additional context
- N/A