opensearch-project/OpenSearch
GitHub で見る[Gradle Check Retry] Publish/Record tests which pass after a retry to address flakiness
Open
#2,797 opened on 2022年4月6日
Build Libraries & Interfacesenhancementgood first issuehacktoberfest
Repository metrics
- Stars
- (8,123 stars)
- PR merge metrics
- (平均マージ 5d 9h) (30d で 266 merged PRs)
説明
Is your feature request related to a problem? Please describe.
gradle checktest failures are now retried as a part of https://github.com/opensearch-project/OpenSearch/pull/2638- This issue addresses the scenarios where the check passes with retries where the flakey tests are lost under the green status
Describe the solution you'd like
- As a part of the solution, there should be a record of logs and/or a comment on the PR in case of test failures
- The generated report has a log of the tests that fail even though the overall job succeeds
- Record the frequent offenders to address and mitigate the underlying root cause for flakiness
Describe alternatives you've considered
- Manually keeping track of failed tests from the
gradle checkbot reports
Additional context
- N/A