Improve Dashboard for Flaky tests · project-chip/connectedhomeip#71613

2026-04-16T14:39:58.000Z

#### Summary - Recently, a new Dashboard got integrated. This dashboard monitors (REPL Test Runs) whenever there is a "push to master branch" or whenever there is any Master run of REPL Tests. - The limitation with this dashboard, is that it's hard to see proper statistics on flaky tests, the focus is mostly on current run - Can we get a clearer way to displaying history of failed tests, so that we can track flaky tests more easily? - link for dashboard: https://project-chip.github.io/connectedhomeip/allure-report/ci_tests/

(2 留言) (0 反應) (0 負責人)C++ (6,410 star) (1,659 fork)batch import

good first issue

描述

Summary

Recently, a new Dashboard got integrated. This dashboard monitors (REPL Test Runs) whenever there is a "push to master branch" or whenever there is any Master run of REPL Tests.
The limitation with this dashboard, is that it's hard to see proper statistics on flaky tests, the focus is mostly on current run
Can we get a clearer way to displaying history of failed tests, so that we can track flaky tests more easily?
link for dashboard: https://project-chip.github.io/connectedhomeip/allure-report/ci_tests/

貢獻者指南

技術棧: htmlcssjavascript
領域: testinganalytics
議題類型: feature
難度: 3
預計時間: 1-2 days
活動狀態: fresh
清晰度: clear
前置要求: basic knowledge of web developmentfamiliarity with Allure test reports
新手友善度: 60
研究方向: Start by examining the existing dashboard at https://project chip.github.io/connectedhomeip/allure report/ci tests/ to understand its current structure and limitations. Look at the repository's CI configuration (likely in .github/workflows) to see how the Allure report is generated and deployed. Investigate the Allure framework's capabilities for historical test data visualization. Consider modifying the report generation or creating a new HTML page that aggregates historical test results from stored data.