project-chip/connectedhomeip

Improve Dashboard for Flaky tests

Open

#71,613 opened on Apr 16, 2026

View on GitHub
 (2 comments) (0 reactions) (0 assignees)C++ (1,659 forks)batch import
good first issue

Repository metrics

Stars
 (6,410 stars)
PR merge metrics
 (Avg merge 8d 5h) (375 merged PRs in 30d)

Description

Summary

  • Recently, a new Dashboard got integrated. This dashboard monitors (REPL Test Runs) whenever there is a "push to master branch" or whenever there is any Master run of REPL Tests.

  • The limitation with this dashboard, is that it's hard to see proper statistics on flaky tests, the focus is mostly on current run

  • Can we get a clearer way to displaying history of failed tests, so that we can track flaky tests more easily?

  • link for dashboard: https://project-chip.github.io/connectedhomeip/allure-report/ci_tests/

Contributor guide

Research direction
Examine the dashboard source code to understand how test results are stored and displayed, then propose a way to show historical failure data.
Tech stack
None
Domain
testingobservability
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
None
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
70