[Bug][Dashboard] Engineering Throughput PR time panels count PRs without a project_pr_metrics row as 0 hours
Les mainteneurs répondent en général sous 2 jours
Évaluation
- Difficulté
- 3/5
- Temps estimé
- Une demi-journée
- Accessibilité débutants
- 22/100
- Type d'issue
- Bug
- Clarté
- Clairement spécifiée
- Activité
- À l'abandon
- Stack technique
- grafana, mysql, postgresql, sql
- Domaine
- data-visualization, databases
Piste de recherche
The affected queries live in the Engineering Throughput and Cycle Time dashboard JSON files, in both MySQL and PostgreSQL variants, including the team-view file. Start with the LEFT JOIN project_pr_metrics plus coalesce(..., 0) in the PR Cycle Time query, and check whether PRs without a metrics row are excluded. Done means those PRs no longer count as 0 h and the panels show No data when no row exists. PR #9226 is already open against this issue, so check it before starting.
Rédigé par le modèle d'indexation à partir du texte de l'issue.
Description
Search before asking
- I had searched in the issues and found no similar issues.
What happened
The PR time panels of the Engineering Throughput and Cycle Time dashboards treat a merged PR that has no
row in project_pr_metrics as a PR that took 0 hours. The PR should be left out of the average instead.
Affected panels (MySQL and PostgreSQL variants of each dashboard):
| Dashboard | Panels |
|---|---|
engineering-throughput-and-cycle-time.json |
PR Cycle Time, PR Coding Time, PR Pickup Time, PR Review Time, PR Deploy Time |
engineering-throughput-and-cycle-time-team-view.json |
Total Cycle Time(h), PR Coding Time(h), PR Pickup Time(h), PR Review Time(h), PR Deploy Time(h) |
All ten queries have the same shape (MySQL version of PR Cycle Time, trimmed):
with _prs as (
SELECT
pr.id,
pr.merged_date as pr_merged_date,
coalesce(prm.pr_cycle_time/60, 0) as cycle_time -- a missing row becomes 0
FROM pull_requests pr
left join project_pr_metrics prm on pr.id = prm.id
join project_mapping pm on pr.base_repo_id = pm.row_id and pm.table = 'repos'
WHERE $__timeFilter(pr.merged_date) and pm.project_name in (${project})
GROUP BY 1,2,3
)
SELECT ..., avg(cycle_time) FROM _prs GROUP BY ...
The set of PRs and the time axis come from pull_requests, while the metric values come from
project_pr_metrics. Because of LEFT JOIN + coalesce(..., 0), a merged PR without a project_pr_metrics
row enters avg() as 0 and pulls the average down:
pull_requests project_pr_metrics value used by the panel
───────────── ────────────────── ───────────────────────
PR A (merged) ──▶ pr_cycle_time = 14h ──▶ 14h
PR B (merged) ──▶ pr_cycle_time = 10h ──▶ 10h
PR C (merged) ──▶ (no row) ──▶ 0h ◀ should be excluded
avg = 8h (expected: 12h)
project_pr_metrics is written only by the DORA plugin (calculateChangeLeadTime in
backend/plugins/dora/tasks/change_lead_time_calculator.go). The most common way to hit this bug is a project
with DORA metrics disabled. In that case pull_requests has merged PRs, but project_pr_metrics has no rows
for them, so all five panels show a flat 0 h. It looks as if every PR was finished instantly, when in fact
no PR time data is available. The dashboard's "Data Sources Required" text does not mention DORA, so users
have no hint about the cause.
The bug depends only on whether a PR has a matching project_pr_metrics row. The reason the row is missing
does not matter.
What do you expect to happen
PRs without a project_pr_metrics row should be left out of these averages (removed from the denominator)
instead of being counted as 0.
If no PR in the selected range has a row (e.g. DORA is not enabled for the project), the panels should show
"No data" instead of 0 h.
How to reproduce
- Create a project with a GitHub or GitLab repository and keep DORA metrics disabled in the project settings.
- Collect data so that
pull_requestscontains merged PRs. - Open Engineering Throughput and Cycle Time (or its Team View) and select the project.
- PR Cycle / Coding / Pickup / Review / Deploy Time show 0 h in every period, even though there are merged PRs.
To count the merged PRs that these panels average in as 0:
SELECT count(*)
FROM pull_requests pr
JOIN project_mapping pm ON pr.base_repo_id = pm.row_id AND pm.`table` = 'repos'
LEFT JOIN project_pr_metrics prm ON pr.id = prm.id
WHERE pr.merged_date IS NOT NULL
AND pm.project_name = '<your project>'
AND prm.id IS NULL;
Anything else
Proposed fix (open to discussion)
- In the 20 affected queries (2 dashboards × 5 panels × MySQL/PostgreSQL), change
LEFT JOIN project_pr_metricsto an innerJOIN. - Keep the existing
coalesce(..., 0)on the per-row values. The comment above it says the goal is to
"make sure cycle_time equals the sum of the four metrics". A row can still have a NULL coding, pickup, review
or deploy time, and those values are still treated as 0. All five panels still average over the same set of
PRs (those that have a row), so this intent is preserved. The only change is that PRs with no row at all are
dropped. - When DORA is enabled, every merged PR in the project gets a row, so those projects see no change in values.
Only the "no row" case changes, from 0 h to excluded (or "No data").
Not affected (no change needed)
dora-details-lead-timefor-changes.jsonuses the sameLEFT JOIN+coalescepattern, but filters on
$__timeFilter(prm.pr_deployed_date), which already drops PRs without a row.DORA.json,dora-by-team.json,kiro-dora.json,kiro-credits-dora.json,
github-copilot-dora-correlation.jsonandmonorepo-subprojects.jsoneither inner-join or select directly
fromproject_pr_metrics, orAVG()the nullable column withoutcoalesce(NULLs are skipped).
Related
- #7398 reported PR Cycle Time showing 0 when data is incomplete. This issue is a different case: the PR has
noproject_pr_metricsrow at all.
Version
v1.0.3-beta15 (the same queries are still on main at 4ad2f66df)
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
- Langage dominant
- Go
- Étoiles
- 3.2k
- Forks
- 819
- Merge moyen
- 2 j 22 h
- PR mergées (30 j)
- 43
Préparer son environnement
Lance le conteneur de développement du projet dans votre navigateur, avec votre propre compte GitHub.
- Aucun Dockerfile ni fichier Docker Compose
- Propose un modèle de pull request
- Aucun guide de contribution
Par où commencer
- Lisez l'issue en entier, puis le guide de contribution du projet.
- Signalez en commentaire que vous la prenez — cela évite que deux personnes fassent le même travail.
- Forkez le dépôt et travaillez sur une branche.
- Ouvrez une pull request qui référence le numéro de l'issue.
Autres issues de apache/devlake
-
[Bug][Project] Invalid metric plugin options are accepted on project save and only fail at the next pipeline runPeut-être pris @chenwei791129 l’a pris il y a 1 jour. Ouverte
Difficulté 3/5 Une demi-journée Accessibilité débutants 22/100
Les mainteneurs répondent en général sous 2 jours
-
[Bug][e2e] Several plugin e2e tests fail on a fresh database because they depend on tables created by other testsPeut-être pris @chenwei791129 l’a pris il y a 1 jour. Ouverte
Difficulté 4/5 3-5 jours Accessibilité débutants 35/100
Les mainteneurs répondent en général sous 2 jours
-
[Feature][dora] Allow filtering which pull requests count toward Lead Time for Changes by branch namePeut-être pris @chenwei791129 l’a pris il y a 1 jour. Ouverte
Difficulté 5/5 Plus d'une semaine Accessibilité débutants 15/100
Les mainteneurs répondent en général sous 2 jours
-
Difficulté 3/5 Une demi-journée Accessibilité débutants 62/100
Les mainteneurs répondent en général sous 2 jours
-
Difficulté 3/5 1-2 jours Accessibilité débutants 42/100
Les mainteneurs répondent en général sous 2 jours
Toutes les issues de apache/devlake
Issues similaires
-
documentation hacktoberfest priority: low skill: good first issue status: ready for dev
Difficulté 2/5 Une demi-journée Accessibilité débutants 85/100
hyperledger-labs/fabric-smart-client#2142 ·
Les mainteneurs répondent en général sous 1 jour
-
Difficulté 2/5 1-3 heures Accessibilité débutants 78/100
numberly/vault-db-injector#107 ·
Les mainteneurs répondent en général sous 1 jour
-
area/import kind/bug
Difficulté 2/5 1-3 heures Accessibilité débutants 62/100
Les mainteneurs répondent en général sous 1 jour
-
[DOC] Wrong sg_egress_ports range in the Terraform Databricks Guide for AWS Hub & Spoke with Network FirewallPeut-être pris @akhil9tiet l’a pris aujourd’hui. Ouvertedocs
Difficulté 1/5 Moins d'une heure Accessibilité débutants 72/100
databricks/terraform-provider-databricks#6080 · 1 commentaire ·
Les mainteneurs répondent en général sous 3 jours
-
kind/documentation
Difficulté 2/5 1-3 heures Accessibilité débutants 80/100
kubernetes-sigs/dra-driver-nvidia-gpu#1569 ·
Les mainteneurs répondent en général sous 1 jour