Enhancement: Only show benchmarks with significant changes in PRs

Open
#31 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
45/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Stale
Tech stack
rust
Domain
ci-cd, performance

Research direction

Start by examining the canbench pull-request comment shown in the linked example and trace how benchmark results are selected for that CI comment. Define significant changes from the existing benchmark output, then verify that unchanged benchmarks are omitted while impacted benchmarks remain visible.

Written by the indexing model from the issue text.

Description

In a canbench PR comment like this one, we have many benchmarks, and it can be hard to spot which of the benchmarks exactly have been impacted. It'd be more readable if the CI comment only shows the specific benchmarks that have changed.

Dominant language
Rust
Stars
21
Forks
6
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from dfinity/canbench

All issues in dfinity/canbench

Similar issues

More Rust issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.