bencheeorg/benchee

Ability to set a "reference" job

Open

#179 ouverte le 19 févr. 2018

Voir sur GitHub
 (2 commentaires) (3 réactions) (0 assignés)Elixir (69 forks)batch import
help wanted

Métriques du dépôt

Stars
 (1 509 stars)
Métriques de merge PR
 (Merge moyen 9j 11h) (5 PRs mergées en 30 j)

Description

Right now when benchmarks are compared, they are always compared to the fastest run. I think it would be useful in some situations to set a "reference" run and compare all the other runs to that.

One example would be the benchmark suite of jason, where I'd like to see all the other encoders reported relative to Jason itself, even though jiffy is the fastest most of the time. Right now, I have to do the additional computations manually, to get the desired numbers, that I can use to annoy people convincing them how fast Jason is 😉.

Guide contributeur