bencheeorg/benchee

Provide "meta" statistics

Open

#56 opened on Dec 18, 2016

View on GitHub
 (5 comments) (0 reactions) (0 assignees)Elixir (69 forks)batch import
enhancementgood first issuehelp wanted

Repository metrics

Stars
 (1,509 stars)
PR merge metrics
 (Avg merge 9d 11h) (5 merged PRs in 30d)

Description

For different use cases, like PragTob/benchee_html#10 it'd be great to have statistics about statistics - what I'd call "meta statistics" - although there's probably some better real statistics name for this :)

What should be in there (that I know of so far):

  • job size (how many jobs are in there)
  • minimum of run times over all jobs
  • maximum of run times over all jobs

This should be added as a new key to the benchmarking suite (:meta_statistics) - it could be added within the statistics module but might be better off as a separate MetaStatistics step that is computed after general statistics have been computed.

Contributor guide

Research direction
Examine the Statistics module to understand current output structure, then create a MetaStatistics module to compute job count, min runtime, and max runtime across all jobs, and integrate it as a new step after general statistics computation.
Tech stack
elixir
Domain
backenddeveloper experiencetesting qa
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Mostly clear
Prerequisites
Elixir
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60