bencheeorg/benchee

Provide "meta" statistics

Open

#56 opened on 2016年12月18日

GitHub で見る
 (5 comments) (0 reactions) (0 assignees)Elixir (1,509 stars) (69 forks)batch import
enhancementgood first issuehelp wanted

説明

For different use cases, like PragTob/benchee_html#10 it'd be great to have statistics about statistics - what I'd call "meta statistics" - although there's probably some better real statistics name for this :)

What should be in there (that I know of so far):

  • job size (how many jobs are in there)
  • minimum of run times over all jobs
  • maximum of run times over all jobs

This should be added as a new key to the benchmarking suite (:meta_statistics) - it could be added within the statistics module but might be better off as a separate MetaStatistics step that is computed after general statistics have been computed.

コントリビューターガイド

技術スタック
なし
領域
data
Issue 種別
feature
難度新しい貢献者にとっての実装難度です。1 は非常に小さな変更、5 は専門的な作業です。
3
推定時間経験ある貢献者が調査、実装、テスト、pull request 準備にかけるおおよその時間範囲です。
1-2 days
活動状況Issue が今どれだけ取り組みやすいかを示します。新しい、活発、古い、ブロック中、またはメンテナー入力待ちなどです。
stale
明確さ期待される変更、受け入れ条件、次の手順がどれだけ明確かを示します。
mostly clear
前提条件
Elixirfamiliarity with benchee codebasebasic statistics
初心者向け度初回貢献者にどれだけ取り組みやすいかを 1-100 で推定したスコアです。
30
調査方針
Investigate the existing statistics module (likely lib/benchee/statistics.ex) to understand how current statistics are computed. Then implement a new step or add a new key :meta statistics to the benchmarking suite that calculates job size, minimum, and maximum run times across all jobs. Consider whether to integrate into the Statistics module or create a separate MetaStatistics step. Look at the issue comments for additional user requirements or constraints.