bencheeorg/benchee

Provide "meta" statistics

Open

#56 建立於 2016年12月18日

在 GitHub 查看
 (5 留言) (0 反應) (0 負責人)Elixir (1,509 star) (69 fork)batch import
enhancementgood first issuehelp wanted

描述

For different use cases, like PragTob/benchee_html#10 it'd be great to have statistics about statistics - what I'd call "meta statistics" - although there's probably some better real statistics name for this :)

What should be in there (that I know of so far):

  • job size (how many jobs are in there)
  • minimum of run times over all jobs
  • maximum of run times over all jobs

This should be added as a new key to the benchmarking suite (:meta_statistics) - it could be added within the statistics module but might be better off as a separate MetaStatistics step that is computed after general statistics have been computed.

貢獻者指南

技術棧
無
領域
data
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
3
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
1-2 days
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
stale
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
mostly clear
前置要求
Elixirfamiliarity with benchee codebasebasic statistics
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
30
研究方向
Investigate the existing statistics module (likely lib/benchee/statistics.ex) to understand how current statistics are computed. Then implement a new step or add a new key :meta statistics to the benchmarking suite that calculates job size, minimum, and maximum run times across all jobs. Consider whether to integrate into the Statistics module or create a separate MetaStatistics step. Look at the issue comments for additional user requirements or constraints.
Provide "meta" statistics · bencheeorg/benchee#56 | Good First Issue