mcollina/autocannon

Inform about the number of observations

開放

#143 建立於 2018年6月26日

 (14 則留言) (0 個反應) (0 位負責人)JavaScript (332 個分叉)batch import
enhancementgood first issue

倉庫指標

星標
 (7,425 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

To compute a confidence interval or determine if there is a statistical difference between two versions, at least three pieces of information is required:

  • the mean
  • the standard deviation (or variance)
  • the number of observations, that the mean and standard deviation were sampled from.

The number of observations is not really clear from the output.

In a previous conversation @mcollina wrote:

The approach that autocannon takes is that it samples once per second the number of requests that happened within that second (https://github.com/mcollina/autocannon/blob/master/lib/run.js#L119-L122). So, it's 30 samples.

It is not really clear to me how that data is aggregated. Or how it relates to 30 samples.

貢獻者指南