BurntSushi/xsv

feature: binned histograms

オープン

#84 opened on 2017/06/13

 (3 件のコメント) (2 件のリアクション) (0 人の担当者)Rust (315 件のフォーク)batch import
enhancementhelp wanted

Repository metrics

Stars
 (9,730 個のスター)
PR merge metrics
 (30d に merged PR はありません)

説明

Histograms could be done in numerous ways. Here are some thoughts:

  • like most of xsv, should operate over huge tables with a single pass
  • .idx files could store metadata helpful for binning? eg, min and max values per column
  • "chose N evenly spaced numerical bins" seems to require more than one pass (or keeping all values in memory). Keeping a tree of round-sized bins and merging them when the tree gets too big would avoid that
  • logarithmic bins
  • power-of-two or power-of-1024 (eg, for file sizes)
  • binning of strings or decimal numbers by prefix
  • "other" / "NaN" / null bins
  • csv/tsv output by default, then a separate mode like xsv table to pretty print bars

コントリビューターガイド