BurntSushi/xsv

feature: binned histograms

开放

#84 创建于 2017年6月13日

 (3 条评论) (2 个反应) (0 位负责人)Rust (315 个派生)batch import
enhancementhelp wanted

仓库指标

星标
 (9,730 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Histograms could be done in numerous ways. Here are some thoughts:

  • like most of xsv, should operate over huge tables with a single pass
  • .idx files could store metadata helpful for binning? eg, min and max values per column
  • "chose N evenly spaced numerical bins" seems to require more than one pass (or keeping all values in memory). Keeping a tree of round-sized bins and merging them when the tree gets too big would avoid that
  • logarithmic bins
  • power-of-two or power-of-1024 (eg, for file sizes)
  • binning of strings or decimal numbers by prefix
  • "other" / "NaN" / null bins
  • csv/tsv output by default, then a separate mode like xsv table to pretty print bars

贡献者指南