Blosc/python-blosc2

[BENCH] Real-world query performance comparison

Open

#652 创建于 2026年6月2日

在 GitHub 查看
 (0 评论) (0 反应) (0 负责人)Python (47 fork)auto 404
documentationhelp wanted

仓库指标

Star
 (207 star)
PR 合并指标
 (PR 指标待抓取)

描述

examples/ctable/real_world.py exists but is a fairly raw script. There is no self-contained example that clearly shows what performance gain SUMMARY indexes provide over a full scan, or how block size affects that gain — which is the most common question users will have after enabling auto-indexing.

Suggested work: Write bench/ctable/summary_index_perf.py that:

  • Generates a synthetic CTable with a few million rows and numeric columns
  • Runs the same where() query three ways: no index, SUMMARY at chunk granularity, SUMMARY at block granularity
  • Prints a clean results table (rows scanned, time, speedup)
  • Includes comments explaining the trade-offs

Ideally, it should work without any external dataset so it can be run immediately after install, but using an accessible dataset is also an option.

贡献者指南