Blosc/python-blosc2

[BENCH] Real-world query performance comparison

Open

#652 opened on 2026年6月2日

GitHub で見る
 (0 comments) (0 reactions) (0 assignees)Python (47 forks)auto 404
documentationhelp wanted

Repository metrics

Stars
 (207 stars)
PR merge metrics
 (PR metrics pending)

説明

examples/ctable/real_world.py exists but is a fairly raw script. There is no self-contained example that clearly shows what performance gain SUMMARY indexes provide over a full scan, or how block size affects that gain — which is the most common question users will have after enabling auto-indexing.

Suggested work: Write bench/ctable/summary_index_perf.py that:

  • Generates a synthetic CTable with a few million rows and numeric columns
  • Runs the same where() query three ways: no index, SUMMARY at chunk granularity, SUMMARY at block granularity
  • Prints a clean results table (rows scanned, time, speedup)
  • Includes comments explaining the trade-offs

Ideally, it should work without any external dataset so it can be run immediately after install, but using an accessible dataset is also an option.

コントリビューターガイド