lance-format/lance

Don't materialize any data on `count_rows` if the filter can be satisfied by a scalar index

Open

#2,682 创建于 2024年8月2日

在 GitHub 查看
 (2 评论) (1 反应) (0 负责人)Rust (695 fork)github user discovery
good first issuehelp wanted

仓库指标

Star
 (6,582 star)
PR 合并指标
 (平均合并 6天 1小时) (30 天内合并 219 个 PR)

描述

If we can satisfy a filter with a scalar index then we should be able to implement a fast path for count_rows where we simply return the size of the allow_list or even possibly subtract the size of the block_list from the metadata-only count_rows (might be some tricky bits if there are deletion vectors) to quickly answer queries like count_rows("x != 'foo'").

贡献者指南