apache/hudi

Limit the amount of partitions considered for GlobalBloomIndex

已关闭

#14,484 创建于 2025年11月30日

 (1 条评论) (0 个反应) (0 位负责人)Java (2,431 个派生)batch import
area:indexfrom-jiragood first issuepriority:hightype:improvement

仓库指标

星标
 (4,823 个星标)
PR 合并指标
 (平均合并 16天 21小时) (30 天内合并 127 个 PR)

描述

Currently, global bloom index will check inputs against files in all partitions.. In lot of cases, the user may know a range of partitions actually impacted from updates clearly (e.g upstream system drops updates older than a year, ... ).. In such a scenario,it may make sense to support an option for Global bloom to control how many partitions you want to match against, to gain performance.

JIRA info

贡献者指南