apache/hudi
Limit the amount of partitions considered for GlobalBloomIndex
クローズ
#14,484 opened on 2025/11/30
area:indexfrom-jiragood first issuepriority:hightype:improvement
Repository metrics
- Stars
- (4,823 個のスター)
- PR merge metrics
- (平均マージ 16d 21h) (30d で 127 merged PRs)
説明
Currently, global bloom index will check inputs against files in all partitions.. In lot of cases, the user may know a range of partitions actually impacted from updates clearly (e.g upstream system drops updates older than a year, ... ).. In such a scenario,it may make sense to support an option for Global bloom to control how many partitions you want to match against, to gain performance.
JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-145
- Type: Improvement