apache/hudi

Limit the amount of partitions considered for GlobalBloomIndex

已關閉

#14,484 建立於 2025年11月30日

 (1 則留言) (0 個反應) (0 位負責人)Java (2,431 個分叉)batch import
area:indexfrom-jiragood first issuepriority:hightype:improvement

倉庫指標

星標
 (4,823 顆星)
PR 合併指標
 (平均合併 16天 21小時) (30 天內合併 127 個 PR)

描述

Currently, global bloom index will check inputs against files in all partitions.. In lot of cases, the user may know a range of partitions actually impacted from updates clearly (e.g upstream system drops updates older than a year, ... ).. In such a scenario,it may make sense to support an option for Global bloom to control how many partitions you want to match against, to gain performance.

JIRA info

貢獻者指南