rapidsai/cudf

[FEA] Add a method to check if row group stats are available

已關閉

#17,864 建立於 2025年1月29日

 (0 則留言) (0 個反應) (0 位負責人)C++ (735 個分叉)batch import
0 - BacklogcuIOfeature requestgood first issue

倉庫指標

星標
 (6,000 顆星)
PR 合併指標
 (平均合併 17天 21小時) (30 天內合併 230 個 PR)

描述

Is your feature request related to a problem? Please describe. Currently, there isn't a method in predicate_pushdown.cpp (filter_row_groups) to check if row group stats aren't available. Hence, we can't ever set num_surviving_row_groups.after_stats_filter to std::nullopt if stats are unavailable.

Describe the solution you'd like We should figure out a relatively cheaper way to distinguish if row group stats aren't available if possible.

Describe alternatives you've considered We currently build the entire statsAST table in predicate_pushdown and try to filter row groups with it. In case no row groups are filtered, we can't distinguish if this was due to ineffective filter or missing stats.

Additional context Originally posted by @mhaseeb123 in https://github.com/rapidsai/cudf/pull/17594#discussion_r1932968249

貢獻者指南