[FEA] Add a method to check if row group stats are available
#17,864 opened on 2025/01/29
Repository metrics
- Stars
- (6,000 個のスター)
- PR merge metrics
- (平均マージ 17d 21h) (30d で 230 merged PRs)
説明
Is your feature request related to a problem? Please describe.
Currently, there isn't a method in predicate_pushdown.cpp (filter_row_groups) to check if row group stats aren't available. Hence, we can't ever set num_surviving_row_groups.after_stats_filter to std::nullopt if stats are unavailable.
Describe the solution you'd like We should figure out a relatively cheaper way to distinguish if row group stats aren't available if possible.
Describe alternatives you've considered
We currently build the entire statsAST table in predicate_pushdown and try to filter row groups with it. In case no row groups are filtered, we can't distinguish if this was due to ineffective filter or missing stats.
Additional context Originally posted by @mhaseeb123 in https://github.com/rapidsai/cudf/pull/17594#discussion_r1932968249