delta-io/delta

[Feature Request] Support additional generation expressions for automatic data skipping

开放

#1,442 创建于 2022年10月18日

 (7 条评论) (0 个反应) (0 位负责人)Scala (2,157 个派生)batch import
enhancementgood first issuenot-stale

仓库指标

星标
 (8,945 个星标)
PR 合并指标
 (平均合并 7天 1小时) (30 天内合并 142 个 PR)

描述

Overview

For partition columns that are generated columns, we are able to automatically generate partition filters when we see a data filter on its generating columns. Right now we automatically generate these for a small subset of possible generation expressions (defined here.)

Details

We can add support for additional expressions. Here are the supported generation expressions in Delta.

A few specific expressions that would make sense to add include:

These are just a few, feel free to comment or create a new sub-issue for any additional expressions you think would be beneficial.

What to update?

贡献者指南