delta-io/delta
在 GitHub 查看[Feature Request] Support additional generation expressions for automatic data skipping
Open
#1,442 建立於 2022年10月18日
enhancementgood first issue
倉庫指標
- Star
- (8,807 star)
- PR 合併指標
- (平均合併 7天 1小時) (30 天內合併 142 個 PR)
描述
Overview
For partition columns that are generated columns, we are able to automatically generate partition filters when we see a data filter on its generating columns. Right now we automatically generate these for a small subset of possible generation expressions (defined here.)
Details
We can add support for additional expressions. Here are the supported generation expressions in Delta.
A few specific expressions that would make sense to add include:
- Ceil: https://github.com/delta-io/delta/issues/1443
- Floor: https://github.com/delta-io/delta/issues/1444
- TruncDate: https://github.com/delta-io/delta/issues/1446
- TruncTimestamp: https://github.com/delta-io/delta/issues/1445
These are just a few, feel free to comment or create a new sub-issue for any additional expressions you think would be beneficial.