delta-io/delta
Auf GitHub ansehen[Feature Request] Support additional generation expressions for automatic data skipping
Open
#1.442 geöffnet am 18. Okt. 2022
enhancementgood first issue
Repository-Metriken
- Stars
- (8.807 Stars)
- PR-Merge-Metriken
- (Durchschn. Merge 7T 1h) (142 gemergte PRs in 30 T)
Beschreibung
Overview
For partition columns that are generated columns, we are able to automatically generate partition filters when we see a data filter on its generating columns. Right now we automatically generate these for a small subset of possible generation expressions (defined here.)
Details
We can add support for additional expressions. Here are the supported generation expressions in Delta.
A few specific expressions that would make sense to add include:
- Ceil: https://github.com/delta-io/delta/issues/1443
- Floor: https://github.com/delta-io/delta/issues/1444
- TruncDate: https://github.com/delta-io/delta/issues/1446
- TruncTimestamp: https://github.com/delta-io/delta/issues/1445
These are just a few, feel free to comment or create a new sub-issue for any additional expressions you think would be beneficial.