delta-io/delta
Voir sur GitHub[Feature Request] Support additional generation expressions for automatic data skipping
Open
#1 442 ouverte le 18 oct. 2022
enhancementgood first issue
Métriques du dépôt
- Stars
- (8 807 stars)
- Métriques de merge PR
- (Merge moyen 7j 1h) (142 PRs mergées en 30 j)
Description
Overview
For partition columns that are generated columns, we are able to automatically generate partition filters when we see a data filter on its generating columns. Right now we automatically generate these for a small subset of possible generation expressions (defined here.)
Details
We can add support for additional expressions. Here are the supported generation expressions in Delta.
A few specific expressions that would make sense to add include:
- Ceil: https://github.com/delta-io/delta/issues/1443
- Floor: https://github.com/delta-io/delta/issues/1444
- TruncDate: https://github.com/delta-io/delta/issues/1446
- TruncTimestamp: https://github.com/delta-io/delta/issues/1445
These are just a few, feel free to comment or create a new sub-issue for any additional expressions you think would be beneficial.