delta-io/delta

[Feature Request] Support additional generation expressions for automatic data skipping

Open

#1,442 创建于 2022年10月18日

在 GitHub 查看
 (5 评论) (0 反应) (0 负责人)Scala (2,100 fork)batch import
enhancementgood first issue

仓库指标

Star
 (8,807 star)
PR 合并指标
 (平均合并 7天 1小时) (30 天内合并 142 个 PR)

描述

Overview

For partition columns that are generated columns, we are able to automatically generate partition filters when we see a data filter on its generating columns. Right now we automatically generate these for a small subset of possible generation expressions (defined here.)

Details

We can add support for additional expressions. Here are the supported generation expressions in Delta.

A few specific expressions that would make sense to add include:

These are just a few, feel free to comment or create a new sub-issue for any additional expressions you think would be beneficial.

What to update?

贡献者指南