delta-io/delta

[Feature Request] Support additional generation expressions for automatic data skipping

Open

#1,442 建立於 2022年10月18日

在 GitHub 查看
 (5 留言) (0 反應) (0 負責人)Scala (2,100 fork)batch import
enhancementgood first issue

倉庫指標

Star
 (8,807 star)
PR 合併指標
 (平均合併 7天 1小時) (30 天內合併 142 個 PR)

描述

Overview

For partition columns that are generated columns, we are able to automatically generate partition filters when we see a data filter on its generating columns. Right now we automatically generate these for a small subset of possible generation expressions (defined here.)

Details

We can add support for additional expressions. Here are the supported generation expressions in Delta.

A few specific expressions that would make sense to add include:

These are just a few, feel free to comment or create a new sub-issue for any additional expressions you think would be beneficial.

What to update?

貢獻者指南