apache/hudi

Add more tests to TestCOWDataSource for TimestampbasedKeyGen

Open

#14753 opened on Nov 30, 2025

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Java (4,823 stars) (2,431 forks)batch import
area:testsfrom-jiragood first issuepriority:high

Description

[https://github.com/apache/hudi/pull/2431] adds support to leverage spark.sql partitionBy() clause to set Hudi's partition. So, some minimal tests are added to TestCOWDataSource for timestamp based key gen. But we would like to get more coverage wrt  timestamp based key gen

JIRA info

Contributor guide

Tech stack
java
Domain
testing
Issue type
test
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
JavaApache Hudi basicsSpark SQLTimestampbasedKeyGen
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
50
Research direction
Refer to the linked PR https://github.com/apache/hudi/pull/2431 for the initial implementation. Examine TestCOWDataSource in the source code (likely under hudi spark datasource/hudi spark/src/test/) to see existing tests for timestamp based key gen. Identify scenarios like different timestamp formats, edge cases, and partitionBy usage. Ensure tests cover both successful and error cases.