[Feature Request][Kernel] Make kernel benchmark configurable using command line arguments
#5420 aperta il 30 ott 2025
Metriche repository
- Star
- (8807 star)
- Metriche merge PR
- (Merge medio 7g 1h) (142 PR mergiate in 30 g)
Descrizione
Feature request
Which Delta project/connector is this regarding?
- Spark
- Standalone
- Flink
- Kernel
- Other (fill in here)
Overview
Motivation
The kernel benchmarking framework currently hard codes benchmark parameters. There are multiple ways users may want to augment a benchmark run including:
- Filtering benchmark specs by name
- Configure the number of warmup iterations
- Configure the number of measurement iterations
- Configure the warmup time.
Further details
Create a command line argument parser that accepts the above options as configurable parameters. Use the current parameters as the defaults for the benchmark.
For filtering benchmark specs, perform a substring match over each variant's full name. --include-test read_metadata
For all other paramaeters, simply take an integer --warum-iterations 10
You can find the relevant file in kernel/kernel-defaults/src/test/java/io/delta/kernel/defaults/benchmarks/WorkloadBenchmark.java`