delta-io/delta

[Feature Request][Kernel] Make kernel benchmark configurable using command line arguments

Open

#5420 aperta il 30 ott 2025

Vedi su GitHub
 (2 commenti) (0 reazioni) (1 assegnatario)Scala (2100 fork)batch import
delta-kernelenhancementgood first issue

Metriche repository

Star
 (8807 star)
Metriche merge PR
 (Merge medio 7g 1h) (142 PR mergiate in 30 g)

Descrizione

Feature request

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Overview

Motivation

The kernel benchmarking framework currently hard codes benchmark parameters. There are multiple ways users may want to augment a benchmark run including:

  • Filtering benchmark specs by name
  • Configure the number of warmup iterations
  • Configure the number of measurement iterations
  • Configure the warmup time.

Further details

Create a command line argument parser that accepts the above options as configurable parameters. Use the current parameters as the defaults for the benchmark.

For filtering benchmark specs, perform a substring match over each variant's full name. --include-test read_metadata For all other paramaeters, simply take an integer --warum-iterations 10

You can find the relevant file in kernel/kernel-defaults/src/test/java/io/delta/kernel/defaults/benchmarks/WorkloadBenchmark.java`

Guida contributor