delta-io/delta

[Feature Request][Kernel] Make kernel benchmark configurable using command line arguments

Open

#5.420 geöffnet am 30. Okt. 2025

Auf GitHub ansehen
 (2 Kommentare) (0 Reaktionen) (1 zugewiesene Person)Scala (2.100 Forks)batch import
delta-kernelenhancementgood first issue

Repository-Metriken

Stars
 (8.807 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 7T 1h) (142 gemergte PRs in 30 T)

Beschreibung

Feature request

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Overview

Motivation

The kernel benchmarking framework currently hard codes benchmark parameters. There are multiple ways users may want to augment a benchmark run including:

  • Filtering benchmark specs by name
  • Configure the number of warmup iterations
  • Configure the number of measurement iterations
  • Configure the warmup time.

Further details

Create a command line argument parser that accepts the above options as configurable parameters. Use the current parameters as the defaults for the benchmark.

For filtering benchmark specs, perform a substring match over each variant's full name. --include-test read_metadata For all other paramaeters, simply take an integer --warum-iterations 10

You can find the relevant file in kernel/kernel-defaults/src/test/java/io/delta/kernel/defaults/benchmarks/WorkloadBenchmark.java`

Contributor Guide