Performance Regression or Improvement: combine_python_batch_2gb_10_byte_records:runtime

Open
  • Is something wrong?
#40,642 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
15/100
Issue type
Bug
Clarity
Needs clarification
Activity status
Active
Tech stack
python
Domain
performance

Research direction

The alert concerns the batch Combine load test combine_python_batch_2gb_10_byte_records, defined in .test-infra/jenkins/job_LoadTests_Combine_Python.groovy around line 76. Read the triage steps in sdks/python/apache_beam/testing/analyzers/README.md, then use the dashboard to find the commits between the roughly 380 ms runs and the roughly 1700 ms runs. Done means identifying the change behind the slowdown and confirming whether the recent drop to about 230 is a real improvement.

Written by the indexing model from the issue text.

Description

awaiting triage perf-alert

Performance change found in the
test: combine_python_batch_2gb_10_byte_records for the metric: runtime.

For more information on how to triage the alerts, please look at
Triage performance alert issues section of the README.

Test description: Combine Python Load Test 2 GB 10 byte records
Test link - https://github.com/apache/beam/blob/5e38decf9e723a385057131b01bbd33d8c60bda3/.test-infra/jenkins/job_LoadTests_Combine_Python.groovy#L76C24-L76C65
Test dashboard - http://metrics.beam.apache.org/d/WNzYt13Zk/combine-load-tests?orgId=1&from=now-90d&to=now&var-processingType=batch&var-sdk=python&viewPanel=2


timestamp: Fri Oct 16 15:37:37 2026, metric_value: 231.00
timestamp: Thu Oct 15 15:45:47 2026, metric_value: 320.00
timestamp: Wed Oct 14 15:42:40 2026, metric_value: 209.00
timestamp: Tue Oct 13 15:44:16 2026, metric_value: 234.00 <---- Anomaly
timestamp: Mon Oct 12 16:12:16 2026, metric_value: 1717.00
timestamp: Sun Oct 11 16:14:56 2026, metric_value: 2335.00
timestamp: Sat Oct 10 16:04:00 2026, metric_value: 1688.00
timestamp: Fri Oct  9 16:05:36 2026, metric_value: 1668.00
timestamp: Thu Oct  8 15:46:32 2026, metric_value: 366.00
timestamp: Wed Oct  7 15:55:13 2026, metric_value: 360.00
timestamp: Tue Oct  6 15:46:39 2026, metric_value: 385.00
timestamp: Mon Oct  5 15:45:52 2026, metric_value: 382.00
timestamp: Sun Oct  4 17:03:54 2026, metric_value: 377.00
timestamp: Sat Oct  3 16:52:38 2026, metric_value: 388.00
Dominant language
Java
Stars
8.7k
Forks
4.8k
Avg merge
2d 9h
Merged PRs (30d)
368

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from apache/beam

All issues in apache/beam

Similar issues

More Java issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.