Create Basic Stress Tests for LM and HM
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 55/100
Research direction
Start by reviewing existing tests in the testing/integration folder and the Launch Manager and Health Monitor test setup. Run the current integration-test suite to see how processes and configuration are created. Done means at least one stress test for LM and one for HM is available there; measuring activation time is optional.
Written by the indexing model from the issue text.
Description
What
Launch Manager (LM) and Health Monitor (HM) could benefit from a set of basic stress tests. The goal is not to build a comprehensive benchmarking suite, but rather to increase confidence in the robustness and scalability of the system under heavier-than-usual workloads.
Launch Manager
As an initial stress test, we could create a scenario that starts 1024 processes (just because 1024 is a nice round number).
Possible setup:
- 512 reporting processes
- 512 native processes
- Minimize the number of unique executables and launch the same executable multiple times through configuration
- Generate the large JSON configuration programmatically to avoid excessive duplication and simplify maintenance
Bonus: Measure and record run-target activation time as the number of processes increases (execute this test with different number of processes).
Health Monitor
Similarly, we could design a stress tests focused on Health Monitor scalability.
Acceptance Criteria (DoD)
At least one stress test for LM and one for HM is available in testing/integration folder.
How
No response
- Dominant language
- C++
- Stars
- 6
- Forks
- 34
- Avg merge
- 1d 23h
- Merged PRs (30d)
- 83
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from eclipse-score/lifecycle
-
documentation
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
eclipse-score/lifecycle#407 ·
-
cleanup
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
eclipse-score/lifecycle#375 ·
-
Feature Req Open
Difficulty 3/5 1-2 days Newbie friendliness 55/100
eclipse-score/lifecycle#664 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 66/100
eclipse-score/lifecycle#652 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
eclipse-score/lifecycle#649 · 1 comment ·
All issues in eclipse-score/lifecycle
Similar issues
-
Difficulty 1/5 Under an hour Newbie friendliness 90/100
AXERA-TECH/ax-llm#77 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 90/100
games-on-whales/wolf#509 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
-
bug-unconfirmed
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
NVIDIA/cuda-samples#453 ·