aiperf Total requests fired discrepancy
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 38/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Quiet
- Tech stack
- python
- Domain
- performance
Research direction
No file or test is named. Start by tracing aiperf's request accounting for duration-bound waves and in-flight cancellations, then identify how “Total requests fired” is calculated. Done means the reported total is no longer misleading when requests are cancelled, with coverage for that scenario.
Written by the indexing model from the issue text.
Description
misleading when some in-flight requests cancelled for duration bound waves
- Dominant language
- Python
- Stars
- 0
- Forks
- 1
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from aws-samples/sample-InferenceBenchmarker
-
enhancement
aws-samples/sample-InferenceBenchmarker#16 · 1 assignee ·
-
enhancement
aws-samples/sample-InferenceBenchmarker#12 · 1 assignee ·
-
enhancement
aws-samples/sample-InferenceBenchmarker#11 · 1 assignee ·
-
Create a package Open
Difficulty 5/5 Over a week Newbie friendliness 20/100
-
example
aws-samples/sample-InferenceBenchmarker#7 · 1 assignee ·
All issues in aws-samples/sample-InferenceBenchmarker
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
syfoud/Simulated_Scepter#172 ·
-
A cancelled tests run makes the coverage comment workflow fail and reports it as a red check on main Openarea: ci bug perceived difficulty: 3
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Nitjsefnie-Harness-Commons/daedalus#921 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
EleutherAI/lm-evaluation-harness#4207 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 92/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
ClickHouse/clickhouse-connect#1057 ·