[JS] [Benchmarking] JavaScript microbenchmarks display regressions
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 30/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- javascript, typescript
- Domain
- performance
Research direction
Start by reviewing the benchmark restoration described in Apache Arrow issues/PRs 37657, 37668, and 38500, then compare the linked Conbench runs. Determine whether the JavaScript benchmark setup changed and whether that explains the regressions; done means documenting the cause or confirming that the performance changes need investigation.
Written by the indexing model from the issue text.
Description
Describe the bug, including details regarding any error messages, version, and platform.
I opened https://github.com/apache/arrow/issues/37657 a few months ago after noticing that the JavaScript microbenchmarks stopped working. Since then, @trxcllnt opened a PR https://github.com/apache/arrow/pull/37668 to fix them (which @assignUser merged in https://github.com/apache/arrow/pull/38500).
Now that they're running again, I noticed performance regressions in almost all of them. See the data in Conbench. Many of them are over 4x slower.
Is this expected due to a known change in the benchmarking setup? If so, I can annotate these performance jumps in Conbench so that future regression alerts are more effective. If not, someone more familiar with the JS codebase should probably investigate.
Component(s)
Benchmarking, JavaScript
- Dominant language
- TypeScript
- Stars
- 112
- Forks
- 23
- Avg merge
- 17h 55m
- Merged PRs (30d)
- 10
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from apache/arrow-js
-
Difficulty 3/5 1-2 days Newbie friendliness 68/100
-
Difficulty 3/5 1-2 days Newbie friendliness 55/100
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
Difficulty 3/5 1-2 days Newbie friendliness 50/100
Similar issues
-
VerificationGate: ATTRIBUTION quote guard never matches a normal quotation (\b around the quote) Open
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
danielmiessler/LifeOS#2234 ·
-
T: Bug
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
-
Difficulty 1/5 Under an hour Newbie friendliness 85/100
-
Mend: dependency security vulnerability untriaged
Difficulty 2/5 1-3 hours Newbie friendliness 70/100