Debugging data collection affects meta-frameworks differently
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Active
- Tech stack
- javascript, typescript
- Domain
- performance, testing-qa
Research direction
Start by locating the Lighthouse configuration and benchmark entry points used for CSR and SSR measurements. Compare runs with Stack Capture, Precise JavaScript coverage, and debugger async-stack tracking enabled and disabled, then determine whether a consistent configuration or documented limitation is needed. Done means framework comparisons are not unevenly affected by these debugging options.
Written by the indexing model from the issue text.
Description
Lighthouse enabled a bunch of debugging tools, that can be very useful to precisely track down which piece of code is responsible for what, but it affects different meta-frameworks differently.
The main options I found that contribute to this are:
- Stack Capture
- Precise JavaScript coverage
- Debugger async-stack tracking
"stack capture" is the most impactful as far as i can tell. For example when i tried disabling it on a task i was benchmarking i got this:
| Measurement | CSR | SSR |
|---|---|---|
| Late task, default Lighthouse | 44.1 ms | 44.1 ms |
| Same task, stack capture disabled | 4.6 ms | 5.2 ms |
But the main problem is that it doesn't affect all meta-frameworks the same way. For "stack capture" for example its impact depends basically on the number of function calls and their depth. So the comparison across frameworks becomes less fair.
FWIW in the next version of TanStack Start the INP measurements are not impacted by any of these features any more than the other frameworks (they seem to all be pretty much within noise of each other). But these options could still impact future measurements unequally (like if a "navigation" measurement is added later, this will probably show up).
- Dominant language
- TypeScript
- Stars
- 42
- Forks
- 16
- Avg merge
- 13h 41m
- Merged PRs (30d)
- 144
Getting set up
- Ships a Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from e18e/framework-tracker
-
documentation
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
e18e/framework-tracker#640 ·
Maintainers usually reply within 1 day
-
documentation
Difficulty 3/5 1-2 days Newbie friendliness 45/100
e18e/framework-tracker#666 ·
Maintainers usually reply within 1 day
-
Variance ChartsOpendocumentation
Difficulty 5/5 Over a week Newbie friendliness 35/100
e18e/framework-tracker#665 ·
Maintainers usually reply within 1 day
-
TanStack Bar ChartOpendocumentation
Difficulty 4/5 3-5 days Newbie friendliness 45/100
e18e/framework-tracker#664 ·
Maintainers usually reply within 1 day
-
TanStack Line ChartOpendocumentation
Difficulty 4/5 1-2 days Newbie friendliness 45/100
e18e/framework-tracker#663 ·
Maintainers usually reply within 1 day
All issues in e18e/framework-tracker
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
Maintainers usually reply within 1 day
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 67/100
mobile-next/mobile-mcp#526 ·
Maintainers usually reply within 1 day
-
e2e-failure ready-to-code
Difficulty 1/5 Under an hour Newbie friendliness 73/100
redhat-developer/rhdh-plugin-export-overlays#4470 · 1 comment ·
Maintainers usually reply within 1 day