Incognito-per-render forfeits Chrome's V8 code cache (~9% CPU measured); parked on isolation at concurrency
还没有人认领这个 Issue。
评估
- 难度
- 5/5
- 预计耗时
- 一周以上
- 新手友好度
- 35/100
- Issue 类型
- 功能
- 描述清晰度
- 基本清楚
- 活跃度
- 活跃
- 技术栈
- javascript
- 领域
- backend, performance
调研方向
Start with bench/render-cpu/README and its harness, then inspect settings.browserExpirationThreshold, resetForNextVariant, and variantContext.ts for the existing retirement and wipe semantics. Measure 200–300 sequential renders with the fresh-incognito control, recording wall time, CPU, ScriptDuration, RSS, and process count, plus realistic per-slot resource use. Done means a reported series that attributes any aging and establishes whether per-slot persistent profiles are safe to pursue.
由索引模型根据 Issue 内容生成。
描述
What is true today
Every render gets a fresh incognito BrowserContext (settings.incognitoPages, default true; ManagedBrowser.getPage). An off-the-record context's HTTP cache is in-memory and dies with the context, and Chrome's V8 code cache lives in the disk-cache backend — so no compiled script ever survives a render. Two consequences:
--disk-cache-size=1073741824inDEFAULT_CHROME_ARGShas never applied to a single render.- A sub-resource replayed from our own
ResourceCacheviaFetch.fulfillRequestnever enters Chrome's HTTP cache either, so it can never get a code-cache entry. Our cache saves the fetch and forfeits the compile.
Every script on every page is therefore parsed and compiled from scratch, every render.
What it is worth
Measured on a live commerce product page, 6 renders per arm, interleaved, medians excluding the cold first render:
| arm | wall | CPU | ScriptDuration |
|---|---|---|---|
| incognito context per render (today) | 4,197ms | 4,900ms | 808ms |
default context + persistent userDataDir |
3,845 (−8%) | 4,440 (−9%) | 629 (−22%) |
| persistent profile + per-render wipe | 3,749 (−11%) | 4,450 (−9%) | 581 (−28%) |
Content identical in every arm (review nodes 1,430; zero un-hydrated framework islands; HTTP 200).
A synthetic fixture cannot size this — it reports ScriptDuration of ~40ms in a 7,500ms render, and V8CompileDuration is useless as an instrument because V8 compiles lazily on background threads. The win scales with a real page's script cost (measured 800–2,465ms on real pages), so only a real-page measurement decides it.
Why this is parked rather than shipped
The arm that was measured cannot ship. It ran at maxActivePages: 1 — strictly sequential — with incognitoPages: false, meaning every render shared the default context's single cookie jar. At production concurrency that breaks in two ways:
- Identity bleed across unrelated URLs. Concurrent renders of different pages interleave session, visitor and bot-mitigation cookies. This repo already measured the sibling case: an unwiped shared context handed a second device variant 125 cookies instead of the 6 pinned ones, putting both devices on one session id, one visitor id and one bot-mitigation token (see the v1.28.0 context-sharing work and
variantContext.ts). That is why context sharing only ever shipped scoped to one job, with a mandatory wipe and a fail-closed fallback. - The wipe is globally destructive.
deleteCookie+Storage.clearDataForOriginact on the whole context, so firing it between renders would delete the cookies of renders still in flight. Structural, not a tunable race.
The shape that could ship
One browser per slot, each with its own --user-data-dir — not a shared context. Each slot then has its own cookie jar (isolation exactly as today), its own disk cache (so the code cache warms), and renders within a slot are sequential by construction, which is the condition resetForNextVariant was designed for. It is the existing per-job argument, one level up.
Already settled, so nobody re-derives it
- The wipe is not a cost. Measured on live pages with all cookies deleted each time: 2–5ms against a ~4,000ms render (~0.1%), on a jar holding 48–77 cookies. The jar does not accumulate, because the wipe runs every render. (Puppeteer issues one
Network.deleteCookiesper cookie and 75 of them still lands in single-digit ms.) - Memory is not the constraint. Production pods have ample memory and disk. RSS is ~265MB per concurrent slot and linear, and extra browser processes cost 7–14% more RSS — worth reporting, not disqualifying.
Storage.clearDataForOrigindoes not clear the HTTP disk cache, which is why the wiped arm kept the whole win. Isolation and the code cache are not in tension.
What has to be measured before picking this up
- Does browser aging justify retiring at 200 pages? (
settings.browserExpirationThreshold) Retirement every ~13 minutes is exactly what would discard the warm profile. The reason on record is a general "prevent memory leaks" recommendation plus an operator observation that aged browsers seemed slower; it has never been measured. Wanted: an aging curve over 200–300 sequential renders (per-render wall, CPU, ScriptDuration, RSS, process count) reported as a series, with today's fresh-incognito shape as the control, and attribution if drift appears — is it RSS-correlated, renderer-process-age-correlated, or reset by disposing a context while keeping the browser? Only one of those is a thing retirement actually fixes. - Cookie semantics across job boundaries. Inside a slot, consecutive renders are different URLs, so the wipe must delete all cookies including the pinned ones — pins are job-scoped by design. That is a different wipe than the one that exists.
- Per-slot RSS and process count at realistic concurrency, for sizing rather than as a blocker.
Related
Our ResourceCache deserves a look in the same pass: measured at production resource counts it does not remove CPU, it moves ~50ms onto the single Node thread to save ~70ms of Chrome CPU, and Chrome's own cache achieves the same origin offload at zero Node cost — though only within one browser's lifetime, whereas the disk cache is shared across slots and restarts. That trade is only justified by real origin RTT, which a localhost fixture cannot price.
Bench harness and full numbers: bench/render-cpu/ (README has the method, the instruments, and the dead-end table).
- 主要语言
- JavaScript
- 星标
- 0
- 派生
- 0
- 平均合并
- 9 小时 10 分钟
- 30 天内合并 PR
- 56
贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
HarperFast/prerender-plugin 的其他 Issue
-
难度 2/5 1-3 小时 新手友好度 86/100
HarperFast/prerender-plugin#176 ·
-
难度 4/5 3-5 天 新手友好度 48/100
HarperFast/prerender-plugin#189 ·
-
难度 5/5 一周以上 新手友好度 25/100
HarperFast/prerender-plugin#183 ·
-
难度 5/5 一周以上 新手友好度 35/100
HarperFast/prerender-plugin#180 ·
-
难度 4/5 3-5 天 新手友好度 38/100
HarperFast/prerender-plugin#179 ·
查看 HarperFast/prerender-plugin 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 82/100
-
area-deployment area-integrations triage:bot-seen
难度 2/5 半天 新手友好度 86/100
-
Issue-Bug
难度 2/5 1-3 小时 新手友好度 68/100
sugarlabs/musicblocks#8924 ·
-
难度 1/5 1 小时以内 新手友好度 90/100
ArduPilot/ardupilot_wiki#8088 ·
-
[BUG] createTool tools cannot be registered with Mastra when exactOptionalPropertyTypes is enabled 未关闭customer-eng status: needs triage
难度 2/5 1-3 小时 新手友好度 84/100