`loadPixels` and `PGraphics` dependency batching in WebGPU
还没有人认领这个 Issue。
评估
- 难度
- 5/5
- 预计耗时
- 一周以上
- 新手友好度
- 25/100
- Issue 类型
- 功能
- 描述清晰度
- 基本清楚
- 活跃度
- 停滞
调研方向
首先跟踪 issue 中描述的 loadPixels、PGraphics 以及 drawStart、flush 和 drawEnd 生命周期的 WebGPU 实现。检查每个 surface 如何设置 CameraOutputMode,然后使用同步 readback 验证 immediate-mode 方法,以及所述的渲染顺序和可见性要求。
由索引模型根据 Issue 内容生成。
描述
The processing API allows performing arbitrary GPU->CPU readback on demand via the loadPixels method. This is generally an extension of the immediate mode philosophy of processing but poses significant friction with modern graphics architectures. In contrast with opengl, which goes to significant lengths to preserve the illusion that GPU data is easily accessible, WebGPU is designed to foreground that GPU operations are asynchronous relative to the CPU timeline. While the API does support blocking on these operations, the expectation of most framework including bevy is that you won't.
Concretely why this matters is because modern graphics libraries really want to batch rendering together for efficiency reasons. For example, in Bevy, all cameras (which could be considered an analog to a PGraphics instance) want to render at the same time every frame. loadPixels introduces an architectural complication in that the current draw state may need to be flushed and made visible to any other graphics context at any arbitrary time.
In other words, beyond any performance concerns, this highlights a potential dependency problem between PGraphics instances:
- In the event where multiple
PGraphicsinstances aren't dependent on each other, batching works fine and we can delay flushing all their draw state til the end of frame. - When a
PGraphicsis used in anotherPGraphics, e.g. an off-screen texture used by something in rendering to the screen, we could simply just track a relative order to ensure the BevyCamerafor one runs before the other. - If the user calls
loadPixels, we need to flush the draw state right now and make the texture visible to potentially any other CPU code.
Approach for WebGPU with Bevy
We should start just by mirroring the immediate mode API. What this means is that we'll mirror the drawStart, flush, drawEnd lifecycle. Set CameraOutputMode::Skipat the beginning of each frame for each surface to render only to the intermediate texture and CameraOutputMode::Write only when calling drawEnd.
We can handle loadPixels in this way just by doing a synchronous readback after a flush. It's fine, and will superficially look like opengl's behavior from the user perspective.
Because this immediate mode approach likely has some undesirable overhead (although tbd, it may be pretty minimal), we can do our own dependency/dirty tracking if necessary down the line. What this would look like is keeping an in-flight dependency graph of PGraphics and how they're being used, and only trigger flushes when they acutally need to be made visible to other graphics contexts. This isn't hard to do but will make the implementation more confusing.
- 主要语言
- Java
- 星标
- 497
- 派生
- 183
- 平均合并
- 4 小时 39 分钟
- 30 天内合并 PR
- 3
贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
processing/processing4 的其他 Issue
-
bug
难度 2/5 1-3 小时 新手友好度 64/100
processing/processing4#1554 · 1 条评论 ·
-
难度 2/5 1-3 小时 新手友好度 76/100
processing/processing4#1515 · 1 个 reaction ·
-
bug
难度 3/5 1-2 天 新手友好度 55/100
processing/processing4#1573 ·
-
startup error 未关闭
难度 4/5 3-5 天 新手友好度 25/100
processing/processing4#1569 · 7 条评论 ·
-
Binaries under bin directory lack executable permissions for the snap and .deb packages for Linux 未关闭bug
processing/processing4#1567 · 3 条评论 · 1 个 reaction · 已指派 1 人 ·
查看 processing/processing4 的全部 Issue
相似的 Issue
-
certification
难度 1/5 1 小时以内 新手友好度 80/100
-
难度 2/5 1-3 小时 新手友好度 75/100
-
[BUG] ECR GetAuthorizationToken returns a proxyEndpoint for the default region, not the request's 未关闭bug ecr
难度 2/5 1-3 小时 新手友好度 75/100
-
Needs: Triage Type: Feature request
难度 2/5 1-3 小时 新手友好度 70/100
AntennaPod/AntennaPod#8794 ·
-
agentic-workflows
难度 2/5 1-3 小时 新手友好度 65/100
github/copilot-sdk#2760 ·