Spike: can Studio's WebView (WKWebView) decode device-view frames at 15 fps or more?

未关闭
#448 1 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
2/5
预计耗时
1-3 小时
新手友好度
57/100
Issue 类型
功能
描述清晰度
基本清楚
活跃度
活跃
技术栈
flutter, go
领域
mobile, testing-qa

调研方向

The issue names no repository files; start by locating Studio’s Wails WebView harness and the device view hub that accepts loopback WebSocket connections. Rerun the harness in an unlocked, visible macOS session and record rendered fps and decode time for each frame size. Done means reporting the measurements and whether 603x1311 frames reach 15 fps without dropped-frame growth.

由索引模型根据 Issue 内容生成。

描述

area/studio documentation

Question: can a page opened in Studio's Wails WebView on macOS (WKWebView) connect to ws://127.0.0.1, receive JPEG frames and decode them with createImageBitmap at 15 fps or more?

What was run (2026-10-14)

A small native host (a WKWebView in an AppKit window, the page served from a custom wails://wails/ scheme as Wails does) and a loopback Go server that streams real JPEG frames (a photographic image at 402x874, 603x1311 and 1206x2622 portrait sizes: 23, 41 and 118 KiB at quality 60; and a UI screenshot: 15, 27 and 83 KiB), paced at 30 fps and acknowledged-as-fast-as-decoded. The page decodes each frame with createImageBitmap(new Blob([bytes],{type:"image/jpeg"})), draws it on a canvas and reports rendered frames, drops, decode and draw time.

Result

  • Answered: a page whose origin is wails://wails connects to ws://127.0.0.1:<port> and the server sees Origin: wails://wails, which the device view hub allows. No mixed-content or custom-scheme block.
  • Not answered: the decode rate. The Mac's screen was locked during the run, so the window reported document.hidden === true and WebKit stopped running the page's timers after the first 6 second step. That step, 402x874 frames at a 30 fps pace, rendered 106 of 185 received frames (about 17.7 per second) in a hidden window, which is not a valid measurement. A visible window is needed.
  • A second route (Playwright's WebKit build, headless) was started but its browser download did not finish in the time available, so no WebKit number exists yet.

To finish

Run the same harness on an unlocked session (or with Playwright WebKit) and report fps and decode ms per size. Acceptance for the device view: at least 15 fps rendered at 603x1311 JPEG without dropped-frame growth.

Nothing was installed on the machine besides the throwaway harness; no code is proposed in the repository for this spike.

主要语言
Go
星标
6
派生
3
平均合并
6 小时 28 分钟
30 天内合并 PR
362

环境准备

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

AlphaWaveSystems/flutter-probe 的其他 Issue

查看 AlphaWaveSystems/flutter-probe 的全部 Issue

相似的 Issue

更多 Go Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。