Cross-platform capture backends (x11grab / avfoundation)

未关闭
#15 2 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
5/5
预计耗时
一周以上
新手友好度
30/100
Issue 类型
功能
描述清晰度
基本清楚
活跃度
冷清
技术栈
typescript
领域
desktop

调研方向

Start with src/utils/targets.ts and trace how buildCaptureArgs, buildScreenshotArgs, and targetInputArgs construct capture arguments; then read src/utils/monitors.ts, src/utils/windows.ts, and src/utils/resolveTarget.ts for target resolution. Begin with the Linux x11grab video scope and use the pure argument builders with an injected platform to test full, monitor, and region targets. Done means those targets build the specified Linux arguments, while unsupported non-Windows window and system-audio requests return clear errors.

由索引模型根据 Issue 内容生成。

描述

enhancement

Problem

Capture is Windows-only. start_recording and screenshot hardcode -f gdigrab (src/utils/targets.ts: buildCaptureArgs / buildScreenshotArgs / targetInputArgs), and target resolution uses Windows APIs (src/utils/monitors.ts via PowerShell, src/utils/windows.ts for window bounds, wired in src/utils/resolveTarget.ts).

The watch, edit, redact, and produce tools already run anywhere ffmpeg does. Only capture is pinned to Windows.

Proposed backends

Selected by process.platform:

  • win32 -> gdigrab (current).
  • linux -> x11grab: -f x11grab -framerate N -video_size WxH -i $DISPLAY+X,Y. Native offset/region, mirrors gdigrab closely (lowest-risk first target).
  • darwin -> avfoundation: -f avfoundation -framerate N -i "<screen-index>". No native offset, so a region: needs -vf crop=w:h:x:y over a full-screen grab; needs screen-recording permission (TCC); the screen device index comes from ffmpeg -f avfoundation -list_devices true -i "".

Architecture sketch

  • Add a host-platform helper (overridable via env for tests).
  • Refactor targetInputArgs into a backend-aware captureInputArgs(target, platform, monitors) and thread a platform option through buildCaptureArgs / buildScreenshotArgs, so the pure builders stay unit-testable for all three platforms on any host.
  • Per-platform monitor enumeration: keep Windows (getMonitors), add Linux via xrandr and macOS via the avfoundation device list.
  • window: targets and system audio stay Windows-only initially (they need xdotool / BlackHole / pulse), with a clear error on other platforms.

Suggested sequencing

  1. Linux (x11grab) first; scope to video full / monitor / region.
  2. macOS (avfoundation) as a follow-up.

Testing reality

The pure arg-builders are fully unit-testable by injecting platform. Actual x11grab / avfoundation runtime can only be verified on those OSes, not from the Windows dev box.

Scope decisions (from planning)

  • Video full / monitor / region cross-platform; window: + system audio stay Windows-only initially.

Recorded from a planning session; not yet scheduled for implementation.

主要语言
TypeScript
星标
1
派生
4
平均合并
14 小时 8 分钟
30 天内合并 PR
48

环境准备

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

TMHSDigital/screencast-mcp 的其他 Issue

查看 TMHSDigital/screencast-mcp 的全部 Issue

相似的 Issue

更多 TypeScript Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。