Cross-platform capture backends (x11grab / avfoundation)

Ouverte
#15 2 commentaires 0 réactions 0 personnes assignées Voir sur GitHub

Les mainteneurs répondent en général sous 1 jour

Personne n'a encore pris cette issue.

Évaluation

Difficulté
5/5
Temps estimé
Plus d'une semaine
Accessibilité débutants
30/100
Type d'issue
Fonctionnalité
Clarté
Plutôt claire
Activité
Calme
Stack technique
typescript
Domaine
desktop

Piste de recherche

Start with src/utils/targets.ts and trace how buildCaptureArgs, buildScreenshotArgs, and targetInputArgs construct capture arguments; then read src/utils/monitors.ts, src/utils/windows.ts, and src/utils/resolveTarget.ts for target resolution. Begin with the Linux x11grab video scope and use the pure argument builders with an injected platform to test full, monitor, and region targets. Done means those targets build the specified Linux arguments, while unsupported non-Windows window and system-audio requests return clear errors.

Rédigé par le modèle d'indexation à partir du texte de l'issue.

Description

enhancement

Problem

Capture is Windows-only. start_recording and screenshot hardcode -f gdigrab (src/utils/targets.ts: buildCaptureArgs / buildScreenshotArgs / targetInputArgs), and target resolution uses Windows APIs (src/utils/monitors.ts via PowerShell, src/utils/windows.ts for window bounds, wired in src/utils/resolveTarget.ts).

The watch, edit, redact, and produce tools already run anywhere ffmpeg does. Only capture is pinned to Windows.

Proposed backends

Selected by process.platform:

  • win32 -> gdigrab (current).
  • linux -> x11grab: -f x11grab -framerate N -video_size WxH -i $DISPLAY+X,Y. Native offset/region, mirrors gdigrab closely (lowest-risk first target).
  • darwin -> avfoundation: -f avfoundation -framerate N -i "<screen-index>". No native offset, so a region: needs -vf crop=w:h:x:y over a full-screen grab; needs screen-recording permission (TCC); the screen device index comes from ffmpeg -f avfoundation -list_devices true -i "".

Architecture sketch

  • Add a host-platform helper (overridable via env for tests).
  • Refactor targetInputArgs into a backend-aware captureInputArgs(target, platform, monitors) and thread a platform option through buildCaptureArgs / buildScreenshotArgs, so the pure builders stay unit-testable for all three platforms on any host.
  • Per-platform monitor enumeration: keep Windows (getMonitors), add Linux via xrandr and macOS via the avfoundation device list.
  • window: targets and system audio stay Windows-only initially (they need xdotool / BlackHole / pulse), with a clear error on other platforms.

Suggested sequencing

  1. Linux (x11grab) first; scope to video full / monitor / region.
  2. macOS (avfoundation) as a follow-up.

Testing reality

The pure arg-builders are fully unit-testable by injecting platform. Actual x11grab / avfoundation runtime can only be verified on those OSes, not from the Windows dev box.

Scope decisions (from planning)

  • Video full / monitor / region cross-platform; window: + system audio stay Windows-only initially.

Recorded from a planning session; not yet scheduled for implementation.

Langage dominant
TypeScript
Étoiles
1
Forks
4
Merge moyen
14 h 8 min
PR mergées (30 j)
48

Préparer son environnement

Par où commencer

  1. Lisez l'issue en entier, puis le guide de contribution du projet.
  2. Signalez en commentaire que vous la prenez — cela évite que deux personnes fassent le même travail.
  3. Forkez le dépôt et travaillez sur une branche.
  4. Ouvrez une pull request qui référence le numéro de l'issue.

Autres issues de TMHSDigital/screencast-mcp

Toutes les issues de TMHSDigital/screencast-mcp

Issues similaires

Plus d'issues TypeScript

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.