Review player: show clicks and captions on the timeline

Offen
#378 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen

Maintainer antworten meist innerhalb von 1 Tag

Dieses Issue hat noch niemand übernommen.

Bewertung

Schwierigkeit
4/5
Geschätzter Aufwand
3-5 Tage
Anfängerfreundlichkeit
57/100
Issue-Typ
Feature
Klarheit
Klar beschrieben
Aktivitätsstatus
Aktiv
Tech-Stack
typescript

Rechercherichtung

Start with src/tools/reviewRecording.ts to see how player_frames builds its payload, then read assets/ui/player.js for the timeline and frame display. Check src/utils/events.ts, src/tools/readEvents.ts, and src/tools/transcribe.ts for the event log and SRT sidecar formats. Done means both tracks can be toggled, clicks seek and show their frame position, captions follow the current frame and can seek, and a 10k-event log keeps the payload bounded.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Beschreibung

effort: medium enhancement help wanted priority: medium

Summary

The review player's timeline shows scene changes and markers, but not what happened: no clicks or keystrokes from the event log, and no captions. Finding "the moment after the Save click" means scrubbing frame by frame, even when the server already knows when every click happened.

Where

  • src/tools/reviewRecording.ts:51-53, 106 (player data carries markers only)
  • assets/ui/player.js:118-143 (renders scene ticks and markers only)
  • src/utils/events.ts, src/tools/readEvents.ts (event log on the video clock)
  • src/tools/transcribe.ts (SRT sidecar)

Suggested fix

  • Include a compact clicks list (t, button, x/y, and the UI element name from #333 when present) and captions (t, end, text) in the player_frames result when the sidecars exist. Cap the counts.
  • Draw click ticks as a second row under the timeline. Hovering or focusing one shows a crosshair on the frame at the click point.
  • Show the caption for the current frame under the stage, and make caption lines clickable to seek.
  • Both tracks can be toggled off.

Acceptance criteria

  • Recordings with an event log show click ticks that seek on activation
  • Recordings with an SRT show the current caption
  • Recordings without sidecars look the same as today
  • Payload stays bounded (test with a 10k-event log)

Getting started

  • Relevant files: src/tools/reviewRecording.ts, assets/ui/player.js, src/utils/events.ts

Filed by repo-audit/feature-ideas at 1ac339f. Severity: medium. Effort: M. audit-key: enhancement|src/tools/reviewRecording.ts|tracks

Vorherrschende Sprache
TypeScript
Sterne
1
Forks
4
Ø Merge
8 Std. 17 Min.
Gemergte PRs (30 T.)
46

Entwicklungsumgebung

Erste Schritte

  1. Lesen Sie das ganze Issue und danach den Beitragsleitfaden des Projekts.
  2. Schreiben Sie ins Issue, dass Sie es übernehmen — das erspart doppelte Arbeit.
  3. Forken Sie das Repository und arbeiten Sie in einem Branch.
  4. Öffnen Sie einen Pull Request, der die Issue-Nummer nennt.

Mehr aus TMHSDigital/screencast-mcp

Alle Issues in TMHSDigital/screencast-mcp

Ähnliche Issues

Weitere Issues zu TypeScript

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.