Captions: optional English translation line under the original (bilingual captions)

Abierto
#3,473 1 comentario 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
5/5
Tiempo estimado
Más de una semana
Aptitud para principiantes
35/100
Tipo de issue
Nueva funcionalidad
Claridad
Necesita aclaración
Estado de actividad
Activo
Stack tecnológico
react, rust, typescript

Línea de trabajo

Read the existing caption transcription flow and the editor and export paths to determine where a second translated line could be supported; the issue does not name specific files or tests. First check how Whisper transcription is invoked and how caption segments are matched by time. Done means agreeing on the open product questions, then implementing and verifying bilingual captions in the editor and exports.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

laoer536 asked for this on #2855: captions with the spoken language on the first line and an English translation on the second, e.g.

你好,我的名字是刘杰
Hello, my name is Liu Jie

It's useful for demos and tutorials aimed at international viewers.

Whisper can already do the translation part: it has a built-in "translate" mode that turns speech in any language it supports into English text, and Cap already ships Whisper Small and Medium. So a first version could be:

  1. Transcribe as today (original language).
  2. Run Whisper again in translate mode on the same audio.
  3. Match each English segment to the original caption by time and show it as a second line.

Questions before I build it:

  • Is a second caption line something you'd want in the editor and exports, or should the translation replace the original instead?
  • English-only translation (what Whisper supports) OK for a first version?
  • Any preference on where the toggle lives (Captions tab, next to the language picker)?

Happy to open a PR if this sounds good.

Lenguaje dominante
Rust
Estrellas
25k
Forks
2.4k
Merge medio
1 d 8 h
PR fusionados (30 d)
676

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de CapSoftware/Cap

Todos los issues de CapSoftware/Cap

Issues similares

Más issues de Rust

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.