[Feature Request] Add real-time streaming transcription as a selectable voice input mode

Aperta
  • Qualcosa non va?
#766 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
5/5
Tempo stimato
Più di una settimana
Idoneità per principianti
35/100
Tipo di issue
Funzionalità
Chiarezza
Abbastanza chiara
Stato di attività
Attiva
Stack tecnologico
android, kotlin
Ambito
mobile

Direzione di ricerca

Start by reading the Voice Plugin documentation mentioned in the issue and tracing the existing offline record-then-transcribe flow. Identify where voice input modes and recording controls are handled; the issue does not name specific files or tests. Done means users can select streaming or batch transcription, with silence timeout and manual controls supported in both modes.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

enhancement

Is your feature request related to a problem?
Currently, LeanType's offline voice input operates in a record-then-transcribe workflow. The user must finish recording and press the checkmark before any recognized text is inserted into the active text field.

There does not appear to be an option for real-time streaming transcription, despite the Voice Plugin documentation describing recognized text as streaming directly into the active input field.

Describe the solution you'd like
Provide an option to choose between two voice input modes:

  1. Streaming transcription: Recognized text is progressively inserted into the active text field while the user speaks, without requiring the recording to finish first.
  2. Batch transcription: Retain the existing workflow, where audio is recorded first and transcribed when recording ends.

Ideally, both modes would support the existing silence timeout and manual recording controls.

Use case
For everyday voice typing, particularly longer messages, emails, and notes, streaming transcription would allow users to see what has been recognized as they speak.

This provides immediate feedback, makes it easier to identify recognition errors, and avoids having to wait until the end of a recording to discover that portions of speech were missed.

Batch transcription would remain useful when users prefer to dictate an entire passage before reviewing the result.

Alternatives considered
The current batch transcription workflow works for shorter dictation, but requires recording to finish before the user can review any recognized text.

Dictating in shorter segments provides more frequent feedback, but interrupts the natural flow of speaking.

Other keyboards and voice input applications offer progressive transcription.

App version & Flavor

  • LeanType: v4.3.1, Offline
  • Voice Plugin: v1.0.1
  • Whisper Base (~57 MB)
Lingua principale
Kotlin
Stelle
1k
Fork
59
Merge medio
14h 9m
PR unite (30g)
56

Preparare l'ambiente

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di LeanBitLab/LeanType

Tutte le issue di LeanBitLab/LeanType

Issue simili

Altre issue su Kotlin

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.