[Feature Request] Add real-time streaming transcription as a selectable voice input mode

Offen
#766 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen

Maintainer antworten meist innerhalb von 1 Tag

Dieses Issue hat noch niemand übernommen.

Bewertung

Schwierigkeit
5/5
Geschätzter Aufwand
Über eine Woche
Anfängerfreundlichkeit
35/100
Issue-Typ
Feature
Klarheit
Größtenteils klar
Aktivitätsstatus
Aktiv
Tech-Stack
android, kotlin
Bereich
mobile

Rechercherichtung

Start by reading the Voice Plugin documentation mentioned in the issue and tracing the existing offline record-then-transcribe flow. Identify where voice input modes and recording controls are handled; the issue does not name specific files or tests. Done means users can select streaming or batch transcription, with silence timeout and manual controls supported in both modes.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Beschreibung

enhancement

Is your feature request related to a problem?
Currently, LeanType's offline voice input operates in a record-then-transcribe workflow. The user must finish recording and press the checkmark before any recognized text is inserted into the active text field.

There does not appear to be an option for real-time streaming transcription, despite the Voice Plugin documentation describing recognized text as streaming directly into the active input field.

Describe the solution you'd like
Provide an option to choose between two voice input modes:

  1. Streaming transcription: Recognized text is progressively inserted into the active text field while the user speaks, without requiring the recording to finish first.
  2. Batch transcription: Retain the existing workflow, where audio is recorded first and transcribed when recording ends.

Ideally, both modes would support the existing silence timeout and manual recording controls.

Use case
For everyday voice typing, particularly longer messages, emails, and notes, streaming transcription would allow users to see what has been recognized as they speak.

This provides immediate feedback, makes it easier to identify recognition errors, and avoids having to wait until the end of a recording to discover that portions of speech were missed.

Batch transcription would remain useful when users prefer to dictate an entire passage before reviewing the result.

Alternatives considered
The current batch transcription workflow works for shorter dictation, but requires recording to finish before the user can review any recognized text.

Dictating in shorter segments provides more frequent feedback, but interrupts the natural flow of speaking.

Other keyboards and voice input applications offer progressive transcription.

App version & Flavor

  • LeanType: v4.3.1, Offline
  • Voice Plugin: v1.0.1
  • Whisper Base (~57 MB)
Vorherrschende Sprache
Kotlin
Sterne
1k
Forks
59
Ø Merge
14 Std. 9 Min.
Gemergte PRs (30 T.)
56

Entwicklungsumgebung

Erste Schritte

  1. Lesen Sie das ganze Issue und danach den Beitragsleitfaden des Projekts.
  2. Schreiben Sie ins Issue, dass Sie es übernehmen — das erspart doppelte Arbeit.
  3. Forken Sie das Repository und arbeiten Sie in einem Branch.
  4. Öffnen Sie einen Pull Request, der die Issue-Nummer nennt.

Mehr aus LeanBitLab/LeanType

Alle Issues in LeanBitLab/LeanType

Ähnliche Issues

Weitere Issues zu Kotlin

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.