gemma speach model use
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 30/100
Research direction
Start by reading the linked flutter_gemma_speech package documentation and the project's existing local-model integration points. Clarify which platforms and speech models this issue should cover before implementing the text-to-speech and speech-to-speech support. Done means the agreed speech flows work on the selected platforms and are verified with tests or a manual run.
Written by the indexing model from the issue text.
Description
here we will try to support the text to speach and speach to speach speaking also for the local models
🖼️ Multimodal Support: Text + Image input with Gemma 4, Gemma3n, FastVLM, Qwen2-VL, SmolVLM2, and LLaVA-OneVision vision models (Gemma 4 / Gemma3n on all platforms incl. Web; Qwen2-VL / SmolVLM2 / LLaVA-OneVision on Android, iOS, and Desktop; FastVLM on Desktop)
🎙️ Audio Input: Record and send audio messages with Gemma 4 and Gemma3n E2B/E4B models (Android, iOS device, macOS/Windows/Linux via LiteRT-LM — not on Web)
🎤 On-device Speech-to-Text: Opt-in flutter_gemma_speech — transcribe audio fully offline with a selectable ASR model (moonshine, Whisper, Parakeet) via the LiteRT C API (Android, iOS, macOS, Windows, Linux; Web is a follow-on)
🔊 On-device Text-to-Speech: Opt-in flutter_gemma_speech — synthesize speech fully offline with a selectable model (Matcha, Qwen3-TTS, Inflect-Nano-v2; kokoro / supertonic are follow-ons) via the LiteRT C API (Android, iOS, macOS, Windows, Linux; Web is a follow-on)
🗣️ On-device Voice Loop: VoiceSession in flutter_gemma_speech chains STT → LLM → TTS into one push-to-talk turn with barge-in — the full on-device speech-to-speech pipeline. VoiceSession.fromChat(recognizer:, chat:, synthesizer:) streams VoiceEvents from recorded PCM (native only).
- Dominant language
- Dart
- Stars
- 2
- Forks
- 2
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 35
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from basictech01/uniun
-
bug good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
basictech01/uniun#300 ·
Maintainers usually reply within 1 day
-
enhancement good first issue P2-Medium
Difficulty 5/5 Over a week Newbie friendliness 25/100
basictech01/uniun#296 ·
Maintainers usually reply within 1 day
-
bug good first issue P2-Medium
Difficulty 4/5 1-2 days Newbie friendliness 22/100
basictech01/uniun#293 ·
Maintainers usually reply within 1 day
-
bug P1-High
Difficulty 4/5 3-5 days Newbie friendliness 18/100
basictech01/uniun#286 · 2 comments ·
Maintainers usually reply within 1 day
-
P3-Low
Difficulty 4/5 1-2 days Newbie friendliness 30/100
basictech01/uniun#282 · 1 comment ·
Maintainers usually reply within 1 day
All issues in basictech01/uniun
Similar issues
-
bug
Difficulty 1/5 Under an hour Newbie friendliness 65/100
chriskelly/wish-together#36 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
AppFlowy-IO/AppFlowy#9075 ·
-
Paste asks for iOS paste permission because the default context menu ignores SystemContextMenuPossibly taken @dorklein claimed this today. Open
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
maheshj01/searchfield#267 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 67/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
avdept/JellyBoxPlayer#375 ·
Maintainers usually reply within 1 day