Hacktoberfest 2026: le issue che i maintainer hanno segnato per ottobre, aperte e adatte ai principianti. Sfoglia le issue Hacktoberfest

Glasses: tap to capture a conversation, ask to recall it

Aperta
  • Qualcosa non va?
#171 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
4/5
Tempo stimato
3-5 giorni
Idoneità per principianti
12/100
Tipo di issue
Funzionalità
Chiarezza
Abbastanza chiara
Stato di attività
Attiva
Stack tecnologico
c, python
Ambito
ai, backend, embedded-iot

Direzione di ricerca

Start with firmware/esp32s3-glasses/main/button.c and audio.c to see how the button and audio stream work today, then read docs/NODES.md and sentient/nodes/service.py for the device protocol. The transcription entry point is sentient/voice/stt.py, and summaries are stored through sentient/memory/. Done means a tap starts and stops a capture that produces a summary with action items on the desktop, and a later voice question is answered from that stored summary. Speaker diarization and the recall flow are design questions the issue leaves open.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

area: devices area: voice enhancement help wanted priority: P1 size: M

Plaud's tap-to-record model sells against always-on pendants, and Brilliant's Halo pitches long-term recall. Limitless's "capture worked but recall didn't" is the trap to avoid. Reviewers complained about gesture bands and rings, which favours one reliable button.

Idea: One physical button starts and stops an explicit capture session on the ESP32 glasses. The desktop transcribes it, with speaker labels from desktop-side diarization, and files a summary and action items. Later, "what did Priya and I agree last week?" is answered by voice. All heavy work runs on the desktop to save glasses battery. The glasses have no display, so captions belong on the phone.

Status in Sentient today: Partial. The glasses firmware has a button and audio streaming, and device nodes exist; there is no capture session or recall flow.

Where: firmware/esp32s3-glasses/main/button.c and audio.c, the device protocol in docs/NODES.md and sentient/nodes/service.py, transcription in sentient/voice/stt.py, and summaries stored through sentient/memory/.

Done when:

  • a tap starts and stops a capture and a summary with action items appears on the desktop
  • a later voice question about it is answered from the stored summary

Sources:

Roadmap ID: VOICE-4 · Priority: P1 · Size: M

Lingua principale
Python
Stelle
702
Fork
113
Merge medio
5h 8m
PR unite (30g)
171

Preparare l'ambiente

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di existence-master/Sentient

Tutte le issue di existence-master/Sentient

Issue simili

Altre issue su Python

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.