Hacktoberfest 2026: los issues que los mantenedores marcaron para octubre, abiertos y aptos para principiantes. Explorar issues de Hacktoberfest

Glasses: tap to capture a conversation, ask to recall it

Abierto
  • ¿Algo no está bien?
#171 0 comentarios 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
4/5
Tiempo estimado
3-5 días
Aptitud para principiantes
12/100
Tipo de issue
Nueva funcionalidad
Claridad
Bastante claro
Estado de actividad
Activo
Stack tecnológico
c, python
Área
ai, backend, embedded-iot

Línea de trabajo

Start with firmware/esp32s3-glasses/main/button.c and audio.c to see how the button and audio stream work today, then read docs/NODES.md and sentient/nodes/service.py for the device protocol. The transcription entry point is sentient/voice/stt.py, and summaries are stored through sentient/memory/. Done means a tap starts and stops a capture that produces a summary with action items on the desktop, and a later voice question is answered from that stored summary. Speaker diarization and the recall flow are design questions the issue leaves open.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

area: devices area: voice enhancement help wanted priority: P1 size: M

Plaud's tap-to-record model sells against always-on pendants, and Brilliant's Halo pitches long-term recall. Limitless's "capture worked but recall didn't" is the trap to avoid. Reviewers complained about gesture bands and rings, which favours one reliable button.

Idea: One physical button starts and stops an explicit capture session on the ESP32 glasses. The desktop transcribes it, with speaker labels from desktop-side diarization, and files a summary and action items. Later, "what did Priya and I agree last week?" is answered by voice. All heavy work runs on the desktop to save glasses battery. The glasses have no display, so captions belong on the phone.

Status in Sentient today: Partial. The glasses firmware has a button and audio streaming, and device nodes exist; there is no capture session or recall flow.

Where: firmware/esp32s3-glasses/main/button.c and audio.c, the device protocol in docs/NODES.md and sentient/nodes/service.py, transcription in sentient/voice/stt.py, and summaries stored through sentient/memory/.

Done when:

  • a tap starts and stops a capture and a summary with action items appears on the desktop
  • a later voice question about it is answered from the stored summary

Sources:

Roadmap ID: VOICE-4 · Priority: P1 · Size: M

Lenguaje dominante
Python
Estrellas
702
Forks
113
Merge medio
5 h 8 min
PR fusionados (30 d)
171

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de existence-master/Sentient

Todos los issues de existence-master/Sentient

Issues similares

Más issues de Python

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.