Hacktoberfest 2026: as issues que os mantenedores marcaram para outubro, abertas e boas para iniciantes. Ver issues do Hacktoberfest

[bot] Google GenAI Live API not instrumented — zero visibility for real-time multimodal sessions

Aberta
  • Algo errado?
#1,732 1 comentário 0 reações 0 responsáveis Ver no GitHub

Mantenedores costumam responder em até 1 dia

Ninguém assumiu esta issue ainda.

Avaliação

Dificuldade
5/5
Tempo estimado
Mais de uma semana
Facilidade para iniciantes
45/100
Tipo de issue
Funcionalidade
Clareza
Razoavelmente clara
Status de atividade
Pouca atividade
Stack de tecnologia
typescript
Domínio
ai, observability

Direção de pesquisa

Comece lendo js/src/wrappers/google-genai.ts, js/src/auto-instrumentations/configs/google-genai.ts, js/src/instrumentation/plugins/google-genai-channels.ts e js/src/instrumentation/plugins/google-genai-plugin.ts para comparar a instrumentação existente dos modelos. Em seguida, inspecione js/src/vendor-sdk-types/google-genai.ts e o diretório e2e/scenarios/google-genai-instrumentation/. O trabalho estará concluído quando as superfícies da Live API tiverem cobertura de instrumentação e cenários de ponta a ponta para atividade de sessão, respostas, metadados de uso e chamadas de ferramentas.

Escrita pelo modelo de indexação a partir do texto da issue.

Descrição

never-stale

Summary

The @google/genai SDK provides a GA Live API (client.live.connect()) for low-latency, real-time bidirectional audio, video, and text interaction with Gemini models. This repo has zero instrumentation for any Live API surface — no channels, no plugin handlers, no wrapper proxies, and no auto-instrumentation configs. Users building real-time voice or multimodal AI applications with the Google GenAI Live API get no Braintrust spans.

What instrumentation is missing

No coverage in any layer:

  • Wrapper (js/src/wrappers/google-genai.ts): Only intercepts instance.models (line 74–76). No proxy for the live resource.
  • Auto-instrumentation config (js/src/auto-instrumentations/configs/google-genai.ts): Only defines configs for generateContentInternal and generateContentStreamInternal. No config for Live API methods.
  • Channels (js/src/instrumentation/plugins/google-genai-channels.ts): Only two channels defined (generateContent, generateContentStream). No Live API channels.
  • Plugin (js/src/instrumentation/plugins/google-genai-plugin.ts): No handler for Live API calls.
  • Vendor types (js/src/vendor-sdk-types/google-genai.ts): GoogleGenAIClient only declares models property. No live property.

A grep for live.connect, sendRealtimeInput, and sendClientContent across js/src/ returns zero matches.

Key upstream API surfaces with no Braintrust tracing:

SDK Method Description
client.live.connect({ model, config }) Creates a WebSocket session for real-time interaction. Config includes system instructions, tools, voice, response modalities, and speech config.
session.sendClientContent() Sends text content in the session.
session.sendRealtimeInput() Sends real-time audio/video data.
session.sendToolResponse() Sends tool call results back to the model.

The Live API session emits server events including model responses with usage metadata and tool call requests. These contain the same kind of data (content, token counts, tool calls) that is already captured for models.generateContent() in this repo.

Braintrust docs status

not_found — The Braintrust Gemini integration page at https://www.braintrust.dev/docs/integrations/ai-providers/gemini documents generateContent and generateContentStream as supported methods. The Live API is not mentioned.

Upstream reference

  • Google GenAI Live API docs: https://ai.google.dev/gemini-api/docs/live
  • SDK method: client.live.connect({ model, config }) — returns a WebSocket session
  • Capabilities: real-time audio/video/text interaction, tool calling, 70+ language support, interruption handling
  • Session config: systemInstruction, tools, responseModalities, speechConfig, realtimeInputConfig
  • This is a production API documented on the official Google AI for Developers site.
  • The @google/genai SDK (latest v1.48.0+) provides full TypeScript support for the Live API.

Precedent

  • This is the Google equivalent of the OpenAI Realtime API gap.
  • Both represent a new category of AI API (WebSocket-based real-time sessions) that the current instrumentation architecture does not cover.

Local files inspected

  • js/src/wrappers/google-genai.ts — only wraps models property
  • js/src/auto-instrumentations/configs/google-genai.ts — no Live configs
  • js/src/instrumentation/plugins/google-genai-channels.ts — no Live channels
  • js/src/instrumentation/plugins/google-genai-plugin.ts — no Live handlers
  • js/src/vendor-sdk-types/google-genai.ts — no live property on client type
  • e2e/scenarios/google-genai-instrumentation/ — no Live test scenarios
Linguagem predominante
TypeScript
Estrelas
29
Forks
16
Merge médio
1d 22h
PRs com merge (30d)
72

Preparar o ambiente

  • Inclui um Dockerfile ou arquivo Docker Compose
  • Sem modelo de pull request
  • Sem guia de contribuição

Primeiros passos

  1. Leia a issue inteira e depois o guia de contribuição do projeto.
  2. Comente na issue dizendo que vai assumir — evita que duas pessoas façam o mesmo trabalho.
  3. Faça um fork do repositório e trabalhe em uma branch.
  4. Abra um pull request que referencie o número da issue.

Mais de braintrustdata/braintrust-sdk-javascript

Todas as issues de braintrustdata/braintrust-sdk-javascript

Issues semelhantes

Mais issues de TypeScript

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.