Hacktoberfest 2026: los issues que los mantenedores marcaron para octubre, abiertos y aptos para principiantes. Explorar issues de Hacktoberfest

[bot] Vercel AI SDK `experimental_generateSpeech` and `experimental_transcribe` not instrumented

Abierto
#1,900 1 comentario 0 reacciones 0 asignados Ver en GitHub

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
4/5
Tiempo estimado
3-5 días
Aptitud para principiantes
55/100
Tipo de issue
Nueva funcionalidad
Claridad
Bastante claro
Estado de actividad
Tranquilo
Stack tecnológico
typescript

Línea de trabajo

Comienza con las entradas existentes de AI SDK en js/src/auto-instrumentations/configs/ai-sdk.ts y las definiciones de canales en js/src/instrumentation/plugins/ai-sdk-channels.ts; después, sigue sus handlers en ai-sdk-plugin.ts y los tipos en ai-sdk-common.ts. Compara el wrapper en js/src/wrappers/ai-sdk/ai-sdk.ts y los escenarios e2e existentes. Se considera terminado cuando ambas funciones experimentales produzcan spans de Braintrust a través de las rutas del plugin y del wrapper, con cobertura para el nuevo comportamiento.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

stale

Summary

The Vercel AI SDK (ai package) exports experimental_generateSpeech (text-to-speech) and experimental_transcribe (speech-to-text) as core functions. Neither the wrapper (wrapAISDK) nor the auto-instrumentation plugin instruments them. Calls to these functions produce no Braintrust spans.

Every other AI SDK core execution function — generateText, streamText, generateObject, streamObject, embed, embedMany, rerank, and the Agent class methods — is fully instrumented, making these the only uninstrumented generative execution functions in the AI SDK plugin.

What instrumentation is missing

  • Auto-instrumentation config (js/src/auto-instrumentations/configs/ai-sdk.ts): No config entries for experimental_generateSpeech or experimental_transcribe. Configs exist for 13 other AI SDK functions.
  • Channels (js/src/instrumentation/plugins/ai-sdk-channels.ts): No channel definitions for speech generation or transcription. 14 channels are defined for other functions.
  • Plugin (js/src/instrumentation/plugins/ai-sdk-plugin.ts): No handler for speech or transcription calls.
  • Vendor types (js/src/vendor-sdk-types/ai-sdk-common.ts): AISDKNamespaceBase does not include experimental_generateSpeech or experimental_transcribe.

A grep for generateSpeech or transcribe across js/src/ returns zero matches.

Upstream reference

Both functions are documented core exports of the ai package (v6+):

Function Description Reference
experimental_generateSpeech Converts text to speech audio using a SpeechModelV3. Accepts model, text, voice, outputFormat, instructions, speed, language. Returns generated audio as base64/Uint8Array with media type. https://ai-sdk.dev/docs/reference/ai-sdk-core/generate-speech
experimental_transcribe Generates a text transcript from audio input using a TranscriptionModelV3. Accepts model, audio (string/Uint8Array/ArrayBuffer/URL). Returns transcript text, segments with timing, detected language, and duration. https://ai-sdk.dev/docs/reference/ai-sdk-core/transcribe

Both are imported from 'ai' (the same package instrumented by this repo) and are available in AI SDK v6, which is already instrumented for other functions (ToolLoopAgent.generate, ToolLoopAgent.stream).

Note: Both carry the experimental_ prefix, indicating the API surface may evolve. However, they are documented, functional, and available in the same SDK version that this repo already instruments for other v6-only features.

Braintrust docs status

not_found — The Braintrust AI SDK integration docs do not enumerate specific supported functions. generateSpeech and transcribe are not mentioned.

Precedent in this repo

  • AI SDK generateImage is tracked as a separate gap in #1626.
  • OpenAI audio APIs (audio.speech.create, audio.transcriptions.create) are tracked in #1629.
  • Mistral audio APIs are tracked in #1749.
  • Groq audio APIs are tracked in #1864.
  • The AI SDK plugin already instruments 13 other core functions across text generation, structured output, embeddings, reranking, and agent execution — speech/transcription is the remaining uninstrumented modality.

Local files inspected

  • js/src/auto-instrumentations/configs/ai-sdk.ts — no speech/transcribe configs
  • js/src/instrumentation/plugins/ai-sdk-channels.ts — no speech/transcribe channels
  • js/src/instrumentation/plugins/ai-sdk-plugin.ts — no speech/transcribe handlers
  • js/src/vendor-sdk-types/ai-sdk-common.ts — no speech/transcribe types
  • js/src/wrappers/ai-sdk/ai-sdk.ts — no speech/transcribe wrapping
  • e2e/scenarios/ai-sdk-instrumentation/ — no speech/transcribe test scenarios
Lenguaje dominante
TypeScript
Estrellas
27
Forks
13
Merge medio
2 d 23 h
PR fusionados (30 d)
67

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de braintrustdata/braintrust-sdk-javascript

Todos los issues de braintrustdata/braintrust-sdk-javascript

Issues similares

Más issues de TypeScript

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.