[bot] Google GenAI: Chat session API (`chats.create`, `send_message`) not instrumented in Python (documented as traced in JS)
Personne n'a encore pris cette issue.
Évaluation
- Difficulté
- 3/5
- Temps estimé
- 1-2 jours
- Accessibilité débutants
- 65/100
- Type d'issue
- Fonctionnalité
- Clarté
- Clairement spécifiée
- Activité
- Active
- Stack technique
- python
- Domaine
- devtools, observability
Piste de recherche
The issue is to add instrumentation for the Chat session API in the Google GenAI Python SDK. Start by examining the existing patchers in py/src/braintrust/integrations/google_genai/patchers.py and integration.py. Look at the upstream google/genai/chats.py to understand the Chat/AsyncChat classes and their send_message methods. The goal is to create a new patcher that captures session-level spans for chat lifecycle and history, similar to the JS/TS implementation. Test by running the existing integration tests and verifying that chat spans appear in traces.
Rédigé par le modèle d'indexation à partir du texte de l'issue.
Description
Summary
The google-genai Python SDK's Chat session API (client.chats.create(model=...) returning a Chat/AsyncChat with send_message()/send_message_stream()) has no dedicated instrumentation in this repo's Python integration. Braintrust's own docs confirm this capability is already designed and shipped for the legacy JS/TS SDK ("Chat spans (send_message, send_message_stream): message input and model as metadata") — it is simply missing from the Python integration.
What is missing
py/src/braintrust/integrations/google_genai/patchers.py and integration.py register patchers only for Models/AsyncModels (generate_content, generate_content_stream, embed_content, generate_images) and Interactions/GAOSInteractions (create/get/cancel/delete, sync and async). There is no patcher targeting google.genai.chats.Chats/AsyncChats/Chat/AsyncChat anywhere in the file, and no reference to chat, Chat, or send_message in tracing.py or patchers.py.
Verified against the pinned upstream version (google-genai==2.24.0, per py/uv.lock): Chat.send_message() does internally delegate to self._modules.generate_content(...) — i.e. it reuses the already-patched Models.generate_content path, so a generate_content span is still produced per turn. However, Chat/AsyncChat (subclass _BaseChat) separately maintains cross-turn conversation state — self._curated_history and self._comprehensive_history, updated via record_history() after every turn — that is invisible to any single generate_content span. There is no session-level span capturing the chat object's lifecycle, turn count, or curated-vs-comprehensive history divergence (e.g. when a turn is marked invalid and excluded from curated history sent to the model on subsequent turns).
Braintrust docs status: supported (JS/TS) / not_found (Python)
The Gemini integration page, Python section, documents only: content generation spans (generate_content/generate_content_stream), embedding spans (embed_content), image generation spans (generate_images), and interaction spans (interactions.create/get/cancel/delete). It contains zero mentions of chat, chats, send_message, or ChatSession in the Python section.
The same page's legacy-SDK section (for @google/generative-ai, JS/TS) explicitly documents: "Chat spans (send_message, send_message_stream): message input and model as metadata." This confirms Braintrust considers chat-session tracing a real, intended capability — it has just not been ported to the Python google-genai integration.
Upstream sources
google-genaiPython SDK,google/genai/chats.py(tagv2.24.0), classesChat/AsyncChat/_BaseChat, factoriesChats.create()/AsyncChats.create(): https://github.com/googleapis/python-genai/blob/v2.24.0/google/genai/chats.py- Google GenAI Chat documentation: https://ai.google.dev/gemini-api/docs/text-generation#chat
Local repo files inspected
py/src/braintrust/integrations/google_genai/integration.py(full file — patcher list)py/src/braintrust/integrations/google_genai/patchers.py(full file — noChat/chatspatcher)py/src/braintrust/integrations/google_genai/tracing.py(grepped for all top-levelclass/defnames andchat— no matches)py/uv.lock(confirms pinnedgoogle-genai==2.24.0)
- Langage dominant
- Python
- Étoiles
- 19
- Forks
- 17
- Merge moyen
- 1 j 5 h
- PR mergées (30 j)
- 61
Guide de contribution
Ouvrir le guide de contribution
Par où commencer
- Lisez l'issue en entier, puis le guide de contribution du projet.
- Signalez en commentaire que vous la prenez — cela évite que deux personnes fassent le même travail.
- Forkez le dépôt et travaillez sur une branche.
- Ouvrez une pull request qui référence le numéro de l'issue.
Autres issues de braintrustdata/braintrust-sdk-python
-
Difficulté 2/5 1-3 heures Accessibilité débutants 75/100
-
Difficulté 2/5 1-3 heures Accessibilité débutants 86/100
-
Difficulté 4/5 3-5 jours Accessibilité débutants 45/100
-
Difficulté 4/5 3-5 jours Accessibilité débutants 48/100
-
Difficulté 4/5 3-5 jours Accessibilité débutants 55/100
Toutes les issues de braintrustdata/braintrust-sdk-python
Issues similaires
-
Difficulté 2/5 1-3 heures Accessibilité débutants 78/100
-
Difficulté 2/5 1-3 heures Accessibilité débutants 86/100
browser-use/browser-use#5905 ·
-
type: enhancement
Difficulté 2/5 1-3 heures Accessibilité débutants 68/100
ynput/ayon-python-api#363 ·
-
bug needs triage
Difficulté 2/5 1-3 heures Accessibilité débutants 88/100
modelscope/FunASR#3728 ·
-
Difficulté 2/5 1-3 heures Accessibilité débutants 88/100
open-compass/opencompass#2655 ·