[bot] Mistral Batch API (`client.batch.jobs`) is not instrumented

未關閉
  • 哪裡不對？
#2,685 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視

維護者通常 1 天內回覆

還沒有人認領這個 Issue。

評估

難度
4/5
預估耗時
3-5 天
新手友好度
45/100
Issue 類型
功能
描述清晰度
基本清楚
活躍度
活躍
技術堆疊
javascript, typescript
領域
observability, tooling

研究方向

Start by reading js/src/instrumentation/plugins/mistral-interceptors.ts to see how existing Mistral channels are declared, then mistral-plugin.ts to see how they are subscribed. Compare js/src/wrappers/mistral.ts and js/src/vendor-sdk-types/mistral.ts to understand how the batch namespace is currently unwrapped and typed. Done means client.batch.jobs.create/get/list and result download produce spans consistent with the existing chat and embeddings instrumentation, with tests covering the batch lifecycle.

由索引模型根據 Issue 內容生成。

描述

typescript

Summary

Mistral's official TypeScript SDK exposes a documented Batch API (client.batch.jobs.create()/.get()/.list(), plus client.files.download() for results) for submitting large-scale async chat, embeddings, FIM, moderation, classification, OCR, and conversation jobs. This repo instruments every one of Mistral's synchronous execution surfaces but has zero coverage of the batch lifecycle — no channel, no plugin logic, no vendor type.

What's missing

  • js/src/instrumentation/plugins/mistral-plugin.ts — MistralPlugin.onEnable()/subscribeToMistralChannels() (lines 24-277) subscribes to exactly ten channels: chatComplete, chatStream, embeddingsCreate, classifiersModerate, classifiersModerateChat, classifiersClassify, classifiersClassifyChat, fimComplete, fimStream, agentsComplete, agentsStream. There is no batch-related channel anywhere in the file.
  • js/src/instrumentation/plugins/mistral-interceptors.ts — grepped for batch/Batch (case-insensitive): zero matches. No mistralChannels.batch* exists for the plugin to subscribe to in the first place.
  • js/src/vendor-sdk-types/mistral.ts — MistralClient (lines 222-229) is typed as { chat?, fim?, agents?, embeddings?, classifiers?, [key: string]: unknown }. There is no batch namespace type at all (no MistralBatch, MistralBatchJob, etc.), so even an untyped passthrough isn't modeled.
  • js/src/wrappers/mistral.ts — wrapMistral()/mistralProxy() (lines 85-108) proxies only chat, fim, agents, embeddings, classifiers. A client's batch property is returned as-is via the proxy's default branch (Reflect.get, line 104) — fully unwrapped, so client.batch.jobs.create(...) produces no span of any kind: no submission span, no status/polling span, no per-request result spans.

This means a customer submitting client.batch.jobs.create({ endpoint: "/v1/chat/completions", inputFiles: [...] }) — a fully supported, documented Mistral API call — gets no trace in Braintrust whatsoever, while the same customer's synchronous chat.complete/embeddings.create calls are fully traced with input, output, and token metrics.

Braintrust docs status

not_found. https://www.braintrust.dev/docs/providers/mistral documents only synchronous spans: "Chat completion spans (mistral.chat.complete...)", "Embedding spans (mistral.embeddings.create)", "Fill-in-the-middle completion spans", "Audio transcription spans." The page's "All call types support sync and async variants" line refers to Python's asyncio client variants, not batch jobs. No batch/async-job tracing is mentioned anywhere on the page.

Upstream sources

  • https://docs.mistral.ai/capabilities/batch/ — Batch API guide: client.batch.jobs.create() accepts input_files (file-based, up to 1,000,000 requests) or inline requests (up to 10,000); supports endpoint values /v1/embeddings, /v1/chat/completions, /v1/fim/completions, /v1/moderations, /v1/chat/moderations, /v1/ocr, /v1/classifications, /v1/conversations, /v1/audio/transcriptions; status via client.batch.jobs.get()/.list(); results retrieved via client.files.download().

Braintrust docs sources checked

Local repo files inspected

  • js/src/instrumentation/plugins/mistral-plugin.ts — subscribeToMistralChannels() (lines 24-277), full enumerated channel list
  • js/src/instrumentation/plugins/mistral-interceptors.ts — grepped for batch/Batch, zero matches
  • js/src/vendor-sdk-types/mistral.ts — MistralClient type (lines 222-229)
  • js/src/wrappers/mistral.ts — mistralProxy() (lines 85-108), proxy coverage limited to chat/fim/agents/embeddings/classifiers
主要語言
TypeScript
星號
29
分支
22
平均合併
1 天 15 小時
30 天內合併 PR
76

環境準備

  • 提供 Dockerfile 或 Docker Compose 檔案
  • 沒有 Pull Request 範本
  • 沒有貢獻指南

從這裡開始

  1. 先讀完整個 Issue，再讀專案的貢獻指南。
  2. 在 Issue 下留言說明你要接手 —— 這能避免兩個人做同樣的事。
  3. Fork 儲存庫，在一個分支上完成修改。
  4. 送出 Pull Request，並在描述裡引用這個 Issue 編號。

braintrustdata/braintrust-sdk-javascript 的其他 Issue

查看 braintrustdata/braintrust-sdk-javascript 的全部 Issue

相似的 Issue

更多 TypeScript Issue

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。