Hacktoberfest 2026：維護者為十月標記出來的 issue，仍然開放、適合新手。 瀏覽 Hacktoberfest issue

[bot] Instrument SGLang offline engine (574,007 weekly downloads)

已關閉
  • 哪裡不對？
#786 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視

維護者通常 1 天內回覆

還沒有人認領這個 Issue。

評估

難度
4/5
預估耗時
3-5 天
新手友好度
55/100
Issue 類型
功能
描述清晰度
基本清楚
活躍度
活躍
技術堆疊
python
領域
ai

研究方向

Start with py/src/braintrust/integrations/cohere/patchers.py and inspect py/src/braintrust/integrations/, py/src/braintrust/wrappers/, py/pyproject.toml, and py/noxfile.py for existing integration patterns. Read SGLang's Offline Engine API documentation first; done means the listed generate, async_generate, encode, and rerank paths, including streaming and VLM inputs, produce Braintrust spans with project registration and validation coverage.

由索引模型根據 Issue 內容生成。

描述

<!-- library-gap-audit: sglang-offline-engine -->

Summary

sglang is a high-performance LLM/multimodal serving framework with RadixAttention, continuous batching, and speculative decoding, positioned alongside vllm (already tracked as a separate open instrumentation gap in this repo) as one of the two dominant open-source inference engines. This repository has zero instrumentation for it.

  • Current version 0.5.20 (released 2026-09-18), under very active development
  • Not present in py/pyproject.toml [tool.braintrust.matrix], no noxfile.py session, no directory under py/src/braintrust/integrations/ or py/src/braintrust/wrappers/
  • Repo-wide grep for sglang under py/ returns zero matches

What is missing

SGLang's in-process Offline Engine API (sglang.Engine, docs: https://docs.sglang.io/docs/basic_usage/offline_engine_api) is the primary way Python applications call it directly (as opposed to going through its OpenAI-compatible HTTP server, which a user could separately point the already-instrumented openai client at). None of these produce a Braintrust span today:

  • Engine.generate() — synchronous text/chat generation, non-streaming and streaming variants
  • Engine.async_generate() — asyncio generation entrypoint, non-streaming and streaming variants; this is the method the framework's own example server-wrapping code (examples/runtime/engine/custom_server.py) uses to build custom serving layers
  • Engine.encode() — embedding execution (e.g. BERT-base/e5-mistral style models) for retrieval/similarity use cases
  • Engine.rerank() — query/document relevance scoring, analogous to the cohere.rerank span type this repo already instruments (py/src/braintrust/integrations/cohere/patchers.py)

This engine also supports vision-language model (VLM) inference via the same generate()/async_generate() surface with image inputs.

Weekly downloads

Weekly downloads: 574,007 (as of 2026-09-21; https://pypistats.org/api/packages/sglang/recent)

Braintrust docs status

not_found — checked https://www.braintrust.dev/docs/integrations/ai-providers and https://www.braintrust.dev/docs/guides/traces/integrations; neither mentions SGLang. (vllm, the closest analog, is also absent from both pages and is tracked separately.)

Upstream sources

Local repo files inspected

  • py/src/braintrust/integrations/ — no sglang/ directory
  • py/src/braintrust/wrappers/ — no SGLang wrapper
  • py/pyproject.toml [tool.braintrust.matrix] — no sglang entry
  • py/noxfile.py — no test_sglang session
  • Repo-wide case-insensitive grep for sglang under py/ — zero matches
主要語言
Python
星號
22
分支
27
平均合併
14 小時 49 分鐘
30 天內合併 PR
126

環境準備

  • 提供 Dockerfile 或 Docker Compose 檔案
  • 沒有 Pull Request 範本
  • 閱讀貢獻指南

從這裡開始

  1. 先讀完整個 Issue，再讀專案的貢獻指南。
  2. 在 Issue 下留言說明你要接手 —— 這能避免兩個人做同樣的事。
  3. Fork 儲存庫，在一個分支上完成修改。
  4. 送出 Pull Request，並在描述裡引用這個 Issue 編號。

braintrustdata/braintrust-sdk-python 的其他 Issue

查看 braintrustdata/braintrust-sdk-python 的全部 Issue

相似的 Issue

更多 Python Issue

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。