sgl-project/sglang

[Tracking] Improve Multimodal CI coverage

Open

#8,496 建立於 2025年7月29日

在 GitHub 查看
 (3 留言) (5 反應) (0 負責人)Python (6,216 fork)auto 404
Multi-modalcigood first issueperformance

倉庫指標

Star
 (28,442 star)
PR 合併指標
 (平均合併 2天 1小時) (30 天內合併 1,000 個 PR)

描述

Checklist

Motivation

  1. All existing Multi-modal CI operations are executed on a single GPU, without considering the scenario of Tensor Parallelism (TP). There is a requirement to introduce test cases for TP-2/4 configurations.
  2. The payload for VLM CI is relatively low. Stress tests are necessary, and simultaneously, it is crucial to investigate whether there are any memory leaks.
  3. At present, the majority of the VLM CI is only to vision. It is essential to expand its scope to audio.
  4. Welcome to add more.

Related resources

The test is under test/srt/test_vision_openai_server_x

Related PRs:

貢獻者指南