sgl-project/sglang

[Tracking] Improve Multimodal CI coverage

Open

#8,496 创建于 2025年7月29日

在 GitHub 查看
 (3 评论) (5 反应) (0 负责人)Python (6,216 fork)auto 404
Multi-modalcigood first issueperformance

仓库指标

Star
 (28,442 star)
PR 合并指标
 (平均合并 2天 1小时) (30 天内合并 1,000 个 PR)

描述

Checklist

Motivation

  1. All existing Multi-modal CI operations are executed on a single GPU, without considering the scenario of Tensor Parallelism (TP). There is a requirement to introduce test cases for TP-2/4 configurations.
  2. The payload for VLM CI is relatively low. Stress tests are necessary, and simultaneously, it is crucial to investigate whether there are any memory leaks.
  3. At present, the majority of the VLM CI is only to vision. It is essential to expand its scope to audio.
  4. Welcome to add more.

Related resources

The test is under test/srt/test_vision_openai_server_x

Related PRs:

贡献者指南