vllm-project/vllm

[Feature]: Upstream DGX spark improvements from Avarok-Cybersecurity/dgx-vllm

开放

#37,141 创建于 2026年3月16日

 (13 条评论) (1 个反应) (0 位负责人)Python (16,816 个派生)batch import
feature requesthelp wantednvidiaquantization

仓库指标

星标
 (80,034 个星标)
PR 合并指标
 (平均合并 3天 17小时) (30 天内合并 993 个 PR)

描述

🚀 The feature, motivation and pitch

As shown in the readme in Avarok-Cybersecurity/dgx-vllm, there are gaps in vLLM fp4 performance for DGX. The fixes seem not too complicated, and we should try to upstream the changes from the repo into vLLM.

Avarok-Cybersecurity/dgx-vllm#7

Alternatives

No response

Additional context

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

贡献者指南