vllm-project/vllm
[Feature]: Use kernel abstraction for fp4 scaled mm
オープン
#31,823 opened on 2026/01/06
feature requesthelp wantedunstale
Repository metrics
- Stars
- (80,034 個のスター)
- PR merge metrics
- (平均マージ 3d 17h) (30d で 993 merged PRs)
説明
🚀 The feature, motivation and pitch
See MPLinearKernel and ScaledMMLinearKernel.
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.