vllm-project/vllm
[Feature]: Integrate RMS+fp4 fused kernel from FlashInfer
クローズ
#32,612 opened on 2026/01/19
feature requestgood first issuehelp wantedstaletorch.compile
Repository metrics
- Stars
- (80,034 個のスター)
- PR merge metrics
- (平均マージ 3d 17h) (30d で 993 merged PRs)
説明
🚀 The feature, motivation and pitch
Kernel: https://github.com/flashinfer-ai/flashinfer/blob/main/flashinfer/norm.py#L406-L409
This should be integrated in the existing rms + quant fusion pass using a similar approach as the silu+fp4 fusion in the act quant fusion pass.
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.