vllm-project/vllm

[Transformers v5] SarvamMLAForCausalLM

Open

#38734 opened on Apr 1, 2026

View on GitHub
 (2 comments) (0 reactions) (1 assignee)Python (80,034 stars) (16,816 forks)batch import
good first issuehelp wanted

Description

This is a sub-issue forming part of the work in https://github.com/vllm-project/vllm/issues/38379, please read the description of this issue before beginning to work on this one.

Which test is failing?

As of https://github.com/huggingface/transformers/pull/41250 the ignore_keys argument to validate_rope was removed in favour of ClassVars (ignore_keys_at_rope_validation) attached to the config classes themselves.

$ pytest tests/models/test_initialization.py::test_can_initialize_large_subset[SarvamMLAForCausalLM]
...
TypeError: RotaryEmbeddingConfigMixin.validate_rope() got an unexpected keyword argument 'ignore_keys'

How to configure my environment?

It's very important that you install both vLLM and Transformers from source so that your test results reflect the current state of both libraries.

# Or your fork
git clone https://github.com/huggingface/transformers.git
git clone https://github.com/vllm-project/vllm.git

cd vllm
VLLM_USE_PRECOMPILED=1 uv pip install -e .
uv pip install -e ../transformers

Contributor guide

Tech stack
python
Domain
backendmachine learningtesting
Issue type
bug
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
Basic knowledge of PythonFamiliarity with vLLM and TransformersUnderstanding of validate rope method
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
65
Research direction
First, read the linked issue #38379 for context. Then examine the PR #41250 that removed the `ignore keys` argument from `validate rope`. Update the test `test can initialize large subset` for SarvamMLAForCausalLM to work with the new signature. Ensure that the `ignore keys at rope validation` ClassVar is properly set in the config class for SarvamMLA. Run the test using the instructions provided.