vllm-project/vllm

[Transformers v5] SarvamMLAForCausalLM

Closed

#38,734 opened on Apr 1, 2026

 (2 comments) (0 reactions) (1 assignee)Python (16,816 forks)batch import
good first issuehelp wanted

Repository metrics

Stars
 (80,034 stars)
PR merge metrics
 (Avg merge 3d 17h) (993 merged PRs in 30d)

Description

This is a sub-issue forming part of the work in https://github.com/vllm-project/vllm/issues/38379, please read the description of this issue before beginning to work on this one.

Which test is failing?

As of https://github.com/huggingface/transformers/pull/41250 the ignore_keys argument to validate_rope was removed in favour of ClassVars (ignore_keys_at_rope_validation) attached to the config classes themselves.

$ pytest tests/models/test_initialization.py::test_can_initialize_large_subset[SarvamMLAForCausalLM]
...
TypeError: RotaryEmbeddingConfigMixin.validate_rope() got an unexpected keyword argument 'ignore_keys'

How to configure my environment?

It's very important that you install both vLLM and Transformers from source so that your test results reflect the current state of both libraries.

# Or your fork
git clone https://github.com/huggingface/transformers.git
git clone https://github.com/vllm-project/vllm.git

cd vllm
VLLM_USE_PRECOMPILED=1 uv pip install -e .
uv pip install -e ../transformers

Contributor guide