vllm-project/vllm

[Transformers v5] SarvamMLAForCausalLM

Geschlossen

#38.734 geöffnet am 01.04.2026

 (2 Kommentare) (0 Reaktionen) (1 zugewiesene Person)Python (16.816 Forks)batch import
good first issuehelp wanted

Repository-Metriken

Stars
 (80.034 Sterne)
PR-Merge-Metriken
 (PR-Metriken ausstehend)

Beschreibung

This is a sub-issue forming part of the work in https://github.com/vllm-project/vllm/issues/38379, please read the description of this issue before beginning to work on this one.

Which test is failing?

As of https://github.com/huggingface/transformers/pull/41250 the ignore_keys argument to validate_rope was removed in favour of ClassVars (ignore_keys_at_rope_validation) attached to the config classes themselves.

$ pytest tests/models/test_initialization.py::test_can_initialize_large_subset[SarvamMLAForCausalLM]
...
TypeError: RotaryEmbeddingConfigMixin.validate_rope() got an unexpected keyword argument 'ignore_keys'

How to configure my environment?

It's very important that you install both vLLM and Transformers from source so that your test results reflect the current state of both libraries.

# Or your fork
git clone https://github.com/huggingface/transformers.git
git clone https://github.com/vllm-project/vllm.git

cd vllm
VLLM_USE_PRECOMPILED=1 uv pip install -e .
uv pip install -e ../transformers

Contributor Guide