vllm-project/vllm

[Transformers v5] SarvamMLAForCausalLM

クローズ

#38,734 opened on 2026/04/01

 (2 件のコメント) (0 件のリアクション) (1 人の担当者)Python (16,816 件のフォーク)batch import
good first issuehelp wanted

Repository metrics

Stars
 (80,034 個のスター)
PR merge metrics
 (平均マージ 3d 17h) (30d で 993 merged PRs)

説明

This is a sub-issue forming part of the work in https://github.com/vllm-project/vllm/issues/38379, please read the description of this issue before beginning to work on this one.

Which test is failing?

As of https://github.com/huggingface/transformers/pull/41250 the ignore_keys argument to validate_rope was removed in favour of ClassVars (ignore_keys_at_rope_validation) attached to the config classes themselves.

$ pytest tests/models/test_initialization.py::test_can_initialize_large_subset[SarvamMLAForCausalLM]
...
TypeError: RotaryEmbeddingConfigMixin.validate_rope() got an unexpected keyword argument 'ignore_keys'

How to configure my environment?

It's very important that you install both vLLM and Transformers from source so that your test results reflect the current state of both libraries.

# Or your fork
git clone https://github.com/huggingface/transformers.git
git clone https://github.com/vllm-project/vllm.git

cd vllm
VLLM_USE_PRECOMPILED=1 uv pip install -e .
uv pip install -e ../transformers

コントリビューターガイド