vllm-project/vllm

[Transformers v5] SarvamMLAForCausalLM

已关闭

#38,734 创建于 2026年4月1日

 (2 条评论) (0 个反应) (1 位负责人)Python (16,816 个派生)batch import
good first issuehelp wanted

仓库指标

星标
 (80,034 个星标)
PR 合并指标
 (平均合并 3天 17小时) (30 天内合并 993 个 PR)

描述

This is a sub-issue forming part of the work in https://github.com/vllm-project/vllm/issues/38379, please read the description of this issue before beginning to work on this one.

Which test is failing?

As of https://github.com/huggingface/transformers/pull/41250 the ignore_keys argument to validate_rope was removed in favour of ClassVars (ignore_keys_at_rope_validation) attached to the config classes themselves.

$ pytest tests/models/test_initialization.py::test_can_initialize_large_subset[SarvamMLAForCausalLM]
...
TypeError: RotaryEmbeddingConfigMixin.validate_rope() got an unexpected keyword argument 'ignore_keys'

How to configure my environment?

It's very important that you install both vLLM and Transformers from source so that your test results reflect the current state of both libraries.

# Or your fork
git clone https://github.com/huggingface/transformers.git
git clone https://github.com/vllm-project/vllm.git

cd vllm
VLLM_USE_PRECOMPILED=1 uv pip install -e .
uv pip install -e ../transformers

贡献者指南