vllm-project/vllm

[Bug]: Add tests for all parallel sampling parameter combinations

Open

#21,948 创建于 2025年7月30日

在 GitHub 查看
 (7 评论) (0 反应) (1 负责人)Python (16,816 fork)batch import
buggood first issuekeep-openstale

仓库指标

Star
 (80,034 star)
PR 合并指标
 (平均合并 3天 17小时) (30 天内合并 993 个 PR)

描述

Verify that we have tests that explicitly exercise parallel sampling (n>1 request sampling parameter) for all of the following combinations:

  • Via AsyncLLM.generate, via LLMEngine add_request() / step()
  • For output_kind equal to each of CUMULATIVE, DELTA, FINAL_ONLY

Ideally a test for each of AsyncLLM and LLMEngine in the appropriate files, with output_kind parameterized.

Additionally we can still test LLM.generate() but this enforces FINAL_ONLY. There is already a test for this one here, but I'm not sure about the other cases.

@sethkimmel3 has reported that the LLMEngine + CUMULATIVE combination is not working properly, this should be exposed and fixed if so.

贡献者指南