vllm-project/speculators

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

PythonStars 155Forks 21Watchers 155Open issues 18License Apache License 2.0

Details

仓库信息

Ownervllm-project

Last pushed2025-12-11

Last updated2025-12-14

Issues fetched at—

Community at a glance