EricLBuehler/candle-vllm

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

RustStars 546Forks 62Watchers 546Open issues 43License MIT License

Details

仓库信息

OwnerEricLBuehler

Homepage—

Last pushed2025-12-08

Last updated2025-12-14

Issues fetched at—

Community at a glance