kvcache-ai/ktransformersPython
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
(17 254 stars) (1 311 forks) (2 issues indexées) (2 good first issues ouvertes)
Dépôts
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.