Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
(5,470 stars) (803 forks) (8 件の索引済み issue) (1 件のオープンな good first issue)
リポジトリ
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations