kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

C++6,717 stars1,290 forksApache-2.0

disaggregationinferencekvcachellmrdmareinforcement-learningsglangtokenspeedtrt-llmvllm

Rankings

PeriodRankScore

Daily

#22703.5

Weekly

#51294.1

Monthly

#557910.3

How scoring works

Engagement

Total stars

Daily new stars

Embeds

Best rank #16

Format

Markdown

[![kvcache-ai/Mooncake badge](https://trending-repos.com/badge/kvcache-ai/Mooncake.svg?v=3)](https://trending-repos.com/repositories/kvcache-ai/Mooncake?utm_source=github&utm_medium=badge)

Back to trending