kvcache-ai/Mooncake
PublicMooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Stars7k24h gain+5Score6.3
Search
Find trending repositories by name or description.
4 results for “kvcache”
RankRepositoryStars24h gainScore
kvcache-ai/AgentENV
PublicAgentENV (AENV) is a distributed platform for running agent environments at scale.
Stars3.7k24h gain+4Score2.6
alibaba/tair-kvcache
PublicAlibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.
Stars20024h gain-Score0.0
kvcache-ai/ktransformers
PublicA Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Stars19.7k24h gain0Score-0.1