Distributed KV cache scheduling & offloading libraries
llm-d/llm-d-kv-cache has 184 GitHub stars.
It currently ranks #34620 daily, #34897 weekly, #36173 monthly by momentum on Trending Repos; its best-ever rank is #10779.
Trending Repos first recorded it on Oct 3, 2026.