01localai-org/vllm.cppC++#3502 overalla community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)7 daysStars48224h gain+2Score0.9