ArcticInference: vLLM plugin for high-throughput, low-latency inference
snowflakedb/ArcticInference has 481 GitHub stars.
It currently ranks #34204 daily, #34490 weekly, #35794 monthly by momentum on Trending Repos; its best-ever rank is #4893.