EricLBuehler/candle-vllm

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

Rust655 stars80 forksMIT

Rankings

Daily

#8489

Weekly

#13479

Monthly

#9313

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/EricLBuehler/candle-vllm.svg)

HTML

<img src="https://trending-repos.com/badge/EricLBuehler/candle-vllm.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/EricLBuehler/candle-vllm.svg