Back to trending
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Python12,347 stars811 forksApache-2.0
bentomlfine-tuningllamallama2llama3-1llama3-2llama3-2-visionllmllm-inferencellm-opsllm-servingllmopsmistralmlopsmodel-inferenceopen-source-llmopenllmvicuna
Rankings
Daily
#5727
0
Weekly
#10061
0
Monthly
#13857
0
Engagement
Total stars
Daily new stars
Get badge
Add a Trending Repos badge to your README
This repository is tracked by Trending Repos. The badge upgrades automatically the moment it cracks the top 100 — set it once and forget it.
Markdown — paste into your README
[](https://trending-repos.com/repositories/bentoml/OpenLLM)HTML
<a href="https://trending-repos.com/repositories/bentoml/OpenLLM"><img src="https://trending-repos.com/badge/bentoml/OpenLLM.svg" alt="Trending Repos" /></a>Raw image URL
https://trending-repos.com/badge/bentoml/OpenLLM.svg