runpod-workers/worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

Python450 stars365 forksMIT

language-modelllmrunpodvllm

Rankings

Daily

#5698

Weekly

#9915

Monthly

#13654

Engagement

Total stars

Daily new stars

Get badge

Add a Trending Repos badge to your README

This repository is tracked by Trending Repos. The badge upgrades automatically the moment it cracks the top 100 — set it once and forget it.

Markdown — paste into your README

[![Trending Repos](https://trending-repos.com/badge/runpod-workers/worker-vllm.svg)](https://trending-repos.com/repositories/runpod-workers/worker-vllm)

HTML

<a href="https://trending-repos.com/repositories/runpod-workers/worker-vllm"><img src="https://trending-repos.com/badge/runpod-workers/worker-vllm.svg" alt="Trending Repos" /></a>

Raw image URL

https://trending-repos.com/badge/runpod-workers/worker-vllm.svg

Back to trending