InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Python7,858 stars697 forksApache-2.0

codellamacuda-kernelsdeepspeedfastertransformerinternlmllamallama2llama3llmllm-inferenceturbomind

Rankings

Daily

#7797

Weekly

#2962

Monthly

#4694

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/InternLM/lmdeploy.svg)

HTML

<img src="https://trending-repos.com/badge/InternLM/lmdeploy.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/InternLM/lmdeploy.svg