InternLM/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Python8,045 stars737 forksApache-2.0

codellamacuda-kernelsdeepspeedfastertransformerinternlmllamallama2llama3llmllm-inferenceturbomind

Rankings

PeriodRankScore

Daily

#267630.0

Weekly

#289740.0

Monthly

#293010.0

How scoring works

Engagement

Total stars

Daily new stars

Embeds

Best rank #623

Format

Markdown

[![InternLM/lmdeploy badge](https://trending-repos.com/badge/InternLM/lmdeploy.svg?v=3)](https://trending-repos.com/repositories/InternLM/lmdeploy?utm_source=github&utm_medium=badge)

Back to trending