vllm-project/llm-compressor

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Python3,268 stars519 forksApache-2.0

compressionquantization

Rankings

Daily

#810

Weekly

#930

Monthly

#1581

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/vllm-project/llm-compressor.svg)

HTML

<img src="https://trending-repos.com/badge/vllm-project/llm-compressor.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/vllm-project/llm-compressor.svg