turboderp-org/exllamav3

An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

Python895 stars100 forksMIT

Rankings

Daily

#5357

Weekly

#8581

Monthly

#9428

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/turboderp-org/exllamav3.svg)

HTML

<img src="https://trending-repos.com/badge/turboderp-org/exllamav3.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/turboderp-org/exllamav3.svg