thu-pacman/chitu

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

Python3,137 stars263 forksApache-2.0

deepseekgpullmllm-servingmodel-servingpytorch

Rankings

Daily

#5402

Weekly

#8350

Monthly

#8663

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/thu-pacman/chitu.svg)

HTML

<img src="https://trending-repos.com/badge/thu-pacman/chitu.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/thu-pacman/chitu.svg