Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

C++9,544 stars578 forksMIT

large-language-modelsllamallmllm-inferencelocal-inference

Rankings

PeriodRankScore

Daily

#282090.0

Weekly

#298270.0

Monthly

#304550.0

How scoring works

Engagement

Total stars

Daily new stars

Embeds

Best rank #1968

Format

Markdown

[![Tiiny-AI/PowerInfer badge](https://trending-repos.com/badge/Tiiny-AI/PowerInfer.svg?v=3)](https://trending-repos.com/repositories/Tiiny-AI/PowerInfer?utm_source=github&utm_medium=badge)

Back to trending