flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

Python5,619 stars976 forksApache-2.0

attentioncudadistributed-inferencegpujitlarge-large-modelsllm-inferencemoenvidiapytorch

Rankings

Daily

#7908

Weekly

#4860

Monthly

#5069

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/flashinfer-ai/flashinfer.svg)

HTML

<img src="https://trending-repos.com/badge/flashinfer-ai/flashinfer.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/flashinfer-ai/flashinfer.svg