alibaba/MNN

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

C++15,222 stars2,315 forksApache-2.0

armconvolutiondeep-learningembedded-devicesllmmachine-learningmlmnntransformervulkanwinograd-algorithm

Rankings

Daily

#2015

Weekly

#1829

Monthly

#1635

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/alibaba/MNN.svg)

HTML

<img src="https://trending-repos.com/badge/alibaba/MNN.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/alibaba/MNN.svg