SandAI-org/MagiAttention

A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training

Python820 stars52 forksApache-2.0

Rankings

Daily

#2167

Weekly

#3858

Monthly

#3698

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/SandAI-org/MagiAttention.svg)

HTML

<img src="https://trending-repos.com/badge/SandAI-org/MagiAttention.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/SandAI-org/MagiAttention.svg