Fast and memory-efficient exact attention
7 daysStars25.3k24h gain+7Score2.9
Find trending repositories by name or description.
Fast and memory-efficient exact attention
An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.
Pre-compiled Python whl for Flash-attention, SageAttention, NATTEN, xFormer etc