A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
NVIDIA/TransformerEngine has 3,602 GitHub stars. It gained +2 stars over 2 recorded days in the last 7 days and +1 over 3 recorded days in the last 30 days (snapshots through Nov 11, 2026).
Its biggest recent day was Nov 5, 2026, with +1 stars.
It currently ranks #3978 daily, #4170 weekly, #4453 monthly by momentum on Trending Repos; its best-ever rank is #234.
Trending Repos first recorded it on May 21, 2026.
| Date | Stars gained | Total stars | Forks gained |
|---|---|---|---|
| +1 | 3,602 | +1 | |
| +1 | 3,600 | +3 | |
| -1 | 3,597 | 0 |