Search

Ongoing research training transformer models at scale

Training library for Megatron-based models with bidirectional Hugging Face conversion capability

Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.

AxisRL is an agentic RL post-training framework built on SGLang rollout, Megatron training, and real-world agent workflows.