01yanring/Megatron-MoE-ModelZooPython#34235 overallBest practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.7 daysStars19224h gain-Score0.0
