yanring/Megatron-MoE-ModelZoo

Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.

Python192 stars32 forksMIT

llm-trainingmegatron-lmmixture-of-experts

Rankings

Daily

#12792

Weekly

#5506

Monthly

#5498

Total stars

Daily new stars

Get badge

This repository is tracked by Trending Repos. The badge upgrades automatically if it ever cracks the top 100.

Markdown

![Trending Repos](https://trending-repos.com/badge/yanring/Megatron-MoE-ModelZoo.svg)

HTML

<img src="https://trending-repos.com/badge/yanring/Megatron-MoE-ModelZoo.svg" alt="Trending Repos" />

Raw URL

https://trending-repos.com/badge/yanring/Megatron-MoE-ModelZoo.svg