A hands-on course for building modern LLMs from scratch in PyTorch, with 26 runnable Jupyter Notebooks covering tokenizers, attention, MoE, RLHF, inference, evaluation, and distillation.
walkinglabs/modern-llm-notebook has 194 GitHub stars.
It currently ranks #43281 daily, #43321 weekly, #43992 monthly by momentum on Trending Repos; its best-ever rank is #3042.