rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Jupyter Notebook106,002 stars16,305 forks

aiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpythonpytorchtokenizertransformers

Rankings

PeriodRankScore

Daily

#56234.4

Weekly

#630180.5

Monthly

#178881.8

How scoring works

Engagement

Total stars

Daily new stars

Embeds

Best rank #6

Format

Markdown

[![rasbt/LLMs-from-scratch badge](https://trending-repos.com/badge/rasbt/LLMs-from-scratch.svg?v=3)](https://trending-repos.com/repositories/rasbt/LLMs-from-scratch?utm_source=github&utm_medium=badge)

Back to trending