rasbt

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

View on GitHub Website

Stars

1,04,158

Forks

15,954

Language

Jupyter Notebook

Licence

—

ai artificial-intelligence attention-mechanism deep-learning finetuning from-scratch generative-ai gpt

Created 23 Jul 2023Last push 1 Sept 2026

Stars and forks are a snapshot taken when this directory was last refreshed, not a live count — the figure here matches the one in our articles and videos. Last refreshed 1 Sept 2026.