raiyanyahya/how-to-train-your-gpt
★ 3,326 stars
★ 1,597 at coverage → ★ 3,326 (+1,729)
Build a modern LLM from scratch. Every line commented. Explained like we are five.
Transcript
Andrew Ng's deep learning specialization costs $49 a month on Coursera. This does it free. How to Train Your GPT is an open source tutorial that walks you through building a real LLM from scratch in PyTorch, with every line of code commented and explained like you are five. It covers tokenization, attention mechanisms, and the complete transformer architecture. Over 1,500 developers starred it in just two weeks. Star it if this saved you money.