🧭 Roadmap
›
04 · Build Language Models
›
Language Modeling
🌙
☀️
04 · Build Language Models
Language Modeling
Next-token prediction — the one task that enables everything
🔴 MUST
🧠 Understand
👁️ Visualize
✏️ Calculate
💻 Code
🔬 Experiment
🗣️ Explain
🔨 Build
6 subtopics — click to study
What is a Language Model?
🔴
Next Token Prediction
🔴
Probability Distribution
🔴
Context Window
🔴
Autoregressive Generation
🔴
Tiny Language Model
🔵
← Back to Roadmap
This page
0:00
This session
0:00
Total (all pages)
0:00
Today
0:00
▶ Running
📊 View all study stats →
0:00
studying