🧭 Roadmap
›
09 · Emerging AI
›
Mixture of Experts (MoE)
🌙
☀️
09 · Emerging AI
Mixture of Experts (MoE)
Scaling model capacity by routing tokens to specialized experts
🟡 GOOD
🧠 Understand
👁️ Visualize
⚖️ Compare
🗣️ Explain
9 subtopics — click to study
What is MoE?
🔴
Expert Networks
🔴
Router / Gating Network
🔴
Sparse Activation
🔴
Top-K Routing
🟡
Load Balancing
🟡
MoE vs Dense Models
🔴
Mixtral / DeepSeek-MoE
🟡
Expert Parallelism
🟢
← Back to Roadmap
This page
0:00
This session
0:00
Total (all pages)
0:00
Today
0:00
▶ Running
📊 View all study stats →
0:00
studying