What is Tiny Language Model? Why does it exist? Where does it appear in Language Modeling?
Draw or describe a visual model of Tiny Language Model. What does it look like conceptually?
Work through a concrete manual example of Tiny Language Model with real numbers or pseudocode.
Implement Tiny Language Model from scratch in Python. Keep it minimal โ just enough to see it work.
Try Tiny Language Model on a real example. Vary the inputs and observe what changes.
Explain Tiny Language Model in plain language using an analogy. Could a non-expert follow it?
Build a small project or demo that uses Tiny Language Model as a core component.