What is Token-to-Token Relationships? Why does it exist? Where does it appear in Self-Attention?
Draw or describe a visual model of Token-to-Token Relationships. What does it look like conceptually?
Work through a concrete manual example of Token-to-Token Relationships with real numbers or pseudocode.
Implement Token-to-Token Relationships from scratch in Python. Keep it minimal โ just enough to see it work.
Try Token-to-Token Relationships on a real example. Vary the inputs and observe what changes.
How is Token-to-Token Relationships different from related concepts in Self-Attention? What are the trade-offs?
Explain Token-to-Token Relationships in plain language using an analogy. Could a non-expert follow it?
Build a small project or demo that uses Token-to-Token Relationships as a core component.
agent/state_tracker.py
๐ full plan โ