What is Student vs Teacher Behavior? Why does it exist? Where does it appear in Distillation?
Draw or describe a visual model of Student vs Teacher Behavior. What does it look like conceptually?
How is Student vs Teacher Behavior different from related concepts in Distillation? What are the trade-offs?
Explain Student vs Teacher Behavior in plain language using an analogy. Could a non-expert follow it?