What is Vanishing Gradients? Why does it exist? Where does it appear in RNN?
Draw or describe a visual model of Vanishing Gradients. What does it look like conceptually?
Work through a concrete manual example of Vanishing Gradients with real numbers or pseudocode.
How is Vanishing Gradients different from related concepts in RNN? What are the trade-offs?
Explain Vanishing Gradients in plain language using an analogy. Could a non-expert follow it?