Compression Bottleneck

What is Compression Bottleneck? Why does it exist? Where does it appear in Attention?

Draw or describe a visual model of Compression Bottleneck. What does it look like conceptually?

Work through a concrete manual example of Compression Bottleneck with real numbers or pseudocode.

Implement Compression Bottleneck from scratch in Python. Keep it minimal — just enough to see it work.

Try Compression Bottleneck on a real example. Vary the inputs and observe what changes.

How is Compression Bottleneck different from related concepts in Attention? What are the trade-offs?

Explain Compression Bottleneck in plain language using an analogy. Could a non-expert follow it?

Build a small project or demo that uses Compression Bottleneck as a core component.