What is Batching? Why does it exist? Where does it appear in Inference Optimization?
How is Batching different from related concepts in Inference Optimization? What are the trade-offs?
Explain Batching in plain language using an analogy. Could a non-expert follow it?