Checkpoints

What is Checkpoints? Why does it exist? Where does it appear in Pretraining?

Draw or describe a visual model of Checkpoints. What does it look like conceptually?

Work through a concrete manual example of Checkpoints with real numbers or pseudocode.

Implement Checkpoints from scratch in Python. Keep it minimal — just enough to see it work.

How is Checkpoints different from related concepts in Pretraining? What are the trade-offs?

Explain Checkpoints in plain language using an analogy. Could a non-expert follow it?