What is PPO (Proximal Policy Optimization)? Why does it exist? Where does it appear in Reinforcement Learning (RLHF)?
Draw or describe a visual model of PPO (Proximal Policy Optimization). What does it look like conceptually?
Work through a concrete manual example of PPO (Proximal Policy Optimization) with real numbers or pseudocode.
How is PPO (Proximal Policy Optimization) different from related concepts in Reinforcement Learning (RLHF)? What are the trade-offs?
Explain PPO (Proximal Policy Optimization) in plain language using an analogy. Could a non-expert follow it?