THE MECHANISM
Observe → decide → act → learn
03Observation is evidence
→04A policy closes the loop
→05An MDP is a modeling tool
FAILURE → REPAIR
Common trap
“The camera image is the state.”
Better model
It is an observation. Hidden friction, object mass, and occluded geometry can still affect what happens next.
YOUR NEXT GATE
Paper-policy warm-up
- 1Choose one task: reach, push, or pick.
- 2Write one line each for observation, action, and success.
- 3Draw the five-step loop and mark where uncertainty enters.