Robotic Pushing is a video prediction dataset for real-world interactions. To explore interactions with the real world, the dataset contains 59,000 robotic interactions involving pushing actions.

In this dataset, accurately predicting the video based on the robot's next action is equivalent to learning a "visual imagination" of the future based on different courses of action.