Motion Reasoning for Goal-Based Imitation Learning

De-An Huang,Yu-Wei Chao,Chris Paxton,Xinke Deng,Li Fei-Fei,Juan Carlos Niebles,Animesh Garg,Dieter Fox,De-An Huang,Yu-Wei Chao,Chris Paxton,Xinke Deng,Li Fei-Fei,Juan Carlos Niebles,Animesh Garg,Dieter Fox

We address goal-based imitation learning, where the aim is to output the symbolic goal from a third-person video demonstration. This enables the robot to plan for execution and reproduce the same goal in a completely different environment. The key challenge is that the goal of a video demonstration is often ambiguous at the level of semantic actions. The human demonstrators might unintentionally a...