RoboTAP: Tracking Arbitrary Points for Few-Shot Visual Imitation

Mel Vecerik,Carl Doersch,Yi Yang,Todor Davchev,Yusuf Aytar,Guangyao Zhou,Raia Hadsell,Lourdes Agapito,Jon Scholz,Mel Vecerik,Carl Doersch,Yi Yang,Todor Davchev,Yusuf Aytar,Guangyao Zhou,Raia Hadsell,Lourdes Agapito,Jon Scholz

For robots to be useful outside labs and specialized factories we need a way to teach them new useful behaviors quickly. Current approaches lack either the generality to onboard new tasks without task-specific engineering, or else lack the data-efficiency to do so in an amount of time that enables practical use. In this work we explore dense tracking as a representational vehicle to allow faster a...