Self-Supervised Object Goal Navigation with In-Situ Finetuning

So Yeon Min,Yao-Hung Hubert Tsai,Wei Ding,Ali Farhadi,Ruslan Salakhutdinov,Yonatan Bisk,Jian Zhang,So Yeon Min,Yao-Hung Hubert Tsai,Wei Ding,Ali Farhadi,Ruslan Salakhutdinov,Yonatan Bisk,Jian Zhang

A household robot should be able to navigate to target objects without requiring users to first annotate everything in their home. Most current approaches to object navigation do not test on real robots and rely solely on reconstructed scans of houses and their expensively labeled semantic 3D meshes. In this work, our goal is to build an agent that builds self-supervised models of the world via ex...