Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations

Rogerio Bonatti,Ratnesh Madaan,Vibhav Vineet,Sebastian Scherer,Ashish Kapoor,Rogerio Bonatti,Ratnesh Madaan,Vibhav Vineet,Sebastian Scherer,Ashish Kapoor

Machines are a long way from robustly solving open-world perception-control tasks, such as first-person view (FPV) aerial navigation. While recent advances in end-to- end Machine Learning, especially Imitation Learning and Reinforcement appear promising, they are constrained by the need of large amounts of difficult-to-collect labeled real- world data. Simulated data, on the other hand, is easy to...