Learning to Act with Affordance-Aware Multimodal Neural SLAM

Zhiwei Jia,Kaixiang Lin,Yizhou Zhao,Qiaozi Gao,Govind Thattai,Gaurav S. Sukhatme,Zhiwei Jia,Kaixiang Lin,Yizhou Zhao,Qiaozi Gao,Govind Thattai,Gaurav S. Sukhatme

Recent years have witnessed an emerging paradigm shift toward embodied artificial intelligence, in which an agent must learn to solve challenging tasks by interacting with its environment. There are several challenges in solving embodied multimodal tasks, including long-horizon planning, vision-and-language grounding, and efficient exploration. We focus on a critical bottleneck, namely the perform...