Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Framework

Weiqin Zu,Wenbin Song,Ruiqing Chen,Ze Guo,Fanglei Sun,Zheng Tian,Wei Pan,Jun Wang,Weiqin Zu,Wenbin Song,Ruiqing Chen,Ze Guo,Fanglei Sun,Zheng Tian,Wei Pan,Jun Wang

The socially-aware navigation system has evolved to adeptly avoid various obstacles while performing multiple tasks, such as point-to-point navigation, human-following, and -guiding. However, a prominent gap persists: in Human-Robot Interaction (HRI), the procedure of communicating commands to robots demands intricate mathematical formulations. Furthermore, the transition between tasks does not qu...