Reshaping Robot Trajectories Using Natural Language Commands: A Study of Multi-Modal Data Alignment Using Transformers
Arthur Bucker,Luis Figueredo,Sami Haddadinl,Ashish Kapoor,Shuang Ma,Rogerio Bonatti,Arthur Bucker,Luis Figueredo,Sami Haddadinl,Ashish Kapoor,Shuang Ma,Rogerio Bonatti
Natural language is the most intuitive medium for us to interact with other people when expressing commands and instructions. However, using language is seldom an easy task when humans need to express their intent towards robots, since most of the current language interfaces require rigid templates with a static set of action targets and commands. In this work, we provide a flexible language-based...
