Grounding Language to Landmarks in Arbitrary Outdoor Environments

Matthew Berg,Deniz Bayazit,Rebecca Mathew,Ariel Rotter-Aboyoun,Ellie Pavlick,Stefanie Tellex,Matthew Berg,Deniz Bayazit,Rebecca Mathew,Ariel Rotter-Aboyoun,Ellie Pavlick,Stefanie Tellex

Robots operating in outdoor, urban environments need the ability to follow complex natural language commands which refer to never-before-seen landmarks. Existing approaches to this problem are limited because they require training a language model for the landmarks of a particular environment before a robot can understand commands referring to those landmarks. To generalize to new environments out...