Translating Natural Language Instructions to Computer Programs for Robot Manipulation
Sagar Gubbi Venkatesh,Raviteja Upadrashta,Bharadwaj Amrutur,Sagar Gubbi Venkatesh,Raviteja Upadrashta,Bharadwaj Amrutur
It is highly desirable for robots that work alongside humans to be able to understand instructions in natural language. Existing language conditioned imitation learning models directly predict the actuator commands from the image observation and the instruction text. Rather than directly predicting actuator commands, we propose translating the natural language instruction to a Python function whic...
