Integrated Learning of Robot Motion and Sentences: Real-Time Prediction of Grasping Motion and Attention based on Language Instructions
Hiroshi Ito,Hideyuki Ichiwara,Kenjiro Yamamoto,Hiroki Mori,Tetsuya Ogata,Hiroshi Ito,Hideyuki Ichiwara,Kenjiro Yamamoto,Hiroki Mori,Tetsuya Ogata
We propose a motion generation model that can achieve robust behavior against environmental changes based on language instructions at a low cost. Conventional robots that communicate with humans use a restricted environment and language to build up a mapping between language and motion, and thus need to prepare a huge training set in order to achieve versatility. Our method trains pairs of languag...
