Multimodal Time Series Learning of Robots Based on Distributed and Integrated Modalities: Verification with a Simulator and Actual Robots

Hideyuki Ichiwara,Hiroshi Ito,Kenjiro Yamamoto,Hiroki Mori,Tetsuya Ogata,Hideyuki Ichiwara,Hiroshi Ito,Kenjiro Yamamoto,Hiroki Mori,Tetsuya Ogata

We have developed an autonomous robot motion generation model based on distributed and integrated multimodal learning. Since each modality used as a robot's senses, such as image, joint angle, and torque, has a different physical meaning and time characteristic, the generation of autonomous motions using multimodal learning has sometimes failed due to overlearning in one of the modalities. Inspire...