Operative Action Captioning for Estimating System Actions

Taiki Nakamura,Seiya Kawano,Akishige Yuguchi,Yasutomo Kawanishi,Koichiro Yoshino,Taiki Nakamura,Seiya Kawano,Akishige Yuguchi,Yasutomo Kawanishi,Koichiro Yoshino

Human-assistive systems, such as robots, need to correctly understand the surrounding situation based on obser-vations and output the required support actions for humans. Language is one of the important channels to communicate with humans, and robots are required to have the ability to express their understanding and action-planning results. In this study, we propose a new task of operative actio...