LAGOON: Language-Guided Motion Control

Shusheng Xu,Huaijie Wang,Yutao Ouyang,Jiaxuan Gao,Zhiyu Mei,Chao Yu,Yi Wu,Shusheng Xu,Huaijie Wang,Yutao Ouyang,Jiaxuan Gao,Zhiyu Mei,Chao Yu,Yi Wu

We aim to control a robot to physically behave in the real world following any high-level language command like "cartwheel" or "kick". Although human motion datasets exist, this task remains particularly challenging since generative models can produce physically unrealistic motions, which will be more severe for robots due to different body structures and physical properties. Deploying such a moti...