Learning Language-Conditioned Deformable Object Manipulation with Graph Dynamics

Yuhong Deng,Kai Mo,Chongkun Xia,Xueqian Wang,Yuhong Deng,Kai Mo,Chongkun Xia,Xueqian Wang

Multi-task learning of deformable object manipulation is a challenging problem in robot manipulation. Most previous works address this problem in a goal-conditioned way and adapt goal images to specify different tasks, which limits the multi-task learning performance and can not generalize to new tasks. Thus, we adapt language instruction to specify deformable object manipulation tasks and propose...