Generalizable task representation learning from human demonstration videos: a geometric approach

Jun Jin,Martin Jagersand,Jun Jin,Martin Jagersand

We study the problem of generalizable task learning from human demonstration videos without extra training on the robot or pre-recorded robot motions. Given a set of human demonstration videos showing a task with different objects/tools (categorical objects), we aim to learn a representation of visual observation that generalizes to categorical objects and enables efficient controller design. We p...