Attentive Task-Net: Self Supervised Task-Attention Network for Imitation Learning using Video Demonstration

Kartik Ramachandruni,Madhu Babu V.,Anima Majumder,Samrat Dutta,Swagat Kumar,Kartik Ramachandruni,Madhu Babu V.,Anima Majumder,Samrat Dutta,Swagat Kumar

This paper proposes an end-to-end self-supervised feature representation network named Attentive Task-Net or AT-Net for video-based task imitation. The proposed AT-Net incorporates a novel multi-level spatial attention module to highlight spatial features corresponding to the intended task demonstrated by the expert. The neural connections in AT-Net ensure the relevant information in the demonstra...