Vision-Based Gesture Recognition in Human-Robot Teams Using Synthetic Data

Celso M. de Melo,Brandon Rothrock,Prudhvi Gurram,Oytun Ulutan,B.S. Manjunath,Celso M. de Melo,Brandon Rothrock,Prudhvi Gurram,Oytun Ulutan,B.S. Manjunath

Building successful collaboration between humans and robots requires efficient, effective, and natural communication. Here we study a RGB-based deep learning approach for controlling robots through gestures (e.g., "follow me"). To address the challenge of collecting high-quality annotated data from human subjects, synthetic data is considered for this domain. We contribute a dataset of gestures th...