Human-robot interaction for robotic manipulator programming in Mixed Reality

Mikhail Ostanin,Stanislav Mikhel,Alexey Evlampiev,Valeria Skvortsova,Alexandr Klimchik,Mikhail Ostanin,Stanislav Mikhel,Alexey Evlampiev,Valeria Skvortsova,Alexandr Klimchik

The paper presents an approach for interactive programming of the robotic manipulator using mixed reality. The developed system is based on the HoloLens glasses connected through Robotic Operation System to Unity engine and robotic manipulators. The system gives a possibility to recognize the real robot location by the point cloud analysis, to use virtual markers and menus for the task creation, t...