Mono-STAR: Mono-Camera Scene-Level Tracking and Reconstruction

Haonan Chang,Dhruv Metha Ramesh,Shijie Geng,Yuqiu Gan,Abdeslam Boularias,Haonan Chang,Dhruv Metha Ramesh,Shijie Geng,Yuqiu Gan,Abdeslam Boularias

We present Mono-STAR, the first real-time 3D reconstruction system that simultaneously supports semantic fusion, fast motion tracking, non-rigid object deformation, and topological change under a unified framework. The proposed system solves a new optimization problem incorporating optical-flow-based 2D constraints to deal with fast motion and a novel semantic-aware deformation graph (SAD-graph) f...