MVTrans: Multi-View Perception of Transparent Objects

Yi Ru Wang,Yuchi Zhao,Haoping Xu,Sagi Eppel,Alán Aspuru-Guzik,Florian Shkurti,Animesh Garg,Yi Ru Wang,Yuchi Zhao,Haoping Xu,Sagi Eppel,Alán Aspuru-Guzik,Florian Shkurti,Animesh Garg

Transparent object perception is a crucial skill for applications such as robot manipulation in household and laboratory settings. Existing methods utilize RGB-D or stereo inputs to handle a subset of perception tasks including depth and pose estimation. However transparent object perception remains to be an open problem. In this paper, we forgo the unreliable depth map from RGB-D sensors and exte...