Audio-Visual Depth and Material Estimation for Robot Navigation
Justin Wilson,Nicholas Rewkowski,Ming C. Lin,Justin Wilson,Nicholas Rewkowski,Ming C. Lin
Reflective and textureless surfaces such as windows, mirrors, and walls can be a challenge for scene reconstruction, due to depth discontinuities and holes. We propose an audio-visual method that uses the reflections of sound to aid in depth estimation and material classification for 3D scene reconstruction in robot navigation and AR/VR applications. The mobile phone prototype emits pulsed audio, ...
