Instance Segmentation with Cross-Modal Consistency
Alex Zihao Zhu,Vincent Casser,Reza Mahjourian,Henrik Kretzschmar,Sören Pirk,Alex Zihao Zhu,Vincent Casser,Reza Mahjourian,Henrik Kretzschmar,Sören Pirk
Segmenting object instances is a key task in machine perception, with safety-critical applications in robotics and autonomous driving. We introduce a novel approach to instance segmentation that jointly leverages measurements from multiple sensor modalities, such as cameras and LiDAR. Our method learns to predict embeddings for each pixel or point that give rise to a dense segmentation of the scen...
