DeepFusion: A Robust and Modular 3D Object Detector for Lidars, Cameras and Radars

Florian Drews,Di Feng,Florian Faion,Lars Rosenbaum,Michael Ulrich,Claudius Gläser,Florian Drews,Di Feng,Florian Faion,Lars Rosenbaum,Michael Ulrich,Claudius Gläser

We propose DeepFusion, a modular multi-modal architecture to fuse lidars, cameras and radars in different combinations for 3D object detection. Specialized feature extractors take advantage of each modality and can be exchanged easily, making the approach simple and flexible. Extracted features are transformed into bird's-eye-view as a common representation for fusion. Spatial and semantic alignme...