Multimodal Neural Radiance Field

Haidong Zhu,Yuyin Sun,Chi Liu,Lu Xia,Jiajia Luo,Nan Qiao,Ram Nevatia,Cheng–Hao Kuo,Haidong Zhu,Yuyin Sun,Chi Liu,Lu Xia,Jiajia Luo,Nan Qiao,Ram Nevatia,Cheng–Hao Kuo

This paper addresses the challenge of reconstructing a scene with a neural radiance field (NeRF) for robot vision and scene understanding using multiple modalities. Researchers have introduced the use of NeRF to represent an object for synthesizing and rendering novel views of complex scenes by optimizing a 3-D radiance field for ray casting and rendering for 2-D RGB images. However, using RGB ima...