UNO: Uncertainty-aware Noisy-Or Multimodal Fusion for Unanticipated Input Degradation
Junjiao Tian,Wesley Cheung,Nathaniel Glaser,Yen-Cheng Liu,Zsolt Kira,Junjiao Tian,Wesley Cheung,Nathaniel Glaser,Yen-Cheng Liu,Zsolt Kira
The fusion of multiple sensor modalities, especially through deep learning architectures, has been an active area of study. However, an under-explored aspect of such work is whether the methods can be robust to degradation across their input modalities, especially when they must generalize to degradation not seen during training. In this work, we propose an uncertainty-aware fusion scheme to effec...
