AV-PedAware: Self-Supervised Audio-Visual Fusion for Dynamic Pedestrian Awareness

Yizhuo Yang,Shenghai Yuan,Muqing Cao,Jianfei Yang,Lihua Xie,Yizhuo Yang,Shenghai Yuan,Muqing Cao,Jianfei Yang,Lihua Xie

In this study, we introduce AV-PedAware, a self-supervised audio-visual fusion system designed to improve dynamic pedestrian awareness for robotics applications. Pedestrian awareness is a critical requirement in many robotics applications. However, traditional approaches that rely on cameras and LIDARs to cover multiple views can be expensive and susceptible to issues such as changes in illuminati...