Who2com: Collaborative Perception via Learnable Handshake Communication

Yen-Cheng Liu,Junjiao Tian,Chih-Yao Ma,Nathan Glaser,Chia-Wen Kuo,Zsolt Kira,Yen-Cheng Liu,Junjiao Tian,Chih-Yao Ma,Nathan Glaser,Chia-Wen Kuo,Zsolt Kira

In this paper, we propose the problem of collaborative perception, where robots can combine their local observations with those of neighboring agents in a learnable way to improve accuracy on a perception task. Unlike existing work in robotics and multi-agent reinforcement learning, we formulate the problem as one where learned information must be shared across a set of agents in a bandwidth-sensi...