CloudAttention: Efficient Multi-Scale Attention Scheme For 3D Point Cloud Learning
Mahdi Saleh,Yige Wang,Nassir Navab,Benjamin Busam,Federico Tombari,Mahdi Saleh,Yige Wang,Nassir Navab,Benjamin Busam,Federico Tombari
Processing 3D data efficiently has always been a challenge. Spatial operations on large-scale point clouds, stored as sparse data, require extra cost. Attracted by the success of transformers, researchers are using multi-head attention for vision tasks. However, attention calculations in transformers come with quadratic complexity in the number of inputs and miss spatial intuition on sets like poi...