NeRF-Loc: Visual Localization with Conditional Neural Radiance Field

Jianlin Liu,Qiang Nie,Yong Liu,Chengjie Wang,Jianlin Liu,Qiang Nie,Yong Liu,Chengjie Wang

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our pipeline, which supports continuous 3D descriptors generation and neural rendering. By unifying the feature matching and the scene coordinate regression to the same ...