nerf2nerf: Pairwise Registration of Neural Radiance Fields

Lily Goli,Daniel Rebain,Sara Sabour,Animesh Garg,Andrea Tagliasacchi,Lily Goli,Daniel Rebain,Sara Sabour,Animesh Garg,Andrea Tagliasacchi

We introduce a technique for pairwise registration of neural fields that extends classical optimization-based local registration (i.e. ICP) to operate on Neural Radiance Fields (NeRF)-neural 3D scene representations trained from collections of calibrated images. NeRF does not decompose illumination and color, so to make registration invariant to illumination, we introduce the concept of a “surface...