Shadow-Based 3D Pose Estimation of Intraocular Instrument Using Only 2D Images

Junjie Yang,Zhihao Zhao,Mathias Maier,Kai Huang,Nassir Navab,M. Ali Nasseri,Junjie Yang,Zhihao Zhao,Mathias Maier,Kai Huang,Nassir Navab,M. Ali Nasseri

In ophthalmic surgeries, such as vitreoretinal operations, surgeons rely on imaging systems, primarily microscopes, for real-time instrument monitoring and motion planning. However, novice surgeons struggle to extract 3D instrument positions from 2D microscope frames, necessitating extensive trial-and-error experience with the background that additional imaging modalities such as iOCT remain inacc...