Learning to Synthesize Volumetric Meshes from Vision-based Tactile Imprints

Xinghao Zhu,Siddarth Jain,Masayoshi Tomizuka,Jeroen Van Baar,Xinghao Zhu,Siddarth Jain,Masayoshi Tomizuka,Jeroen Van Baar

Vision-based tactile sensors typically utilize a deformable elastomer and a camera mounted above to provide high-resolution image observations of contacts. Obtaining accurate volumetric meshes for the deformed elastomer can provide direct contact information and benefit robotic grasping and manipulation. This paper focuses on learning to synthesize the volumetric mesh of the elastomer based on the...