Prototypical Contrastive Transfer Learning for Multimodal Language Understanding

Seitaro Otsuki,Shintaro Ishikawa,Komei Sugiura,Seitaro Otsuki,Shintaro Ishikawa,Komei Sugiura

Although domestic service robots are expected to assist individuals who require support, they cannot currently interact smoothly with people through natural language. For example, given the instruction “Bring me a bottle from the kitchen,” it is difficult for such robots to specify the bottle in an indoor environment. Most conventional models have been trained on real-world datasets that are labor...