Talk the talk and walk the walk: Dialogue-driven navigation in unknown indoor environments

Thomas Victor Ilyevsky,Jared Sigurd Johansen,Jeffrey Mark Siskind,Thomas Victor Ilyevsky,Jared Sigurd Johansen,Jeffrey Mark Siskind

Prior work in natural-language-driven navigation demonstrates success in systems deployed in synthetic environments or applied to large datasets, both real and synthetic. However, there is an absence of such frameworks being deployed and rigorously tested in real environments, unknown a priori. In this paper, we present a novel framework that uses spoken dialogue with a real person to interpret a ...