Success Weighted by Completion Time: A Dynamics-Aware Evaluation Criteria for Embodied Navigation
Naoki Yokoyama,Sehoon Ha,Dhruv Batra,Naoki Yokoyama,Sehoon Ha,Dhruv Batra
We present Success weighted by Completion Time (SCT), a new metric for evaluating navigation performance for mobile robots. Several related works on navigation have used Success weighted by Path Length (SPL) as the primary method of evaluating the path an agent makes to a goal location, but SPL is limited in its ability to properly evaluate agents with complex dynamics. In contrast, SCT explicitly...
