Integrated Benchmarking and Design for Reproducible and Accessible Evaluation of Robotic Agents
Jacopo Tani,Andrea F. Daniele,Gianmarco Bernasconi,Amaury Camus,Aleksandar Petrov,Anthony Courchesne,Bhairav Mehta,Rohit Suri,Tomasz Zaluska,Matthew R. Walter,Emilio Frazzoli,Liam Paull,Andrea Censi,Jacopo Tani,Andrea F. Daniele,Gianmarco Bernasconi,Amaury Camus,Aleksandar Petrov,Anthony Courchesne,Bhairav Mehta,Rohit Suri,Tomasz Zaluska,Matthew R. Walter,Emilio Frazzoli,Liam Paull,Andrea Censi
As robotics matures and increases in complexity, it is more necessary than ever that robot autonomy research be reproducible. Compared to other sciences, there are specific challenges to benchmarking autonomy, such as the complexity of the software stacks, the variability of the hardware and the reliance on data-driven techniques, amongst others. In this paper, we describe a new concept for reprod...
