Evaluation Metrics of Object Detection for Quantitative System-Level Analysis of Safety-Critical Autonomous Systems
Apurva Badithela,Tichakorn Wongpiromsarn,Richard M. Murray,Apurva Badithela,Tichakorn Wongpiromsarn,Richard M. Murray
This paper proposes two metrics for evaluating learned object detection models: the proposition-labeled and distance-parametrized confusion matrices. These metrics are leveraged to quantitatively analyze the system with respect to its system-level formal specifications via probabilistic model checking. In particular, we derive transition probabilities from these confusion matrices to compute the p...