Identifying Performance Regression Conditions for Testing & Evaluation of Autonomous Systems
Paul Stankiewicz,Marin Kobilarov,Paul Stankiewicz,Marin Kobilarov
This paper addresses the problem of identifying whether/how a black-box autonomous system has regressed in performance when compared to previous versions. The approach analyzes performance datasets (typically gathered through simulation-based testing) and automatically extracts test parameter clusters of predicted performance regression. First, surrogate modeling with quantile random forests is us...
