Re-Thinking Classification Confidence with Model Quality Quantification
Yancheng Pan,Huijing Zhao,Yancheng Pan,Huijing Zhao
Deep neural networks using for real-world classification task require high reliability and robustness. However, the Softmax output by the last layer of network is often over-confident. We propose a novel confidence estimation method by considering model quality for deep classification models. Two metrics, MQ-Repres and MQ-Discri are developed accordingly to evaluate the model quality, and also pro...