Relative cost curves: An alternative to AUC and an extension to 3-class problems
Kybernetika, Tome 50 (2014) no. 5, pp. 647-660
Voir la notice de l'article provenant de la source Czech Digital Mathematics Library
Performance evaluation of classifiers is a crucial step for selecting the best classifier or the best set of parameters for a classifier. Receiver Operating Characteristic (ROC) curves and Area Under the ROC Curve (AUC) are widely used to analyse performance of a classifier. However, the approach does not take into account that misclassification for different classes might have more or less serious consequences. On the other hand, it is often difficult to specify exactly the consequences or costs of misclassifications. This paper is devoted to Relative Cost Curves (RCC) - a graphical technique for visualising the performance of binary classifiers over the full range of possible relative misclassification costs. This curve provides helpful information to choose the best set of classifiers or to estimate misclassification costs if those are not known precisely. In this paper, the concept of Area Above the RCC (AAC) is introduced, a scalar measure of classifier performance under unequal misclassification costs problem. We also extend RCC to multicategory problems when misclassification costs depend only on the true class.
DOI :
10.14736/kyb-2014-5-0647
Classification :
62A10, 62N05, 93E12
Keywords: classifier; performance evaluation; misclassification costs; cost curves; ROC curves; AUC
Keywords: classifier; performance evaluation; misclassification costs; cost curves; ROC curves; AUC
@article{10_14736_kyb_2014_5_0647,
author = {Montvida, Olga and Klawonn, Frank},
title = {Relative cost curves: {An} alternative to {AUC} and an extension to 3-class problems},
journal = {Kybernetika},
pages = {647--660},
publisher = {mathdoc},
volume = {50},
number = {5},
year = {2014},
doi = {10.14736/kyb-2014-5-0647},
mrnumber = {3301852},
zbl = {1305.93195},
language = {en},
url = {http://geodesic.mathdoc.fr/articles/10.14736/kyb-2014-5-0647/}
}
TY - JOUR AU - Montvida, Olga AU - Klawonn, Frank TI - Relative cost curves: An alternative to AUC and an extension to 3-class problems JO - Kybernetika PY - 2014 SP - 647 EP - 660 VL - 50 IS - 5 PB - mathdoc UR - http://geodesic.mathdoc.fr/articles/10.14736/kyb-2014-5-0647/ DO - 10.14736/kyb-2014-5-0647 LA - en ID - 10_14736_kyb_2014_5_0647 ER -
%0 Journal Article %A Montvida, Olga %A Klawonn, Frank %T Relative cost curves: An alternative to AUC and an extension to 3-class problems %J Kybernetika %D 2014 %P 647-660 %V 50 %N 5 %I mathdoc %U http://geodesic.mathdoc.fr/articles/10.14736/kyb-2014-5-0647/ %R 10.14736/kyb-2014-5-0647 %G en %F 10_14736_kyb_2014_5_0647
Montvida, Olga; Klawonn, Frank. Relative cost curves: An alternative to AUC and an extension to 3-class problems. Kybernetika, Tome 50 (2014) no. 5, pp. 647-660. doi: 10.14736/kyb-2014-5-0647
Cité par Sources :