TY - GEN
T1 - A univariate bound of area under ROC
AU - Lyu, Siwei
AU - Ying, Yiming
N1 - Publisher Copyright: © 2018 by Association For Uncertainty in Artificial Intelligence (AUAI) All rights reserved.
PY - 2018
Y1 - 2018
N2 - Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimize AUC as a learning objective, so most existing algorithms are based on optimizing a surrogate loss to AUC. One significant drawback of these surrogate losses is that they require pairwise comparisons among training data, which leads to slow running time and increasing local storage for online learning. In this work, we describe a new surrogate loss based on a reformulation of AUC risk, which does not require pairwise comparison but rankings of the predictions. We further show that the ranking operation can be avoided, and the learning objective obtained based on this surrogate enjoys linear complexity in time and storage. We perform experiments to demonstrate the effectiveness of the online and batch algorithms for AUC optimization based on the proposed surrogate loss.
AB - Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimize AUC as a learning objective, so most existing algorithms are based on optimizing a surrogate loss to AUC. One significant drawback of these surrogate losses is that they require pairwise comparisons among training data, which leads to slow running time and increasing local storage for online learning. In this work, we describe a new surrogate loss based on a reformulation of AUC risk, which does not require pairwise comparison but rankings of the predictions. We further show that the ranking operation can be avoided, and the learning objective obtained based on this surrogate enjoys linear complexity in time and storage. We perform experiments to demonstrate the effectiveness of the online and batch algorithms for AUC optimization based on the proposed surrogate loss.
UR - https://www.scopus.com/pages/publications/85059379683
M3 - Conference contribution
T3 - 34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018
SP - 43
EP - 52
BT - 34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018
A2 - Globerson, Amir
A2 - Silva, Ricardo
PB - Association For Uncertainty in Artificial Intelligence (AUAI)
T2 - 34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018
Y2 - 6 August 2018 through 10 August 2018
ER -