1: \begin{abstract}

2: %Recently, AUC maximization for deep learning (aka Deep AUC Maximization) has received increasing interests due to its promising performance for tackling classification problems with imbalanced unstructured data. However, in many applications partial AUC (pAUC) is preferred for assessing the performance of a classifier, which is the area under the ROC curve with a restriction on the upper bound of  false positive rate (for one-way pAUC) and a restriction on the lower bound of true positive rate (for two-way pAUC). Compared with standard AUC maximization, maximization of pAUC scores is more challenging as the objective function involves selecting examples whose prediction scores are in a certain range, which makes computing an unbiased stochastic gradient of the objective function expensive.  

3: In this paper, we propose systematic and efficient gradient-based methods for both one-way and two-way partial AUC (pAUC) maximization that are applicable to deep learning. We propose new formulations of pAUC surrogate objectives by using the distributionally robust optimization (DRO) to define the loss for each individual positive data. We consider two formulations of DRO, one of which is based on conditional-value-at-risk (CVaR) that yields a non-smooth but exact estimator for pAUC, and another one is based on a KL divergence regularized DRO that yields an inexact but smooth (soft) estimator for pAUC. For both one-way and two-way pAUC maximization, we propose two algorithms and prove their convergence for optimizing their two formulations, respectively. Experiments demonstrate the effectiveness of the proposed algorithms for pAUC maximization for deep learning on various datasets. The proposed methods are implemented with tutorials in

4: our open-sourced library LibAUC (\url{www.libauc.org}).

5: \end{abstract}

6: