1: \begin{abstract}

2: Areas under ROC (AUROC) and precision-recall curves (AUPRC) are common metrics for evaluating classification performance for imbalanced problems. Compared with AUROC, AUPRC is a more appropriate metric for highly imbalanced datasets. While stochastic optimization of AUROC has been studied extensively, principled stochastic optimization of AUPRC has been rarely explored. In this work, we propose a principled technical method to optimize AUPRC for deep learning. 

3: Our approach is based on maximizing the averaged precision (AP), which is an unbiased point estimator of AUPRC. %We show that the surrogate loss function for AP is highly non-convex and more complicated than that of AUROC. 

4: We cast the objective into a sum of {\it dependent compositional functions} with inner functions dependent on random variables of the outer level. We propose efficient adaptive and non-adaptive  stochastic algorithms named SOAP with {\it provable convergence guarantee under mild conditions} by leveraging recent advances in stochastic compositional optimization. Extensive experimental results on  image and graph datasets demonstrate that our proposed method outperforms prior methods on imbalanced problems in terms of AUPRC.

5: To the best of our knowledge, our work represents the first attempt to optimize AUPRC with provable convergence. The SOAP has been implemented in the libAUC library at~\url{https://libauc.org/}. 

6: %\footnote{* denotes equal contribution.} 

7: \end{abstract}

8: