1: \begin{abstract}% <- trailing '%' for backward compatibility of .sty file
2: We present
3: consistent algorithms
4: for multiclass learning with complex performance metrics and constraints, where the objective and constraints are defined by arbitrary functions
5: of the confusion matrix. This setting includes
6: %as a special case linear performance metrics, which are simply linear functions of the confusion matrix, but also includes
7: many common
8: performance metrics such as the multiclass G-mean and micro $F_1$-measure, and constraints such as those on the
9: classifier's precision and recall and more recent measures of fairness discrepancy. We give a
10: general framework for designing consistent algorithms for such complex design goals
11: by viewing the learning problem as an optimization problem over the set of feasible confusion matrices.
12: We provide multiple instantiations of our framework under
13: different assumptions on the performance metrics and constraints, and in each case show rates of convergence to the optimal (feasible) classifier (and thus asymptotic consistency).
14: %The resulting algorithms are provably consistent and
15: Experiments on a variety of multiclass classification tasks and fairness constrained problems show that our algorithms compare favorably to the state-of-the-art
16: baselines.
17: \end{abstract}
18: