6105332e7da20f93.tex
1: \begin{abstract}%   <- trailing '%' for backward compatibility of .sty file
2: We present
3:  consistent algorithms
4: for multiclass learning with complex performance metrics and constraints, where the objective and constraints are defined by arbitrary functions
5: of the confusion matrix. This setting includes 
6: %as a special case linear performance metrics, which are simply linear functions of the confusion matrix, but also includes
7: many common 
8: performance metrics such as the multiclass G-mean and micro $F_1$-measure, and  constraints such as those on the
9: classifier's precision and recall and more recent measures of fairness discrepancy. We give a
10: general framework for designing consistent algorithms for such complex design goals
11: by viewing the learning problem as an optimization problem over the set of feasible confusion matrices.
12: We provide multiple instantiations of our framework under 
13: different assumptions on the performance metrics and constraints, and in each case show rates of convergence  to the optimal (feasible) classifier (and thus asymptotic consistency).
14: %The resulting algorithms are provably consistent and 
15: Experiments on a variety of multiclass classification tasks and fairness constrained problems show that our algorithms compare favorably to the state-of-the-art
16:  baselines.
17: \end{abstract}
18: