6bb43545ae35eeb1.tex
1: \begin{abstract}
2: 
3: 
4:     We present a novel column generation based boosting method for
5:     multi-class classification.
6:     Our multi-class boosting is formulated in a single optimization
7:     problem as in \cite{Shen2011Direct,cvpr2012Paisitkriangkrai}.
8:     Different from most existing multi-class boosting methods, which
9:     use the same set of weak learners for all the classes,
10:     we train class specified weak learners (i.e.,
11:     each class has a different set of weak learners).
12:     We show that using separate weak learner sets for each class leads
13:     to fast convergence,
14:     without introducing additional computational  overhead in the
15:     training  procedure. To further make the training more efficient
16:     and scalable,  we also
17:     propose a fast coordinate descent method for
18:     solving the optimization problem at each boosting iteration.
19:     The proposed coordinate descent method is conceptually simple
20:     and easy to implement in that it is a closed-form solution for
21:     each coordinate update.
22:     Experimental results on a variety of  datasets show that,
23:     compared to a range of existing multi-class boosting methods, the proposed
24:     method has much faster convergence rate and  better generalization
25:     performance in most cases. We also empirically show that the
26:     proposed fast coordinate descent algorithm needs less
27:     training time than the MultiBoost algorithm in Shen and Hao
28:     \cite{Shen2011Direct}.
29: 
30: 
31: 
32: 
33: \end{abstract}
34: