1: \begin{abstract}

2:       

3:       We study boosting algorithms from a new perspective.

4:       We show that the Lagrange dual problems of $ \ell_1$ norm regularized

5:       \adaboost,

6:       \logitboost and soft-margin \lpboost with generalized hinge loss 

7:       are all entropy maximization problems. 

8:       By looking at the dual problems of these boosting algorithms, we

9:       show that the success of boosting algorithms can be understood

10:       in terms of maintaining a better margin distribution by

11:       maximizing margins and at the same time controlling the margin

12:       variance. 

13:       We also theoretically prove that, approximately, $ \ell_1$

14:       norm regularized \adaboost 

15:       maximizes the average margin, instead of the minimum margin. 

16:       %

17:       %

18:       %

19:       The duality formulation also enables us to 

20:       develop column generation based optimization algorithms, which

21:       are totally corrective.  We show that they exhibit almost

22:       identical classification results to that of standard stage-wise additive

23:       boosting algorithms but  with much faster convergence rates.

24:       Therefore fewer weak classifiers are needed to build the

25:       ensemble using our proposed optimization technique.   

26: 

27: \end{abstract}

28: