24a902f0225018e4.tex
1: \begin{abstract}
2: Due to the non-smoothness of the Hinge loss in SVM, it is difficult to obtain a faster convergence rate with
3: modern optimization algorithms.
4: In this paper, we introduce two smooth Hinge losses $\psi_G(\alpha;\sigma)$ and $\psi_M(\alpha;\sigma)$
5: which are infinitely differentiable and converge to the Hinge loss uniformly in $\alpha$ as $\sigma$ tends to $0$.
6: By replacing the Hinge loss with these two smooth Hinge losses, we obtain two smooth support vector machines
7: (SSVMs), respectively. Solving the SSVMs with the Trust Region Newton method (TRON) leads to two quadratically
8: convergent algorithms. Experiments in text classification tasks show that the proposed SSVMs are effective in
9: real-world applications.
10: We also introduce a general smooth convex loss function to unify several commonly-used convex loss functions
11: in machine learning. The general framework provides smooth approximation functions to non-smooth convex
12: loss functions, which can be used to obtain smooth models that can be solved with faster convergent
13: optimization algorithms.
14: \end{abstract}
15: