1: \begin{abstract}
2: We investigate the learning rate of multiple kernel learning (MKL)
3: with $\ell_1$ and elastic-net regularizations.
4: The elastic-net regularization is a composition of an $\ell
5: _1$-regularizer for inducing the sparsity
6: and an $\ell_2$-regularizer for controlling the smoothness.
7: We focus on a sparse setting where the total number of kernels is large,
8: but the number of nonzero components of the ground truth is relatively small,
9: and show sharper convergence rates
10: than the learning rates have ever shown for both $\ell_1$ and
11: elastic-net regularizations.
12: Our analysis reveals some relations between
13: the choice of a regularization function and the performance.
14: If the ground truth is smooth,
15: we show a faster convergence rate for the elastic-net regularization
16: with less conditions than $\ell_1$-regularization;
17: otherwise, a faster convergence rate for the $\ell_1$-regularization
18: is shown.
19:
20: %Our analysis shows there appears a trade-off between the sparsity and
21: %the smoothness
22: %when it comes to selecting which of $\ell_1$ and elastic-net
23: %regularizations to use;
24: %if the ground truth is smooth, the elastic-net regularization is
25: %preferred,
26: %otherwise the $\ell_1$ regularization is preferred.
27:
28: %and prove that $ell_1$ MKL and elastic-net MKL achieve
29: %the minimax learning rate on the $\ell_1$-mixed-norm ball and $
30: %Our bound is sharper than the convergence rates ever shown,
31: %and has a property that the smoother the truth is,
32: %the faster the convergence rate is.
33: \end{abstract}