1: \begin{abstract}

2: 	Selecting appropriate regularization coefficients is critical to performance 

3: 	with respect to regularized empirical risk minimization problems. 

4: 	Existing theoretical approaches attempt to determine the coefficients in order for regularized empirical objectives to be upper-bounds of true objectives, uniformly over a hypothesis space.

5: 	Such an approach is, however, known to be over-conservative, especially in high-dimensional settings with large hypothesis space. 

6: 	In fact, an existing generalization error bound in variance-based regularization is $O(\sqrt{d \log n/n})$, where $d$ is the dimension of hypothesis space, and thus the number of samples required for convergence linearly increases with respect to $d$.

7: 	This paper proposes an algorithm that calculates regularization coefficient, one which results in faster convergence of generalization error $O(\sqrt{\log n/n})$ and whose leading term is independent of the dimension $d$.

8: 	This faster convergence without dependence on the size of the hypothesis space is achieved by means of empirical hypothesis space reduction, which, with high probability, successfully reduces a hypothesis space without losing the true optimum solution.

9: 	Calculation of uniform upper bounds over reduced spaces, then, 

10: 	enables acceleration of the convergence of generalization error.

11: \end{abstract}