f20bfdcfe72fd2f2.tex
1: \begin{abstract}
2:  % The abstract paragraph should be indented \nicefrac{1}{2}~inch (3~picas) on  both the left- and right-hand margins. Use 10~point type, with a vertical  spacing (leading) of 11~points.  The word \textbf{Abstract} must be centered,   bold, and in point size 12. Two line spaces precede the abstract. The abstract   must be limited to one paragraph.
3:  
4:  %% Which regularization norm should we use? This question is fundamental since regularization plays a pivotal role in ill-posed machine learning and inverse problems. t
5:  Regularization plays a pivotal role in ill-posed machine learning and inverse problems. However, the fundamental comparative analysis of various regularization norms remains open. We establish a small noise analysis framework to assess the effects of norms in Tikhonov and RKHS regularizations, in the context of ill-posed linear inverse problems with Gaussian noise. This framework studies the convergence rates of regularized estimators in the small noise limit and reveals the potential instability of the conventional $L^2$-regularizer. We solve such instability by proposing an innovative class of adaptive fractional RKHS regularizers, which covers the $L^2$ Tikhonov and RKHS regularizations by adjusting the fractional smoothness parameter. A surprising insight is that over-smoothing via these fractional RKHSs consistently yields optimal convergence rates, but the optimal hyper-parameter may decay too fast to be selected in practice. 
6: \end{abstract}
7: