1: \begin{abstract}

2: 

3: 

4: In this paper, we study the influence of ill-conditioned regression matrix on

5: two hyper-parameter estimation methods for the kernel-based regularization method: the empirical Bayes ($\EB$) and the Stein's unbiased risk estimator (SURE). First, we consider the convergence rate of the cost functions of EB and SURE, and we find that

6: they have the same convergence rate but the influence of the ill-conditioned regression matrix on the scale factor are different: the scale factor for SURE

7: contains one more factor $\cond(\Phi^{T}\Phi)$

8: than that of EB, where $\Phi$ is the regression matrix and $\cond(\cdot)$ denotes the condition number of a matrix. This finding indicates that when $\Phi$ is ill-conditioned, i.e., $\cond(\Phi^{T}\Phi)$ is large, the cost function of SURE converges slower than that of EB. Then we consider the convergence rate of the optimal hyper-parameters of EB and SURE, and we find that they are both asymptotically normally distributed and have the same convergence rate, but the influence of the ill-conditioned regression matrix on the scale factor are different. In particular, for the ridge regression case, we show that the optimal hyper-parameter of SURE converges slower than that of EB with a factor of $1/n^2$, as $\cond(\Phi^{T}\Phi)$ goes to $\infty$,

9: where $n$ is the FIR model order.

10:  \end{abstract}