1: \begin{abstract}
2:
3: We propose a new discrete-time online parameter estimation algorithm that combines two different aspects, one that adds momentum, and another that includes a time-varying learning rate. It is well known that recursive least squares based approaches that include a time-varying gain can lead to exponential convergence of parameter errors under persistent excitation, while momentum-based approaches have demonstrated a fast convergence of tracking error towards zero with constant regressors. The question is when combined, will the filter from the momentum method come in the way of exponential convergence. This paper proves that exponential convergence of parameter is still possible with persistent excitation. Simulation results demonstrated competitive properties of the proposed algorithm compared to the recursive least squares algorithm with forgetting.
4:
5: % Stability proof using Lyapunov's method shows that the proposed algorithm has a similar parameter convergence rate to that of the recursive least squares algorithm with a forgetting factor. Due to the presence of the momentum term, our algorithm provides more flexibility for the adjustment of convergence behavior. Simulation results show that the proposed algorithm can outperform the recursive least squares algorithm when the forgetting factors are set to be the same.
6:
7: % I would write this differently. HT has demonstrated potential of fast convergence of tracking error, 1/sqrt e compared to 1/e. The main idea is the addition of a stable filter in the parameter estimation algorithm. Separately, exponential convergence has been addressed through a time-varying gain in RLS based approaches. The question is then, will the filter come in the way of exponential convergence. This paper proves that it does not and that exponential convergence is possible with PE. Simulation results show that the .... algorithm. Comparisons are also made with RLS with forgetting factor.
8:
9: \end{abstract}
10: