1: \begin{abstract}

2: {

3: This paper studies Anderson acceleration (AA) for fixed-point methods $\bx^{(k+1)}=q(\bx^{(k)})$. It provides the first proof that when the operator $q$ is linear and symmetric, AA improves the root-linear convergence factor over the fixed-point iterations. When $q$ is nonlinear, yet has a symmetric Jacobian at the solution, a slightly modified AA algorithm is proved to have an analogous root-linear convergence factor improvement over fixed-point iterations. 

4: Simulations verify our observations. Furthermore, experiments with different data models demonstrate AA is significantly superior to the standard fixed-point methods for Tyler's M-estimation.

5: 

6: \vspace{3mm}

7:     \noindent\textbf{Keywords:} 

8: Anderson acceleration, fixed-point method, Tyler's M-estimation

9: 

10: \vspace{3mm}

11:     \noindent\textbf{MSC codes:} 

12:      65F10, 65H10, 68W40

13: %90C26, 15A16, 65K10, 68Q32

14: %90C26, 90C52, 65K10, 68W40

15: }

16: 

17: % 90C26 - Nonconvex programming, global optimization

18: % 90C52 - Methods of reduced gradient type 

19: % 65K10 - Numerical optimization and variational techniques

20: % 68W40 - Analysis of algorithms  

21: % 65F10 - Iterative numerical methods for linear systems

22: % 65H10 - Numerical computation of solutions to systems of equations

23: \end{abstract}

24: