1: \begin{abstract}

2: Anderson acceleration (AA) has a long history of use and a strong recent interest due to its potential ability to dramatically improve the linear convergence of the fixed-point iteration. Most authors are simply using and analyzing the stationary version of Anderson acceleration (sAA) with a constant damping factor or without damping. Little attention has been paid to nonstationary algorithms. However, damping can be useful and is sometimes crucial for simulations in which the underlying fixed-point operator is not globally contractive. The role of this damping factor has not been fully understood. In the present work, we consider the non-stationary Anderson acceleration algorithm with optimized damping (AAoptD) in each iteration to further speed up linear and nonlinear iterations by applying one extra inexpensive optimization. We analyze this procedure and develop an efficient and inexpensive implementation scheme. We also show that, compared with the stationary Anderson acceleration with fixed window size $sAA(m)$, optimizing the damping factors is related to dynamically packaging $sAA(m)$ and $sAA(1)$ in each iteration (alternating window size $m$ is another direction of producing non-stationary AA). Moreover, we show by extensive numerical experiments that, in the case a larger window size is needed, the proposed non-stationary Anderson acceleration with optimized damping procedure often converges much faster than stationary AA with constant damping or without damping. When the window size is very small ($m\leq3$ was typically used, especially in the early days of application), AAoptD and AA are comparable. Lastly, we observed that when the system is overdamped (i.e. the damping factor is close to the lower bound zero), inconsistency may occur. So there is some trade-off between stability and speed of convergence. We successfully solve this problem by further restricting damping factors bound away from zero.

3: \end{abstract}

4: