1: \begin{abstract}

2: Anderson acceleration (AA) as an efficient technique for speeding up the convergence of fixed-point iterations may be designed for accelerating an optimization method. 

3: %Anderson acceleration (mixing) is a simple and efficient technique for speeding up the convergence of fixed-point iterations. Recently, it has been shown that Anderson acceleration can be effectively employed to accelerate the convergence of some optimization methods, provided that they can be viewed as applications of fixed-point iterations. 

4: We propose a novel optimization algorithm by adapting Anderson acceleration to the energy adaptive gradient method (AEGD) [\href{https://arxiv.org/abs/2010.05109}{arXiv:2010.05109}]. The feasibility of our algorithm is examined in light of convergence results for AEGD, though it is not a fixed-point iteration. %Especially, we introduce an extra hyperparameter that controls the frequency of Anderson mixing implementation and further adapts the proposed method to proximal gradient algorithms. 

5: We also quantify the accelerated convergence rate of AA for gradient descent by a factor of the gain at each implementation of the Anderson mixing. Our experimental results show that the proposed algorithm requires little tuning of hyperparameters and exhibits superior fast convergence.

6: %\%  improves the gener

7: %Experiments on logistic regression and least squares are conducted to validate the proposed method. 

8: \end{abstract}

9: