1: \begin{abstract}

2: First-order operator splitting methods are ubiquitous among many fields through science and engineering, such as inverse problems, signal/image processing, statistics, data science and machine learning, to name a few. 

3: In this paper, we study a geometric property of first-order methods when applying to solve non-smooth optimization problems. With the tool of ``partial smoothness'', we design a framework to analyze the trajectory of the fixed-point sequence generated by first-order methods and show that locally, the fixed-point sequence settles onto a regular trajectory such as a straight line or a spiral. 

4: Based on this finding, we discuss the limitation of current widely used ``inertial acceleration'' technique, and propose a trajectory following adaptive acceleration algorithm. 

5: Global convergence is established for the proposed acceleration scheme based on the perturbation of fixed-point iteration. Locally, we first build connections between the acceleration scheme and the well-studied ``vector extrapolation technique'' in the field of numerical analysis, and then discuss local acceleration guarantees of the proposed acceleration scheme. 

6: Moreover, our result provides a geometric interpretation of these vector extrapolation techniques. 

7: Numerical experiments on various first-order methods are provided to demonstrate the advantage of the proposed adaptive acceleration scheme. 

8: %for the acceleration of first-order methods. VE requires the choice of the number of past points $k$, which is problem dependent. There is often tradeoff between numerically stability and accurate extrapolation in the choice of $k$. \todo{...}One of our main contributions is that under the framework of partial smoothness, we show that eventually, the trajectory of the sequence in the case of DR or PD lies approximately in space of dimension two, and hence, vector extrapolation methods can be effectively applied with $k=4$.

9: %\end{abstract}

10: