8b49e864b2282954.tex
1: \begin{abstract}
2: In this paper, we focus on the \emph{relaxed proximal point algorithm} (RPPA) for solving convex (possibly nonsmooth) optimization problems. 
3: %
4: We conduct a comprehensive study on three types of relaxation schedules: (i) constant schedule with relaxation parameter $\alpha_k\equiv \alpha \in (0, \sqrt{2}]$, (ii) the dynamic schedule put forward by Teboulle and Vaisbourd \cite{TV23}, and (iii) the silver stepsize schedule proposed by Altschuler and Parrilo \cite{AP23b}. The latter two schedules were initially investigated for the \emph{gradient descent} (GD) method and are extended to the RPPA in this paper.
5: %
6: For type (i),  we establish tight non-ergodic $O(1/N)$ convergence rate results measured by function value residual and subgradient norm, where $N$ denotes the iteration counter.
7: %
8: For type (ii), we establish a convergence rate that is tight and approximately $\sqrt{2}$ times better than the constant schedule of type (i). 
9: %
10: For type (iii), aside from the original silver stepsize schedule put forward by Altschuler and Parrilo, we propose two new modified silver stepsize schedules, and 
11: %
12: for all the three silver stepsize schedules, $O(1 / N^{1.2716})$ accelerated convergence rate results with respect to three different performance metrics are established.
13: %
14: Furthermore, our research affirms the conjecture in \cite[Conjecture 3.2]{LG24} on GD method with the original silver stepsize schedule.
15: \end{abstract}
16: