627b4adbd61b95f2.tex
1: \begin{abstract}
2: The generalized \texttt{Lasso} is a remarkably versatile and extensively utilized model across a broad spectrum of domains, including statistics, machine learning, and image science. Among the optimization techniques employed to address the challenges posed by this model, saddle-point methods stand out for their effectiveness. In particular, the \textit{primal-dual hybrid gradient} (\texttt{PDHG}) algorithm has emerged as a highly popular choice, celebrated for its robustness and efficiency in finding optimal solutions. Recently,  the underlying mechanism of the~\texttt{PDHG} algorithm has been elucidated through the high-resolution ordinary differential equation (ODE) and the implicit-Euler scheme as detailed in~\citep{li2024understanding}. This insight has spurred the development of several accelerated variants of the ~\texttt{PDHG} algorithm, originally proposed by~\citep{chambolle2011first}. By employing discrete Lyapunov analysis, we establish that the~\texttt{PDHG} algorithm with iteration-varying step sizes, converges at a rate near $O(1/k^2)$. Furthermore, for the specific setting where $\tau_{k+1}\sigma_k = s^2$ and $\theta_k = \tau_{k+1}/\tau_k \in (0, 1)$ as proposed in~\citep{chambolle2011first}, an even faster convergence rate of $O(1/k^2)$ can be achieved. To substantiate these findings, we design a novel discrete Lyapunov function. This function is distinguished by its succinctness and straightforwardness, providing a clear and elegant proof of the enhanced convergence properties of the \texttt{PDHG} algorithm under the specified conditions. Finally, we utilize the discrete Lyapunov function to establish the optimal linear convergence rate when both the objective functions are strongly convex. 
3: \end{abstract}
4: