39427cea279afa5d.tex
1: \begin{abstract}
2: This paper presents a new regularization approach -- termed \emph{OpReg-Boost} -- to boost the convergence of online optimization and learning algorithms. In particular, the paper considers online  algorithms for optimization problems with a time-varying (weakly) convex composite cost. For a given online algorithm, OpReg-Boost learns the closest algorithmic map that yields linear convergence; to this end, the learning procedure hinges on the concept of \emph{operator regression}. We show how to formalize the operator regression problem and propose a computationally-efficient Peaceman-Rachford solver that exploits a closed-form solution of simple quadratically-constrained quadratic programs (QCQPs). Simulation results showcase the superior properties of OpReg-Boost w.r.t. the more classical forward-backward algorithm, FISTA, and Anderson acceleration.%, and with respect to its close relative convex-regression-boost (CvxReg-Boost) which is also novel but  less performing.
3: \end{abstract}
4: