bfafa9551394ddcf.tex
1: \begin{abstract}
2: Gradient-based first-order convex optimization algorithms find widespread applicability in a variety of domains, including machine learning tasks. Motivated by the recent advances in fixed-time stability theory of continuous-time dynamical systems, we introduce a generalized framework for designing accelerated optimization algorithms with strongest convergence guarantees that further extend to a subclass of non-convex functions. In particular, we introduce the \emph{GenFlow} algorithm and its momentum variant that provably converge to the optimal solution of objective functions satisfying the Polyak-Ɓojasiewicz (PL) \co{inequality in a fixed time}. Moreover\co{,} for functions that admit non-degenerate saddle-points, we show that for the proposed GenFlow algorithm, the time required to evade these saddle-points is uniformly bounded for all initial conditions. Finally, for strongly convex-strongly concave minimax problems whose optimal solution is a saddle point, a similar scheme is shown to arrive at the optimal solution again in a fixed time. The superior convergence properties of our algorithm are validated experimentally on a variety of benchmark datasets. %The time of convergence has an intuitive dependence on the hyperparameters of the optimization algorithm. The superior convergence properties of our algorithm are validated experimentally on a variety of benchmark datasets. This work highlights how connections between optimization algorithms and continuous-time dynamical systems can be leveraged to design and analyze convergence behavior of optimization algorithms.
3: \end{abstract}
4: