1: \begin{abstract}

2: We propose a Randomized Progressive Training algorithm (RPT) -- a stochastic proxy for the well-known Progressive Training method (PT) \citep{progrssiveKarras}.

3: Originally designed to train GANs \cite{goodfellow2014generative}, PT was proposed as a heuristic, with no convergence analysis even for the simplest objective functions. On the contrary, to the best of our knowledge,

4: RPT is the first PT-type algorithm with rigorous and sound theoretical guarantees for general smooth objective functions. We cast our method into the established framework of Randomized Coordinate Descent (RCD) \citep{nesterovRCD, richtarikRCD}, for which (as a by-product of our investigations) we also propose a novel, simple

5: and general convergence analysis encapsulating strongly-convex, convex and nonconvex objectives. We then use this framework to establish a convergence theory for RPT.

6: Finally, we validate the effectiveness of our method through extensive computational experiments.

7: 

8: \end{abstract}

9: