1: \begin{abstract}
2: % The main goal of this paper it to adapt classical backtracking gradient descent algorithms with backtracking Armijo line-search to stochastic optimization setting, where the objective function We propose a variant of stochastic gradient descent optimization algorithm with backtracking line-search for which we establish framework for analyzing convergence rates of stochastic optimization algorithms based on analyzing an underlying generic stochastic process. We first introduce this framework and the related process and derive a bound on the expected stopping time of this process. Then, we utilize this framework to analyze the bound on expected global convergence rate of a stochastic variant of a traditional trust region method, introduced in \cite{ChenMenickellyScheinberg2014}. While traditional trust region methods rely on exact
3: % computations of the gradient and values of the objective function, this method assumes that these values are available up to some dynamically adjusted accuracy. Moreover, this accuracy is assumed to hold only with some sufficiently large, but fixed, probability, without any additional restrictions on the variance of the errors. This setting applies, for example, to standard stochastic optimization and machine learning formulations. Improving upon the analysis in \cite{ChenMenickellyScheinberg2014}, we show that the stochastic process defined by the algorithm satisfies the assumptions of our proposed general framework, with the stopping time defined as reaching accuracy $\|\nabla f(x)\|\leq \epsilon$. The resulting bound for this stopping time is $O(\epsilon^{-2})$, under the assumption of sufficiently accurate stochastic gradient, and is the first global complexity bound for a stochastic trust-region method.
4: % \end{abstract}
5: