1: \begin{abstract}

2:   In this paper, we introduce the tamed stochastic gradient descent method (TSGD) for

3:   optimization problems. Inspired by the tamed Euler scheme, which is a 

4:   commonly used method within the context of stochastic differential equations, TSGD

5:   is an explicit scheme that exhibits stability properties similar to those of implicit

6:   schemes. As its computational cost is essentially equivalent to that of the well-known

7:   stochastic gradient descent method (SGD), it constitutes a very competitive alternative

8:   to such methods.

9:     

10:   We rigorously prove (optimal) sub-linear convergence of the scheme for strongly convex

11:   objective functions on an abstract Hilbert space. The analysis only requires very mild 

12:   step size restrictions, which illustrates the good stability properties.

13:   The analysis is based on a priori estimates more frequently encountered in a time

14:   integration context than in optimization, and this alternative approach provides a

15:   different perspective also on the convergence of SGD. Finally, we demonstrate the

16:   usability of the scheme on a problem arising in a context of supervised learning.

17:   

18: \end{abstract}

19: