1: \begin{abstract}

2:   Standard stochastic optimization methods are brittle, sensitive to

3:   stepsize choices and other algorithmic parameters, and they exhibit

4:   instability outside of well-behaved families of objectives. To address

5:   these challenges, we investigate models for stochastic optimization and

6:   learning problems that exhibit better robustness to problem families and

7:   algorithmic parameters. With appropriately accurate models---which we call

8:   the \aProx family~\cite{AsiDu18}---stochastic methods can be made stable,

9:   provably convergent and asymptotically optimal; even modeling

10:   that the objective is nonnegative is sufficient for this

11:   stability. We extend these results beyond convexity to weakly convex

12:   objectives, which include compositions of convex losses with smooth

13:   functions common in modern machine learning applications. We highlight the

14:   importance of robustness and accurate modeling with a careful experimental

15:   evaluation of convergence time and algorithm sensitivity.

16: \end{abstract}