1: \begin{abstract}
2: We study local complexity measures for stochastic convex optimization
3: problems, providing a local minimax theory analogous to that of
4: H\'{a}jek and Le Cam for classical statistical problems.
5: We give complementary optimality results,
6: developing fully online methods
7: that adaptively achieve optimal convergence guarantees. Our results provide
8: function-specific lower bounds and convergence results that make precise
9: a correspondence between statistical difficulty and the geometric notion
10: of tilt-stability from optimization. As
11: part of this development, we show how variants of Nesterov's dual
12: averaging---a stochastic gradient-based procedure---guarantee finite
13: time identification of constraints in optimization problems, while
14: stochastic gradient procedures fail. Additionally, we
15: highlight a gap between problems with linear and nonlinear
16: constraints: standard stochastic-gradient-based procedures are
17: suboptimal even for the simplest nonlinear constraints, necessitating
18: the development of asymptotically optimal
19: Riemannian stochastic gradient methods.
20: \end{abstract}
21: