1: \begin{abstract}

2: We provide new adaptive first-order methods for constrained convex

3: optimization. Our main algorithms $\adaacsa$ and $\adaagdplus$ are

4: accelerated methods, which are universal in the sense that they achieve

5: nearly-optimal convergence rates for both smooth and non-smooth functions,

6: even when they only have access to stochastic gradients. In addition,

7: they do not require any prior knowledge on how the objective function

8: is parametrized, since they automatically adjust their per-coordinate

9: learning rate. These can be seen as truly accelerated $\adagrad$

10: methods for constrained optimization.

11: 

12: We complement them with a simpler algorithm $\adagradplus$ which

13: enjoys the same features, and achieves the standard non-accelerated

14: convergence rate. We also present a set of new results involving adaptive

15: methods for unconstrained optimization and monotone operators. 

16: \end{abstract}

17: