1: \begin{abstract}

2:   We present a novel method for convex unconstrained optimization that, \emph{without any modifications}, ensures: \textbf{(i)} accelerated convergence rate for smooth objectives, \textbf{(ii)} standard convergence rate in the general (non-smooth) setting, and \textbf{(iii)}   standard convergence rate in the stochastic optimization setting.  To the best of our knowledge, this is the first method that \emph{simultaneously} applies to all of the above settings.  

3:   

4: %At the heart of our method is an adaptive learning rate rule that employs importance weights, in the spirit of   

5: At the heart of our method is an adaptive learning rate rule that employs importance weights, in the spirit of adaptive online learning algorithms  \citep{duchi2011adaptive,levy2017online},  combined with an update  that linearly couples two sequences, in the spirit of~\citep{AllenOrecchia2017}.

6: An empirical examination of our method demonstrates its applicability to the above mentioned scenarios and corroborates our theoretical findings.

7: %\kl{Remover references from abstract?}

8: \end{abstract}

9: