1: \begin{abstract}

2:   We develop a new reduction that converts any online convex optimization algorithm suffering $O(\sqrt{T})$ regret into an $\epsilon$-differentially private stochastic convex optimization algorithm with the optimal convergence rate $\tilde O(1/\sqrt{T} + \sqrt{d}/\epsilon T)$ on smooth losses in linear time, forming a direct analogy to the classical non-private ``online-to-batch'' conversion. 

3: %   In the $\mu$-strongly-convex case, the same argument converts algorithms achieving $O(\log(T)/\mu)$ regret into stochastic optimization algorithms achieving a convergence rate $\tilde O(1/\mu T + 1/\mu\epsilon^2T^2)$. 

4: By applying our techniques to more advanced adaptive online algorithms, we produce adaptive differentially private counterparts whose convergence rates depend on apriori unknown variances or parameter norms.

5: \end{abstract}

6: