1: \begin{abstract}

2: 

3: The communication cost of distributed optimization algorithms is a major bottleneck in their scalability.

4: %

5: This work considers a parameter-server setting in which the worker is constrained to communicate information to the server using only $R$ bits per dimension.

6: %

7: We show that \textbf{democratic embeddings} from random matrix theory are significantly useful for designing efficient and optimal vector quantizers that respect this bit budget.

8: %

9: The resulting polynomial complexity source coding schemes are used to design distributed optimization algorithms with convergence rates matching the minimax optimal lower bounds for: (i) Smooth and Strongly-Convex objectives with access to an Exact Gradient oracle, as well as (ii) General Convex and Non-Smooth objectives with access to a Noisy Subgradient oracle.

10: %

11: We further propose a relaxation of this coding scheme which is nearly minimax optimal.

12: %

13: Numerical simulations validate our theoretical claims.

14: 

15: \iffalse

16:   The abstract paragraph should be indented \nicefrac{1}{2}~inch (3~picas) on

17:   both the left- and right-hand margins. Use 10~point type, with a vertical

18:   spacing (leading) of 11~points.  The word \textbf{Abstract} must be centered,

19:   bold, and in point size 12. Two line spaces precede the abstract. The abstract

20:   must be limited to one paragraph.

21:  \fi

22:   

23: \end{abstract}

24: