406f7d1c16933ebf.tex
1: \begin{abstract}
2: We consider over-the-air convex optimization
3: on a $d-$dimensional space
4: where coded gradients are sent over an additive Gaussian noise channel
5: with variance $\sigma^2$.
6: The codewords satisfy an average power constraint $P$,  resulting in the signal-to-noise ratio (SNR)
7: of $P/\sigma^2$. 
8: We derive bounds for the convergence rates for over-the-air optimization.
9: Our first result is a lower bound
10: for the convergence rate showing that any code must {slowdown}
11: the convergence rate
12: by a factor of roughly $\sqrt{d/\log(1+\SNR)}$.
13: Next, we consider  a popular class of schemes called \emph{analog coding}, where a linear function of the gradient is sent.  
14: We show that a simple scaled transmission analog coding scheme results in a slowdown in convergence rate by
15: a factor of $\sqrt{d(1+1/\SNR)}$. This matches the previous lower
16: bound up to constant factors for low SNR, making the scaled transmission scheme optimal
17: at low SNR. However, we show that this slowdown is necessary for any analog coding scheme.
18: In particular, a slowdown in convergence by a factor of $\sqrt{d}$ for analog coding remains even
19: when SNR tends to infinity.
20: Remarkably, we present a simple quantize-and-modulate scheme that uses \emph{Amplitude Shift Keying}
21: and almost attains the optimal convergence rate at all SNRs.
22: \end{abstract}
23: