1: \begin{abstract}
2: This paper considers the fundamental convergence
3: time for opportunistic scheduling over time-varying channels.
4: The channel state probabilities are unknown and algorithms must
5: perform some type of estimation and learning while they
6: make decisions to optimize network utility. Existing schemes can
7: achieve a utility within $\epsilon$ of optimality, for any desired
8: $\epsilon>0$, with convergence
9: and adaptation times of $O(1/\epsilon^2)$. This paper shows that
10: if the utility function is concave and smooth, then
11: $O(\log(1/\epsilon)/\epsilon)$ convergence time is possible
12: via an existing stochastic variation on the Frank-Wolfe algorithm,
13: called the RUN algorithm.
14: Next, a converse result is proven to show it is impossible for any algorithm
15: to have convergence time better than $O(1/\epsilon)$, provided the algorithm
16: has no a-priori knowledge of channel state probabilities. Hence, RUN is
17: within a logarithmic factor of convergence time optimality.
18: However, RUN has a vanishing stepsize and hence has an
19: infinite adaptation time. Using stochastic Frank-Wolfe with a fixed stepsize
20: yields improved $O(1/\epsilon^2)$ adaptation
21: time, but convergence time increases to $O(1/\epsilon^2)$, similar
22: to existing drift-plus-penalty based algorithms. This raises important open questions
23: regarding optimal adaptation.
24: \end{abstract}