71aa0c3d94b8bb95.tex
1: \begin{abstract}
2: We present $\textit{Free-MESSAGE}^{p}$, the first zeroth-order algorithm
3: for convex mean-semideviation-based risk-aware learning, which is
4: also the first three-level zeroth-order compositional stochastic optimization
5: algorithm, whatsoever. Using a non-trivial extension of Nesterov\textquoteright s
6: classical results on Gaussian smoothing, we develop the $\textit{Free-MESSAGE}^{p}$
7: algorithm from first principles, and show that it essentially solves
8: a smoothed surrogate to the original problem, the former being a uniform
9: approximation of the latter, in a useful, convenient sense. We then
10: present a complete analysis of the $\textit{Free-MESSAGE}^{p}$ algorithm,
11: which establishes convergence in a user-tunable neighborhood of the
12: optimal solutions of the original problem, as well as explicit convergence
13: rates for both convex and strongly convex costs. Orderwise, and for
14: fixed problem parameters, our results demonstrate no sacrifice in
15: convergence speed compared to existing first-order methods, while
16: striking a certain balance among the condition of the problem, its
17: dimensionality, as well as the accuracy of the obtained results, naturally
18: extending previous results in zeroth-order risk-neutral learning.
19: \end{abstract}
20: