ab39828bcd602318.tex
1: \begin{abstract}
2: 
3:   \noindent In this paper we develop proximal methods for statistical learning.
4:   Proximal point algorithms are useful in statistics and
5:   machine learning for obtaining optimization solutions for composite functions.
6:   Our approach exploits closed-form solutions of proximal operators and
7:   envelope representations based on the Moreau,
8:   Forward-Backward, Douglas-Rachford and Half-Quadratic envelopes. Envelope
9:   representations lead to novel proximal algorithms for statistical
10:   optimisation of composite objective functions which include both non-smooth and
11:   non-convex objectives.  We illustrate our methodology with
12:   regularized Logistic and Poisson regression and non-convex bridge penalties
13:   with a fused lasso norm.  We provide a discussion of convergence of
14:   non-descent algorithms with acceleration and for non-convex functions.  
15:   Finally, we provide directions for future research.
16: 
17:   \vspace{0.1in}
18:   \noindent Keywords: Bayes MAP; shrinkage; sparsity; splitting; fused lasso;
19:   Kurdyka-\L ojasiewicz; non-convex
20:   optimisation; proximal operators; envelopes; regularization;  ADMM;
21:   optimization; Divide and Concur. 
22: \end{abstract}
23: