1299554ab39f293d.tex
1: \begin{abstract}
2: Inertial algorithms for minimizing nonsmooth and nonconvex functions
3: as the inertial proximal alternating linearized minimization algorithm (iPALM)
4: have demonstrated their superiority with respect to computation time over their non inertial variants.
5: In many  problems in imaging and machine learning, 
6: the objective functions have a special form involving huge data which encourage the
7: application of stochastic algorithms. While algorithms based on stochastic gradient descent are still used in the
8: majority of applications, recently also stochastic algorithms for minimizing nonsmooth and nonconvex functions
9: were proposed.
10: 
11: In this paper, we derive an inertial variant of a stochastic PALM algorithm 
12: with variance-reduced gradient estimator, called iSPALM, 
13: and prove linear convergence of the algorithm under certain assumptions.
14: Our inertial approach can be seen as generalization of momentum methods widely used to speed up and stabilize optimization algorithms, in particular in machine learning,
15: to nonsmooth problems. 
16: Numerical experiments for learning the weights of a so-called
17: proximal neural network and the parameters of Student-$t$ mixture models 
18: show that our new algorithm outperforms both 
19: stochastic PALM and 
20: its deterministic counterparts.
21: \end{abstract}
22: