1: \begin{abstract}
2: Inertial algorithms for minimizing nonsmooth and nonconvex functions
3: as the inertial proximal alternating linearized minimization algorithm (iPALM)
4: have demonstrated their superiority with respect to computation time over their non inertial variants.
5: In many problems in imaging and machine learning,
6: the objective functions have a special form involving huge data which encourage the
7: application of stochastic algorithms. While algorithms based on stochastic gradient descent are still used in the
8: majority of applications, recently also stochastic algorithms for minimizing nonsmooth and nonconvex functions
9: were proposed.
10:
11: In this paper, we derive an inertial variant of a stochastic PALM algorithm
12: with variance-reduced gradient estimator, called iSPALM,
13: and prove linear convergence of the algorithm under certain assumptions.
14: Our inertial approach can be seen as generalization of momentum methods widely used to speed up and stabilize optimization algorithms, in particular in machine learning,
15: to nonsmooth problems.
16: Numerical experiments for learning the weights of a so-called
17: proximal neural network and the parameters of Student-$t$ mixture models
18: show that our new algorithm outperforms both
19: stochastic PALM and
20: its deterministic counterparts.
21: \end{abstract}
22: