1: \begin{abstract}
2: Recovering a function or high-dimensional parameter vector from indirect measurements
3: is a central task in various scientific areas.
4: Several methods for solving such inverse problems
5: are well developed and well understood.
6: Recently, novel algorithms using deep learning and neural networks for inverse problems appeared.
7: While still in their infancy, these techniques show astonishing performance
8: for applications like low-dose CT or various sparse data problems.
9: However, theoretical results for deep
10: learning in inverse problems are missing so far.
11: In this paper, we establish such a convergence analysis for the proposed
12: NETT (Network Tikhonov) approach to inverse problems.
13: NETT considers regularized solutions having small value of
14: a regularizer defined by a trained neural network. Opposed to existing deep learning approaches,
15: our regularization scheme enforces data consistency also for
16: the actual unknown to be recovered. This is beneficial
17: in case the unknown to be recovered is not sufficiently similar to available training data.
18: We present a complete convergence analysis for NETT, where we derive well-posedness results and quantitative error estimates, and
19: propose a possible strategy for training the regularizer. Numerical results are presented for a
20: tomographic sparse data problem using the $\ell^q$-norm of auto-encoder as
21: trained regularizer, which demonstrate good performance of NETT
22: even for unknowns of different type from the training data.
23:
24: \medskip \noindent \textbf{Keywords:} inverse problems, deep learning, convergence analysis, image reconstruction, convolutional neural networks, $\ell^q$ regularization, total nonlinearity.
25:
26: \medskip \noindent \textbf{AMS subject classifications:}
27: 65J20, 65J22, 45F05
28: \end{abstract}
29: