35ae8b3257b82dc2.tex
1: \begin{abstract}
2: Recovering a function or high-dimensional parameter vector from  indirect  measurements
3: is a  central task in various scientific areas.
4: Several methods for solving such inverse problems
5: are well developed  and well understood.
6: Recently,  novel algorithms using deep learning and neural networks for inverse problems  appeared.
7: While still in their infancy,   these techniques show  astonishing performance
8: for applications  like low-dose CT  or various sparse data problems.
9: However, theoretical  results for deep
10: learning in inverse problems  are missing so far.
11: In this paper,  we establish  such a convergence analysis for the proposed
12: NETT (Network Tikhonov)  approach to inverse problems.
13: NETT considers regularized solutions having  small  value of
14: a regularizer defined by a trained neural network. Opposed to existing deep learning  approaches,
15: our regularization scheme enforces data consistency also for 
16: the actual  unknown to be recovered. This is  beneficial
17: in case the unknown to be recovered is not sufficiently  similar  to available training data.
18: We present a complete convergence analysis for NETT, where we derive well-posedness results  and quantitative error estimates, and 
19: propose  a possible  strategy for training the regularizer. Numerical results are presented for a
20: tomographic sparse data problem using the $\ell^q$-norm of auto-encoder as
21: trained regularizer, which demonstrate good performance of NETT
22: even for unknowns of different type from the  training data.
23: 
24: \medskip \noindent \textbf{Keywords:} inverse problems, deep learning, convergence analysis, image reconstruction, convolutional neural networks, $\ell^q$ regularization, total nonlinearity.
25: 
26: \medskip \noindent \textbf{AMS subject classifications:}
27: 65J20, 65J22, 45F05
28: \end{abstract}
29: