1: \begin{abstract}

2:   Although the \emph{residual method}, or \emph{constrained regularization},

3:   is frequently used in applications, a detailed study of its properties is still missing.

4:   This sharply contrasts the progress of the theory of Tikhonov regularization,

5:   where a series of new results for regularization in Banach spaces

6:   has been published in the recent years.

7:   The present paper intends to bridge the gap between the existing theories

8:   as far as possible.

9:   We develop a stability and convergence theory for the residual method in general topological spaces.

10:   In addition, we prove convergence rates in terms of (generalized)

11:   Bregman distances, which can also be applied to non-convex regularization

12:   functionals.

13: 

14:   We provide three examples that show the applicability of our theory.

15:   The first example is the regularized solution of linear operator equations

16:   on $L^p$-spaces, where we show that the results of Tikhonov regularization

17:   generalize unchanged to the residual method.

18:   As a second example, we consider the problem of density estimation

19:   from a finite number of sampling points,

20:   using the Wasserstein distance as a fidelity term and an entropy measure

21:   as regularization term.

22:   It is shown that the densities obtained in this way depend continuously

23:   on the location of the sampled points and that the underlying density can

24:   be recovered as the number of sampling points tends to infinity.

25:   Finally, we apply our theory to compressed sensing.

26:   Here, we show the well-posedness of the method and derive convergence rates

27:   both for convex and non-convex regularization under rather weak conditions.

28: 

29: \medskip\noindent\textbf{Keywords.}

30: Ill-posed problems, Regularization, Residual Method, Sparsity, Stability,

31: Convergence Rates.

32: 

33: \medskip\noindent\textbf{AMS.}

34: 65J20; 47J06; 49J27.

35: \end{abstract}

36: