1: \begin{abstract}

2: Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to resolve this issue is to learn these parameters from data. While mathematically appealing this strategy leads to a nested optimization problem (known as bilevel optimization) which is computationally very difficult to handle. \revision{It is common when solving the upper-level problem to assume access to exact solutions of the lower-level problem, which is practically infeasible.} In this work we propose to solve these problems using inexact derivative-free optimization algorithms which never require \revision{exact lower-level problem solutions, but instead assume access to approximate solutions with controllable accuracy, which is achievable in practice}. We \revision{prove} global convergence and \revision{a worst-case complexity bound for } our approach. \revision{We test} our proposed framework on ROF-denoising and learning MRI sampling patterns.

3: Dynamically adjusting the lower-level accuracy yields  learned parameters with similar reconstruction quality as high-accuracy evaluations but with dramatic reductions in computational work (up to 100 times faster in some cases).

4: \keywords{derivative-free optimization \and bilevel optimization \and machine learning \and variational regularization}

5: \subclass{65D18 \and 65K10 \and 68T05 \and 90C26 \and 90C56}

6: \end{abstract}

7: