1: \begin{abstract}
2: We introduce an efficient first-order primal-dual method for the solution of nonsmooth PDE-constrained optimization problems.
3: We achieve this efficiency through \emph{not} solving the PDE or its linearisation on each iteration of the optimization method.
4: Instead, we run the method interwoven with a simple conventional linear system solver (Jacobi, Gauss–Seidel, conjugate gradients), always taking only \emph{one step} of the linear system solver for each step of the optimization method. The control parameter is updated on each iteration as determined by the optimization method.
5: We prove linear convergence under a second-order growth condition, and numerically demonstrate the performance on a variety of PDEs related to inverse problems involving boundary measurements.
6: \end{abstract}
7: