1: \begin{abstract}

2: When dealing with difficult inverse problems such as \newtext{inverse rendering}, using Monte Carlo \newtext{estimated gradients} to optimise parameters \newtext{can slow down convergence due to variance.} Averaging many \newtext{gradient} samples in each iteration reduces this variance trivially. However, for problems that require thousands of optimisation iterations, the computational cost \newtext{of this approach rises quickly.}

3: 

4: We derive a theoretical framework for interleaving sampling and optimisation. We \newtext{update and} reuse past samples \newtext{with low-variance finite-difference} estimators that describe the change in the estimated gradients between each iteration. By combining \newtext{proportional} and \newtext{finite-difference} samples, we continuously reduce the variance of our novel gradient meta-estimators throughout the optimisation process. We investigate how our estimator interlinks with Adam and derive a stable combination.

5: 

6: We implement our method for \newtext{inverse path tracing} and demonstrate how our estimator speeds up convergence \newtext{on difficult} optimisation tasks.

7: \end{abstract}

8: