1: \begin{abstract}
2: Recently, significant progress has been made regarding the statistical understanding of artificial neural networks (ANNs). ANNs are motivated by the functioning of the brain, but differ in several crucial aspects. In particular, the locality in the updating rule of the connection parameters in biological neural networks (BNNs) makes it biologically implausible that the learning of the brain is based on gradient descent. In this work, we look at the brain as a statistical method for supervised learning. The main contribution is to relate the local updating rule of the connection parameters in BNNs to a zero-order optimization method. It is shown that the expected values of the iterates implement a modification of gradient descent.
3:
4: %In the linear regression model, we derive convergence rates for such a scheme. We observe different regimes in the convergence rate and for suitable choices of hyperparameters, the curse of dimensionality can be avoided.
5: \end{abstract}
6: