1: \begin{abstract}

2: We study the implicit regularization effects of deep learning in tensor factorization. While implicit regularization in deep matrix and \enquote*{shallow} tensor  factorization via linear and certain type of non-linear neural networks promotes low-rank solutions with at most quadratic growth, we show that its effect in deep tensor factorization grows polynomially with the depth of the network. This provides a remarkably faithful description of the observed experimental behaviour. Using numerical experiments, we demonstrate the benefits of this implicit regularization in yielding a more accurate estimation and better convergence properties. 

3: \end{abstract}

4: