1: \begin{abstract}

2: 

3:  One of the major concerns for  neural network training is that the non-convexity of the associated loss functions  may cause bad landscape. The recent success of neural networks suggests that their loss  landscape  is not too bad, but what specific results do we know about the landscape?  In this article, we review recent findings and results on the global landscape of neural networks. 

4:   First, we point out that wide neural nets may have sub-optimal local minima under certain assumptions. 

5:   Second, we discuss a few rigorous results on the geometric properties of wide networks such as ``no bad basin'', and some modifications that eliminate sub-optimal local minima and/or   decreasing paths to infinity. 

6:  Third, we discuss visualization and empirical explorations of the landscape for practical neural nets.  Finally, we briefly discuss some convergence results and  their relation to landscape results. 

7:    

8: 

9: \end{abstract}

10: