1: \begin{abstract}

2:     % We analyze the spectral neural network and its approximation and optimization regime. Specifically, we quantify the number of neurons to approximate the eigenvector is exponential to the embedded dimension. Though nonconvex in the Euclidean space, the ambient optimization problem is shown to be convex in a Riemannain space. The simulation results are provided to support the convex optimization regime. Furthermore, we show that by solving the parameterized optimization problem, the approximated solution is close to the eigenvector. Our result show the benignness of the training process and the representation power of spectral neural network.

3: 

4: 

5: There is a large variety of machine learning methodologies that are based on the extraction of spectral geometric information from data. However, the implementations of many of these methods often depend on traditional eigensolvers, which present limitations when applied in practical online big data scenarios. To address some of these challenges, researchers have proposed different strategies for training neural networks as alternatives to traditional eigensolvers, with one such approach known as Spectral Neural Network (SNN). In this paper, we investigate key theoretical aspects of SNN. First, we present quantitative insights into the tradeoff between the number of neurons and the amount of spectral geometric information a neural network learns. Second, we initiate a theoretical exploration of the optimization landscape of SNN's objective to shed light on the training dynamics of SNN. Unlike typical studies of convergence to global solutions of NN training dynamics, SNN presents an additional complexity due to its non-convex ambient loss function.

6: 

7: 

8: 

9:  

10: 

11: 

12: 

13:     

14: \end{abstract}

15: