8ce3ecdb96342fc9.tex
1: \begin{abstract}
2: It is now known that the expressive power of graph convolutional neural nets (GCN) does not grow infinitely with the number of layers.
3: %Instead, the rate of convergence to a subspace spanned by the first eigenvector of the normalized graph Laplacian matrix is characterized by the ``eigen-gap'': the difference between the Laplacian's first two distinct eigenvalues. 
4: Instead, the GCN output approaches a subspace spanned by the first eigenvector of the normalized graph Laplacian matrix with the convergence rate characterized by the ``eigen-gap'': the difference between the Laplacian's first two distinct eigenvalues. 
5: To promote a deeper GCN architecture with sufficient expressiveness, in this paper, given an empirical covariance matrix $\bar{\C}$ computed from observable data, we learn a sparse graph Laplacian matrix $\L$ closest to $\bar{\C}^{-1}$ while maintaining a desirable eigen-gap that slows down convergence.
6: Specifically, we first define a sparse graph learning problem with constraints on the first eigenvector (the most common signal) and the eigen-gap.
7: We solve the corresponding dual problem greedily, where a locally optimal eigen-pair is computed one at a time via a fast approximation of a semi-definite programming (SDP) formulation.
8: The computed $\L$ with the desired eigen-gap is normalized spectrally and used for supervised training of GCN for a targeted task.
9: Experiments show that our proposal produced deeper GCNs and smaller errors compared to a competing scheme without explicit eigen-gap optimization.
10: \end{abstract}
11: