ef13d4d944f31bde.tex
1: \begin{abstract}
2:     Implicit graph neural networks (GNNs) have emerged as a potential approach to enable GNNs to capture long-range dependencies effectively.
3:     %
4:     However, poorly designed implicit GNN layers can experience over-smoothing or may have limited adaptability to learn data geometry, potentially hindering their performance in graph learning problems. 
5:     %
6:     To address these issues, we introduce a geometric framework to design implicit graph diffusion layers based on a parameterized graph Laplacian operator. 
7:     %
8:     Our framework allows learning the geometry of vertex and edge spaces, as well as the graph gradient operator from data.
9:     %
10:     We further show how implicit GNN layers can be viewed as the fixed-point solution of a Dirichlet energy minimization problem and give conditions under which it may suffer from over-smoothing.
11:     %which can suffer from \textit{feature independence over-smoothing} and \textit{unlabelled over-smoothing}.
12:     %
13:     To overcome the over-smoothing problem, we design our implicit graph diffusion layer as the solution of a Dirichlet energy minimization problem with constraints on vertex features, enabling it to trade off smoothing with the preservation of node feature information.
14:     %capture long-range dependencies without encountering over-smoothing issues. 
15:     %
16:     With an appropriate hyperparameter set to be larger than the largest eigenvalue of the parameterized graph Laplacian, our framework guarantees a unique equilibrium and quick convergence.
17:     %
18:     Our models demonstrate better performance than leading implicit and explicit GNNs on benchmark datasets for node and graph classification tasks, with substantial accuracy improvements observed for some datasets.
19: %    certain heterophilic datasets, i.e., Chameleon and Squirrel.
20: \end{abstract}
21: