arXiv Analytics

Sign in

arXiv:2310.10064 [cs.LG]AbstractReferencesReviewsResources

Learning Graph Filters for Spectral GNNs via Newton Interpolation

Junjie Xu, Enyan Dai, Dongsheng Luo, Xiang Zhang, Suhang Wang

Published 2023-10-16Version 1

Spectral Graph Neural Networks (GNNs) are gaining attention because they can surpass the limitations of message-passing GNNs by learning spectral filters that capture essential frequency information in graph data through task supervision. However, previous research suggests that the choice of filter frequency is tied to the graph's homophily level, a connection that hasn't been thoroughly explored in existing spectral GNNs. To address this gap, the study conducts both theoretical and empirical analyses, revealing that low-frequency filters have a positive correlation with homophily, while high-frequency filters have a negative correlation. This leads to the introduction of a shape-aware regularization technique applied to a Newton Interpolation-based spectral filter, enabling the customization of polynomial spectral filters that align with desired homophily levels. Extensive experiments demonstrate that NewtonNet successfully achieves the desired filter shapes and exhibits superior performance on both homophilous and heterophilous datasets.

Related articles: Most relevant | Search more
arXiv:2311.18177 [cs.LG] (Published 2023-11-30)
An Effective Universal Polynomial Basis for Spectral Graph Neural Networks
arXiv:2303.13750 [cs.LG] (Published 2023-03-24)
LONGNN: Spectral GNNs with Learnable Orthonormal Basis
arXiv:2401.09071 [cs.LG] (Published 2024-01-17)
Rethinking Spectral Graph Neural Networks with Spatially Adaptive Filtering