Schatten Graph Neural Networks

Youfa Liu, Yongyong Chen, Guo Chen, Jiawei ZhangIEEE Access 2022 · DOI · OpenReview

Abstract

Graph Neural Networks (GNNs) have been intensively studied in recent years because of their promising performance over graph-structural data and have provided assistance in many fields. Recalling recent works on graph neural networks, we found that imposing graph smoothing via Frobenius norm was proven to be effective in the architecture of graph neural networks from the standpoint of the graph signal processing. In this paper, we aim to model the graph smoothness of graph neural networks using a Schatten <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$p$ </tex-math></inline-formula> -norm with <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$p$ </tex-math></inline-formula> in the interval <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$[1,2$ </tex-math></inline-formula> ) to characterize smoothness and propose a novel architecture called Schatten graph neural networks. This architecture stems from a primal-dual solution scheme for a graph signal denoising problem. There is difficulty in solving subproblems with respect to the Schatten <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$p$ </tex-math></inline-formula> -norm. We propose a fixed point iteration scheme and prove that it tracks with the linear convergence rate with solid mathematical analysis. Extensive experiments demonstrate the effectiveness of the proposed architecture of graph neural networks and their robustness to the graph adversarial attacks.
BibTeX
@article{liu2022schatten,
  author = {Youfa Liu and Yongyong Chen and Guo Chen and Jiawei Zhang},
  title = {{Schatten Graph Neural Networks}},
  journal = {IEEE Access},
  year = {2022},
  doi = {10.1109/access.2022.3176634},
}

Loading related content...

Figure