Abstract
Researchers from The Ohio State University have introduced Local Degree Profile (LDP), a linear-time graph representation that requires zero training. This simple baseline performs comparably to, and sometimes better than, state-of-the-art Graph Neural Networks (GNNs) and complex graph kernels on popular social network benchmarks. These findings suggest that current datasets may not be sufficiently challenging to justify the complexity of modern deep learning models for graph classification.
Introduction
The field of graph classification has recently shifted toward increasingly sophisticated methods, primarily divided into mathematical graph kernels and deep Graph Neural Networks (GNNs). However, as these models grow in complexity and computational cost, it becomes difficult to discern which components drive performance. Are improvements due to the expressive power of deep learning, or are benchmark datasets simple enough that basic structural statistics suffice? To address this, the authors developed the Local Degree Profile (LDP), the simplest meaningful baseline, to test the limits of current benchmarks.
The Local Degree Profile (LDP) Method
LDP relies exclusively on node degrees—the number of neighbors a node has—avoiding backpropagation or complex spectral theory. For every node $v$ in a graph, the method examines its "1-neighborhood" and calculates five statistics:
- Degree($v$): The node's own degree.
- Min: The minimum degree among its neighbors.
- Max: The maximum degree among its neighbors.
- Mean: The average degree of its neighbors.
- Standard Deviation: The variation in neighbor degrees.
These features are aggregated into histograms or empirical distribution functions to represent the entire graph. The resulting vectors are then fed into a standard Support Vector Machine (SVM).
Crucially, LDP extraction is a linear-time process, $O(E)$, where $E$ is the number of edges. This makes it as fast as reading the graph data itself, offering a massive efficiency advantage over kernels with $O(V^3)$ or higher complexity.
Experimental Results
The authors evaluated LDP on two categories of benchmarks: non-attributed social networks (e.g., IMDB, REDDIT) and attributed bioinformatics datasets (e.g., MUTAG, PROTEINS).
Performance on Social Networks
On social network datasets, LDP frequently matched or outperformed state-of-the-art GNNs like Graph Isomorphism Networks (GIN) and DiffPool. For instance, on the REDDIT-BINARY dataset, LDP achieved 92.1% accuracy, nearly identical to GIN’s 92.4%.
Performance on Attributed Graphs
While LDP is designed for non-attributed graphs, it remains competitive on chemical and biological datasets when augmented with node labels. However, its performance is generally lower in these domains compared to specialized kernels, as local degree information alone is often insufficient for capturing complex molecular properties.
Discussion and Insights
The success of LDP offers several critical insights for the graph learning community:
- GNNs as Feature Aggregators: LDP can be interpreted as a 2-layer GNN with fixed, non-trainable weights. Its high performance suggests that for many tasks, the structural information in the neighborhood is more critical than the learned weights.
- Robustness: Unlike the Weisfeiler-Lehman (WL) kernel, which uses exact hashing and can be sensitive to minor graph perturbations, LDP’s use of continuous statistics makes it more robust.
- Benchmark Limitations: The fact that a simple histogram of degrees can rival deep GNNs suggests that current social network benchmarks may be "too easy." They may primarily be distinguishable by local degree distributions rather than global structural patterns.
Conclusion
LDP serves as a powerful reminder of the importance of strong baselines. While it struggles with global structures—such as long-range paths—its efficiency and performance on standard benchmarks are remarkable. The authors call for the development of more diverse and complex "ImageNet-scale" graph datasets. Until such benchmarks are available, any new GNN architecture should be measured against LDP to ensure its complexity provides genuine value.
Summary updated