Multi-Channel Fusion Graph Convolutional Networks with pseudo-label for Semi-Supervised Node Classification

Guang Yang2025 · DOI

TL;DR

The researchers propose MCF-GCN, a framework that tackles two major hurdles in graph learning: noisy/incomplete structures and the chronic shortage of labeled data. By generating multiple "views" of a graph and using a sophisticated "Information Gain" filter to create high-quality pseudo-labels, the model significantly outperforms standard Graph Convolutional Networks (GCNs) on benchmark classification tasks.

What Problem Does This Paper Address?

Graph Convolutional Networks (GCNs) are the workhorses of node classification (e.g., predicting the topic of a research paper in a citation network). However, they usually rely on a single, predefined adjacency matrix. If that graph structure is noisy or missing edges, the model’s performance plateaus.

Furthermore, GCNs are often used in semi-supervised settings where only a tiny fraction of nodes are labeled. Learning robust embeddings from such sparse data is difficult. While "pseudo-labeling" (treating high-confidence predictions as ground truth) is a common fix, it often introduces "noise"—if the model is confidently wrong about a node, it poisons its own training process.

Methods

The proposed Multi-Channel Fusion Graph Convolutional Network (MCF-GCN) consists of three integrated modules:

  1. Graph Generation Module: Instead of relying only on the original graph, the authors create two additional versions:
  2. Edge-Augmented Fusion Graph ($G_T$): They randomly remove and add edges to capture multi-order relationships and "reconstruct" latent patterns.
  3. Multi-Scale Feature Fusion Graph ($G_F$): They build a graph based on the cosine similarity of node features, helping the model find "neighbors" that might not be connected in the original topology but share similar characteristics.
  4. Multi-Channel Fusion Module: The model runs three parallel GCN encoders (one for the original graph and one for each generated graph). To ensure these different views don't drift too far apart, the authors apply a consistency constraint (an $L_2$ loss) that minimizes the distance between the embeddings.
  5. Pseudo-Label Generation Module: To solve label sparsity, they don't just pick the most likely class. They use:
  6. Confidence Propagation: Smoothing predictions across the graph so that labels are consistent with the local structure.
  7. Information Gain (IG) Filtering: This is the "secret sauce." They calculate an IG score based on how well a node’s pseudo-label aligns with its neighbors' predictions. Only the most "reliable" nodes (top $k$ per class) are added to the training set.

Datasets

The authors evaluated their model on three gold-standard citation network benchmarks:

  • Cora: 2,708 nodes, 5,429 edges, 7 classes.
  • CiteSeer: 3,327 nodes, 4,732 edges, 6 classes.
  • PubMed: 19,717 nodes, 443,328 edges, 3 classes.

In all cases, they used the standard split of only 20 labeled instances per class for training.

Key Insights and Ideas

  • The Power of Multi-View Learning: The paper demonstrates that the "raw" graph is rarely the optimal one. By looking at the data through the lenses of both topology (edges) and feature similarity (content), the model captures complementary information that a single GCN misses.
  • Quality Over Quantity in Pseudo-Labels: Most pseudo-labeling schemes fail because they trust the model's internal "confidence" (softmax output), which is often poorly calibrated. By introducing the Information Gain score, the authors force the model to check with the "neighborhood" before committing to a label.
  • Stability via Consistency: By enforcing that the three different channels produce similar embeddings, the model avoids overfitting to the noise introduced during the graph augmentation process.

Key Results

MCF-GCN consistently outperformed baselines like GAT, SGC, and even other multi-scale encoders (N-GCN, MOGCN).

  • Accuracy Boost: On the Cora dataset, the model achieved 85.60% accuracy, a significant jump over the standard GCN's 81.51%.
  • Ablation Success: Removing the pseudo-labeling module (GCN #A) or the multi-channel module (GCN #B) led to lower scores, proving that both structural augmentation and data augmentation are necessary for peak performance.
  • Visual Clarity: t-SNE visualizations in the paper show that MCF-GCN produces much tighter, more distinct clusters with clearer boundaries between classes compared to standard GCN or Graph Attention Networks (GAT).

Limitations and Future Work

While the results are impressive, the paper leaves a few stones unturned:

  • Hyperparameter Sensitivity: The model introduces several new hyperparameters (the smoothing factor $\alpha$, the threshold $\tau$, and the number of pseudo-labels $k$). The authors perform a sensitivity analysis, but finding the "sweet spot" for a new dataset might require significant tuning.
  • Computational Overhead: Running three parallel GCN encoders and a propagation-based filtering module is naturally more computationally expensive than a single-stream GCN. The authors do not provide a detailed analysis of training time or memory scaling for much larger graphs.
  • Future Directions: The authors suggest that the information gain filtering mechanism could be further refined to handle even noisier real-world datasets.

Summary updated

Abstract

Graph Convolutional Networks GCNs have shown great promise in semi-supervised node classification tasks. However, existing Graph Convolutional Networks GCNs face two key challenges: 1 While addressing the limitations of incomplete or noisy graph structures, the structural information of the graph remains underutilized 2 the scarcity of labeled data, limiting the ability to learn comprehensive embeddings. To address these issues, we propose a novel Multi-channel Fusion Graph Convolutional Networks with pseudo-label, which learn a connected embedding by fusing the multi-channel graphs information and node features. First, to explore the latent information within the original data, we design a graph generation module to extend and reconstruct the original data into multiple graphs. Meanwhile, a multi-channel approach is employed to embed and fuse these graphs, capturing the complementarity across different channels. Second, to address the issue of label sparsity, we design a confidence propagation-based information gain filtering module to generate high-quality pseudo-labels. Extensive experiments on three benchmark datasets demonstrate that our method outperforms other approaches.
BibTeX
@misc{yang2025multi,
  author = {Guang Yang},
  title = {{Multi-Channel Fusion Graph Convolutional Networks with pseudo-label for Semi-Supervised Node Classification}},
  year = {2025},
  doi = {10.65286/icic.v21i2.62782},
}
Figure