UFO: A Unified Flow-Oriented Framework for Robust Continual Graph Learning

Danhui Zhang, Zhe Wang, Qing Qing, Jiarui Liu, Wentao Gao, Ziqi Xu, Mingliang Hou, Xikun Zhang, Renqiang LuoarXiv 2026 · arXiv

TL;DR

Continual graph learning methods usually assume clean training data, but real-world data streams are often noisy, leading to a phenomenon called catastrophic remembering where models persistently reinforce corrupted knowledge. To solve this, the authors introduce UFO (Unified Flow-Oriented framework), which uses conditional normalizing flows to generate privacy-preserving feature replays while simultaneously scoring and down-weighting noisy samples. UFO consistently outperforms existing methods in both accuracy and retention across multiple benchmark datasets under heavy label noise.

What Problem Does This Paper Address?

Graphs in the real world—like social networks, citation webs, and financial transaction logs—are inherently dynamic and evolve over time. Continual Graph Learning (CGL) aims to train Graph Neural Networks (GNNs) on these sequential data streams. However, standard CGL setups suffer from two major flaws when deployed in the wild:

  1. Catastrophic Forgetting: Privacy constraints and storage limits usually mean historical graph data cannot be saved, causing the model to forget past tasks as it learns new ones.
  2. Noisy Supervision: Real-world data is messy, often containing over 30% incorrect or corrupted labels. On graphs, this is uniquely destructive: the message-passing mechanism of GNNs propagates and amplifies these label errors across entire node neighborhoods.

This amplification forces the model to memorize incorrect information, causing a newly identified failure mode: catastrophic remembering, where noise from new tasks permanently disrupts and corrupts the model's overall knowledge base. Existing methods handle either forgetting or noise, but rarely both simultaneously.

Methods

The authors propose UFO (Unified Flow-Oriented framework), a method that addresses both forgetting and noise by learning and leveraging the underlying feature distributions of graph data.

Figure 1: The framework of UFO: (1) The flow models feature distributions over sequential graphs and generates features for previous tasks. (2) Relative scores are computed using ft and ft−1, and are used to modulate Lnew and Lold for instance-level adaptation. (3) Knowledge preservation constraints maintain structural and semantic consistency across tasks.

UFO consists of three interconnected modules:

  • The Modeling of Flow (Generative Replay): Instead of storing raw historical nodes (which violates privacy), UFO trains a conditional normalizing flow model. This model learns an invertible mapping between complex graph feature distributions and a simple standard Gaussian latent space. To mitigate forgetting, the model samples from this latent space and runs the flow in reverse to synthesize realistic historical features for replay.
  • Two-Stage Instance-Level Adaptation: Normalizing flows provide exact likelihood estimations. UFO leverages this by calculating the conditional log-likelihood of a node's features given its observed label. If a label is noisy, its feature-label alignment will be poor, yielding a low likelihood. UFO converts these likelihoods into relative reliability scores to down-weight corrupted samples during training on both new data ($\mathcal{L}_{new}$) and generated replay data ($\mathcal{L}_{old}$).
  • Graph Knowledge Preservation: To prevent the latent space from shifting over time, UFO uses an embedding alignment loss ($\mathcal{L}_E$) to anchor node representations and a Kullback–Leibler (KL) divergence distillation loss ($\mathcal{L}_L$) to pass soft semantic knowledge from the previous task's classifier to the current one.

Datasets

UFO was evaluated on four widely used real-world graph benchmarks:

  • CoraFull: A large academic citation network (70 classes, split into 10 tasks).
  • CS: An author collaboration network from the Microsoft Academic Graph (15 classes, split into 5 tasks).
  • WikiCS: A hyperlink network based on Wikipedia computer science topics (10 classes, split into 5 tasks).
  • Photo: An Amazon co-purchase network for photographic products (8 classes, split into 4 tasks).

To simulate real-world imperfections, the authors injected both symmetric noise (randomly swapping labels) and pair-flipping noise (swapping labels with visually/thematically similar classes) at 15% and 30% ratios.

Key Insights and Ideas

  • The "Dual-Use" of Normalizing Flows: The core elegance of UFO lies in using normalizing flows for two completely different tasks at once. Their generative capacity solves catastrophic forgetting (via feature replay), while their density estimation capacity solves label noise (by acting as an anomaly detector for mismatched feature-label pairs).
  • Catastrophic Remembering as a Systemic Disease: The paper highlights that label noise isn't just a local training issue; in a continual learning setup, it acts as a virus. If a model aggressively learns from a noisy task, it permanently bakes those corrupted correlations into its weights, degrading performance on all past and future tasks.
  • Graph Noise Amplification: Because GNNs aggregate neighborhood features, a single noisy label poisons an entire neighborhood. UFO's instance-level weighting effectively isolates these "super-spreader" noisy nodes before their errors can cascade through the message-passing layers.

Key Results

UFO was compared against eight baselines spanning standard CGL methods (like LwF, ERGNN, DSLR, DMSG) and robust label-noise methods (like CLNode, TSS, TFR).

  • Superior Accuracy under High Noise: On the CoraFull dataset with 30% label noise, UFO achieved an average accuracy of 77.77%, outperforming the best CGL baseline (DMSG at 59.71%) and completely blowing away robust learning baselines which hovered around 25-34%.
  • Stable Forgetting Metrics: While robust learning methods suffered massive forgetting (up to -55% retention) because they lack replay mechanisms, UFO maintained a tight, stable forgetting rate (around -6% to -7% on CoraFull) regardless of whether the noise was 0%, 15%, or 30%.
Performance matrices on CoraFull with 30% noise, demonstrating UFO's stability across sequential tasks compared to baselines.

As shown in the performance matrices above, UFO maintains a significantly darker, more stable accuracy matrix across sequential tasks, demonstrating its ability to balance forgetting and noise resistance.

Limitations and Future Work

The authors openly acknowledge two primary limitations of UFO:

  1. Loss of Explicit Topology: UFO performs replay entirely within the feature space. It does not explicitly reconstruct historical graph topologies (like past edges or exact neighborhood structures), which might limit its ability to fully recover complex structural knowledge.
  2. Hyperparameter Sensitivity: The framework relies heavily on the architecture of the normalizing flow. If the flow is too deep, optimization difficulty and computational costs skyrocket. Finding the right balance of flow layers requires careful tuning.

Future work will likely focus on extending generative replay to explicitly capture evolving graph topologies alongside feature distributions.

Summary updated

Abstract

Graph learning research has increasingly shifted toward continual graph learning (CGL), which better reflects real-world scenarios where graphs evolve over time. However, existing CGL methods largely assume clean supervision and overlook a critical challenge: the newly arriving portions of the graph are often noisy, due to annotation errors or adversarial corruption. This mismatch limits their applicability in practice. In this work, we study robust continual graph learning, where models must simultaneously handle catastrophic forgetting and noisy supervision in evolving graph data. We show that label noise introduces a new failure mode, catastrophic remembering, where models persistently reinforce corrupted knowledge across tasks. To address these challenges, we propose a Unified Flow-Oriented framework (UFO). First, UFO models conditional feature distributions via flow-based generative modeling and produces replay representations, mitigating forgetting without storing historical data. Second, UFO estimates instance-level reliability scores to distinguish clean from noisy nodes, reducing the impact of corrupted supervision and alleviating catastrophic remembering. Extensive experiments on four benchmark graph datasets under varying noise ratios demonstrate that UFO consistently outperforms existing methods in both accuracy and forgetting metrics. Code is available at: https://anonymous.4open.science/r/UFO.
BibTeX
@misc{zhang2026ufo,
  author = {Danhui Zhang and Zhe Wang and Qing Qing and Jiarui Liu and Wentao Gao and Ziqi Xu and Mingliang Hou and Xikun Zhang and Renqiang Luo},
  title = {{UFO: A Unified Flow-Oriented Framework for Robust Continual Graph Learning}},
  year = {2026},
  eprint = {2605.09862},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2605.09862},
}
Figure