GAN-MDF: A Method for Multi-fidelity Data Fusion in Digital Twins

Lixue Liu, Chao Zhang, Dacheng TaoarXiv 2021 · arXiv

Abstract

Digital twins require high-quality data to accurately mirror physical systems, yet high-fidelity (HF) data is often scarce and expensive to obtain. This paper presents GAN-MDF, a novel Generative Adversarial Network (GAN) framework designed for Multi-fidelity Data Fusion (MDF). By combining a split-generator architecture—comprising a pre-trained low-fidelity (LF) block and a high-fidelity mapping block—with a "supervised-loss trick," GAN-MDF effectively fuses abundant LF data with limited HF samples. Experimental results across ten benchmark problems demonstrate that GAN-MDF significantly outperforms traditional interpolation and machine learning methods in accuracy and robustness, particularly when HF data is extremely limited.

Introduction

Digital twins serve as virtual replicas of physical entities, such as smart factories or robotic systems, enabling real-time monitoring and predictive maintenance. The efficacy of these twins depends on the quality of the underlying data. Researchers typically encounter two data types: High-Fidelity (HF) data, which is accurate but costly, and Low-Fidelity (LF) data, which is abundant but less precise.

The challenge of Multi-fidelity Data Fusion (MDF) is to integrate these disparate sources to build a high-accuracy model. Traditional methods like Kriging interpolation often rely on strict assumptions, such as Gaussian distributions or nested data structures. Standard machine learning models, on the other hand, frequently suffer from overfitting or divergence when HF samples are scarce. GAN-MDF addresses these limitations by leveraging the generative power of adversarial networks tailored for regression tasks.

Methodology

Standard GAN vs. GAN-MDF

A standard Generative Adversarial Network typically generates data from random noise, as shown in the figure below. While effective for generating realistic images, this approach lacks the precision required for scientific data fusion.

A standard GAN architecture where a generator creates fake samples from random noise to fool a discriminator.

In contrast, GAN-MDF utilizes a specialized architecture designed to extract features from LF data before mapping them to HF outputs. The framework consists of two primary components:

  1. The Generator: Unlike the noise-driven generator in standard GANs, the GAN-MDF generator is split into two sub-networks:
  2. LF Block: Pre-trained on the extensive LF dataset to capture the system's underlying physical features. Its weights are frozen after pre-training.
  3. HF Block: Takes the original input concatenated with the features from the LF block to learn the mapping to the HF response.
  4. The Discriminator: Evaluates whether the output is a generated (fake) HF sample or a real HF sample.
The GAN-MDF architecture, illustrating the split generator (LF and HF blocks) and the integration of supervised loss.

The Supervised-Loss Trick

To overcome the inherent instability of GANs in regression tasks, the authors introduce a supervised-loss trick. A supervised loss term ($L_S$) is added to the objective function, penalizing the direct difference between the generator's output and actual HF training samples. This term acts as a guide, ensuring the generator converges toward accurate numerical values rather than just plausible distributions.

Experimental Setup and Results

The performance of GAN-MDF was evaluated against four state-of-the-art methods (co-RBF, H-kriging, LS-MFS, and Hierarchical Regression) across ten test cases, including nine synthetic benchmarks and one real-world malaria parasite rate dataset.

Key Findings

  • Superior Accuracy: GAN-MDF consistently achieved lower Normalized Root Mean Square Error (NRMSE) than competing methods across most test scenarios.
  • Robustness to Scarcity: The model demonstrated remarkable stability with as few as 2 to 5 HF samples. While other methods failed to converge or showed high error rates under extreme scarcity, GAN-MDF remained accurate.
  • Distribution Agnostic: Unlike Gaussian process-based methods, GAN-MDF does not require specific data distribution assumptions, making it highly flexible for diverse engineering applications.
  • Unnested Flexibility: The framework performs effectively even when HF samples are not a subset of the LF data, removing a common constraint in traditional MDF techniques.

Conclusion

GAN-MDF provides a robust and flexible solution for multi-fidelity data fusion in digital twins. By combining feature extraction from LF data with a supervised adversarial training process, it overcomes the limitations of data scarcity and strict mathematical assumptions. Future work will focus on the theoretical underpinnings of the model's success and refining the architecture for even higher-dimensional engineering problems.

Summary updated

Abstract

The Internet of Things (IoT) collects real-time data of physical systems, such as smart factory, intelligent robot and healtcare system, and provide necessary support for digital twins. Depending on the quality and accuracy, these multi-source data are divided into different fidelity levels. High-fidelity (HF) responses describe the system of interest accurately but are computed costly. In contrast, low-fidelity (LF) responses have a low computational cost but could not meet the required accuracy. Multi-fidelity data fusion (MDF) methods aims to use massive LF samples and small amounts of HF samples to develop an accurate and efficient model for describing the system with a reasonable computation burden. In this paper, we propose a novel generative adversarial network for MDF in digital twins (GAN-MDF). The generator of GAN-MDF is composed of two sub-networks: one extracts the LF features from an input; and the other integrates the input and the extracted LF features to form the input of the subsequent discriminator. The discriminator of GAN-MDF identifies whether the generator output is a real sample generated from HF model. To enhance the stability of GAN-MDF's training, we also introduce the supervised-loss trick to refine the generator weights during each iteration of the adversarial training. Compared with the state-of-the-art methods, the proposed GAN-MDF has the following advantages: 1) it performs well in the case of either nested or unnested sample structure; 2) there is no specific assumption on the data distribution; and 3) it has high robustness even when very few HF samples are provided. The experimental results also support the validity of GAN-MDF.
BibTeX
@misc{liu2021gan,
  author = {Lixue Liu and Chao Zhang and Dacheng Tao},
  title = {{GAN-MDF: A Method for Multi-fidelity Data Fusion in Digital Twins}},
  year = {2021},
  eprint = {2106.14655},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2106.14655},
}
Figure