Physics-Informed Machine Learning for Modeling CO2 Capture from Scarce Data

Mickael Gault, Pierre Bachaud, Benoît Celse, Rémi Emonet, Marc Sebban

TL;DR

This paper introduces a novel Physics-Informed Machine Learning (PiML) approach to model CO2 capture in industrial absorption columns, especially when data is scarce. By combining a physics-inspired neural network architecture with physical laws and simulation data, their method achieves significantly better accuracy and generalization than traditional mechanistic models or purely data-driven approaches.

What Problem Does This Paper Address?

Accurately modeling complex industrial processes like CO2 capture is crucial for environmental sustainability, but it's challenging. Mechanistic simulations, while grounded in physics, can be computationally expensive and may not fully capture the intricate phenomena in real-world systems like absorption columns. On the other hand, purely data-driven machine learning models struggle when faced with limited or uncertain industrial data. This paper tackles this "low data regime and inaccurate physical models" problem by developing a hybrid approach that leverages both physical knowledge and available data.

Methods

The core of this work is a Physics-informed Machine Learning (PiML) model that integrates multiple sources of physical knowledge:

  • Physics-Informed Architecture: The neural network architecture is designed to mimic the countercurrent flow structure of the absorption column, with distinct blocks representing packed beds and an intercooler. This physical structure guides how information propagates through the network.
  • Simulation Data: The model is trained using data generated from a mechanistic numerical solver. This provides a baseline understanding of the system's dynamics.
  • Physical Law Regularization: The ideal gas law is embedded as a regularization term in the loss function. This acts as a soft constraint, ensuring that the model's predictions remain physically consistent without requiring complex derivative calculations.

The authors also describe a "Physical Model Augmentation" process where a pre-trained PiML model is fine-tuned using a smaller dataset of empirically corrected industrial data. This allows the model to learn corrections to the initial mechanistic model, improving its accuracy on real-world observations.

Datasets

The paper utilizes two datasets:

  • Initial Dataset (D1): 600 samples simulated by a mechanistic model parameterized solely on laboratory experiments. This dataset is used to train the initial PiML surrogate model.
  • Corrected Dataset (D2): 200 samples simulated by a mechanistic model that has been augmented with empirical correlations to better match industrial observations from the DMXTM unit. This dataset is used for fine-tuning and evaluating the model's ability to adapt to real-world data.

Key Insights and Ideas

  • Architecture Matters: Designing neural network architectures that mirror the physical structure of a system (like the countercurrent flow in an absorption column) can significantly improve performance, especially with limited data.
  • Hybrid is Better: Combining the strengths of mechanistic models (physical consistency) and data-driven models (adaptability to real-world nuances) through PiML offers a powerful solution for complex industrial modeling.
  • Fine-tuning for Real-World Data: Even a small amount of empirically corrected industrial data can be highly effective in fine-tuning a pre-trained PiML model, allowing it to capture subtle deviations from the initial mechanistic model.
  • Generalization Power: The PiML approach demonstrates strong generalization capabilities, performing well even when faced with data that differs from its initial training set, which is crucial for industrial applications.

Key Results

  • The Corrected PiML Surrogate model significantly outperforms the initial mechanistic model, a purely data-driven model, and the initial PiML surrogate when tested on corrected industrial data.
  • In low-data regimes (e.g., 20 training samples), the Corrected PiML Surrogate achieves an MSE one order of magnitude lower than the other models.
  • The R² scores show that the Corrected PiML Surrogate consistently achieves higher accuracy, especially as the training data size increases. For instance, with 100 training samples, it shows a substantial improvement over the other methods.
  • The paper highlights that the data-driven model struggles significantly with limited data, even for a simplified task of predicting outputs at the column's ends.

Limitations and Future Work

  • Analytical Form of Corrections: The current approach fine-tunes parameters of the building block Be. Future work could explore directly modifying the analytical form of the equations within the model to introduce corrections.
  • Incorporating More PDEs: The current model primarily uses the ideal gas law. Future research could investigate incorporating other relevant PDEs (mass and heat transfer, chemical kinetics) into the PiML framework, despite their complexity.
  • Advanced Architectures: The paper used a vanilla Multi-Layer Perceptron. Exploring more expressive architectures like transformer-based models is suggested for enhanced modeling capabilities.

Summary updated

Abstract

Accurate modeling of complex industrial processes often relies on costly mechanistic simulations grounded in physical principles. In this paper, we investigate the subject of <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\text{CO}_{2}$</tex> capture, a major environmental challenge, through the absorption column of an amine-based post-combustion process. The modeling of such unit at industrial scale faces two difficulties: (i) theoretical models, efficient at laboratory scale, might fail to fully reflect the complexity of the numerous intertwined phenomena occurring in the absorber, (ii) the cost and uncertainty of industrial observation data make purely data-driven approaches unfeasible. To tackle both this low data regime and inaccurate physical models, we envision this <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\text{CO}_{2}$</tex> capture problem through the lens of Physics-informed Machine Learning (PiML). We present a hybrid (data+knowledge) model where the scarce observation data complement the physical model, while the latter ensures that the predictions remain physically consistent. Beyond the standard use of simulation data for learning and the embedding of physical laws as regularization, the originality of our PiML algorithm compared to other methods in the literature lies in a physical prior assumption about the network architecture and its countercurrent flow learning process inspired by the column's operation. Our experimental results showcase a significant improvement in accuracy and highlight the potential of our augmented model for generalizing across domains, especially when data is scarce.
BibTeX
@inproceedings{gault2025physics,
  author = {Mickael Gault and Pierre Bachaud and Benoît Celse and Rémi Emonet and Marc Sebban},
  title = {{Physics-Informed Machine Learning for Modeling CO2 Capture from Scarce Data}},
  booktitle = {ICTAI},
  year = {2025},
  doi = {10.1109/ictai66417.2025.00207},
}
Figure