Latent Space Simulation for Carbon Capture Design Optimization

Brian R. Bartoldson, Rui Wang, Yucheng Fu, David Widemann, Sam Nguyen, Jie Bao, Zhijie Xu, Brenda Ng

Introduction

Efficient Carbon Capture Systems (CCS) are vital for mitigating climate change. Solvent-based CCS relies on maximizing the gas-solvent Interfacial Area (IA) to optimize CO2 absorption. Traditionally, engineers employ Computational Fluid Dynamics (CFD) to evaluate these designs. However, CFD is computationally expensive; a single simulation of a small reactor section can require an hour on a 96-core supercomputer. This bottleneck makes large-scale design optimization—which requires thousands of iterations—practically impossible. To address this, researchers have developed a neural network surrogate model capable of predicting CFD results with high accuracy at a fraction of the computational cost.

Methodology: Latent Space Simulation

The proposed framework builds upon the Deep Fluids (DF) architecture, utilizing a "Latent Space Simulation" approach to bypass high-resolution pixel-wise calculations. The process involves four primary stages:

  1. Encoding: High-resolution CFD frames (representing liquid-gas volume fractions) are compressed into low-dimensional latent vectors using a convolutional neural network (CNN) encoder.
  2. Conditioning: Simulation parameters, such as inlet velocity ($v$) and time ($t$), are injected into the latent representation.
  3. Latent Integration: A Latent Integration Network (LIN) predicts the temporal evolution of the latent vector.
  4. Decoding: The evolved vector is reconstructed into a full-resolution fluid flow field.
The Latent Space Simulation architecture, illustrating the end-to-end process from encoding to Interfacial Area (IA) computation.

Key methodological improvements include end-to-end training of all components and the adoption of a Relative Error ($L_{RE}$) loss function to better capture fluid boundary nuances compared to standard Mean Squared Error.

Experimental Setup

The model was evaluated using a dataset of 50 CFD simulations of a 2D vertical slice from a Representative Column Model (RCM). The solvent inlet velocity ($v$) served as the primary variable. The dataset was split into 40 training simulations and 10 test simulations to evaluate generalization to unseen configurations. Each simulation spanned 5,000 timesteps, downsampled to 500 frames for training.

Results and Key Insights

The surrogate model achieved a 4000x speedup over traditional CFD solvers, reducing simulation time from an hour to less than a second. Crucially, the model maintained high fidelity, yielding only a 4% relative error in predicting steady-state Interfacial Area on unseen test data.

The Role of Inductive Bias

A significant finding was the superior performance of CNN-based autoencoders over Vision Transformers (ViTs) in this low-data regime. The spatial locality and translation equivariance inherent in CNNs provided a more effective inductive bias than the global attention mechanisms of ViTs when training on limited simulation data.

Comparison of relative error ($L_{RE}$) for different Latent Variable Models (LVMs). CNNs demonstrate superior performance compared to SVD and ViT architectures.

Furthermore, while the model exhibited higher errors during transient, chaotic phases of the simulation, it proved remarkably accurate at predicting the final "steady state" IA—the primary metric for engineering design.

Limitations and Future Directions

While successful, the current model is constrained by its training on a fixed packing geometry. Future work will explore Graph Neural Networks (GNNs) to handle varying reactor geometries more flexibly. Additionally, scaling the framework from 2D slices to full 3D simulations remains a computational challenge for the training phase. Finally, investigating the model's robustness to out-of-distribution inlet velocities remains a priority for industrial deployment.

Summary updated

Abstract

The CO2 capture efficiency in solvent-based carbon capture systems (CCSs) critically depends on the gas-solvent interfacial area (IA), making maximization of IA a foundational challenge in CCS design. While the IA associated with a particular CCS design can be estimated via a computational fluid dynamics (CFD) simulation, using CFD to derive the IAs associated with numerous CCS designs is prohibitively costly. Fortunately, previous works such as Deep Fluids (DF) (Kim et al., 2019) show that large simulation speedups are achievable by replacing CFD simulators with neural network (NN) surrogates that faithfully mimic the CFD simulation process. This raises the possibility of a fast, accurate replacement for a CFD simulator and therefore efficient approximation of the IAs required by CCS design optimization. Thus, here, we build on the DF approach to develop surrogates that can successfully be applied to our complex carbon-capture CFD simulations. Our optimized DF-style surrogates produce large speedups (4000x) while obtaining IA relative errors as low as 4% on unseen CCS configurations that lie within the range of training configurations. This hints at the promise of NN surrogates for our CCS design optimization problem. Nonetheless, DF has inherent limitations with respect to CCS design (e.g., limited transferability of trained models to new CCS packings). We conclude with ideas to address these challenges.
BibTeX
@inproceedings{bartoldson2022latent,
  author = {Brian R. Bartoldson and Rui Wang and Yucheng Fu and David Widemann and Sam Nguyen and Jie Bao and Zhijie Xu and Brenda Ng},
  title = {{Latent Space Simulation for Carbon Capture Design Optimization}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2022},
  url = {https://openreview.net/forum?id=03UMwyZd00},
}
Figure