Graph Neural Networks for Carbon Dioxide Adsorption Prediction in Aluminum-Substituted Zeolites

Marko Petković, José Manuel Vicent‐Luna, Vlado Menkovski, Sofı́a CaleroACS 2024 · DOI

TL;DR

This paper introduces a Graph Neural Network (GNN) model that significantly accelerates the prediction of CO2 adsorption properties in zeolites, achieving speedups of 4-5 orders of magnitude compared to traditional molecular simulations. Beyond prediction, the model offers interpretability by identifying specific adsorption sites and enables inverse design of new zeolite materials with desired properties.

What Problem Does This Paper Address?

Designing new materials for carbon capture, particularly zeolites, is a critical challenge in mitigating climate change. Zeolites are promising due to their high adsorption capacity and thermal stability. However, the vast number of possible zeolite structures, especially concerning the placement of aluminum (Al) and silicon (Si) atoms, makes experimental or traditional simulation-based screening computationally infeasible. Existing molecular simulation methods, while accurate, are extremely time-consuming, taking hours to days for a single prediction. This bottleneck hinders the rapid discovery and optimization of zeolites for CO2 adsorption.

Methods

The researchers propose an extension to the Equivariant Porous Crystal Networks (EPCN) architecture, a type of Graph Neural Network (GNN). Standard GNNs represent materials as graphs where atoms are nodes and bonds are edges. The EPCN architecture specifically incorporates "pore nodes" to better capture the porous nature of zeolites.

The key innovations in this work are:

  • Interpretability Extension: Instead of aggregating pore information into a single prediction, the extended model processes each pore's hidden state individually and then sums these scalar values. This allows the model to output a prediction for each pore, enabling the identification of specific adsorption sites and their contributions to the overall adsorption properties.
  • Inverse Design Capability: The trained GNN model is integrated with a genetic algorithm. The GNN acts as a fast fitness function, allowing the genetic algorithm to efficiently search for novel zeolite configurations that meet a target heat of adsorption.

Datasets

The study utilizes generated datasets of four zeolite topologies: MOR, MFI, RHO, and ITW. For each topology, various configurations of aluminum and silicon atoms were generated, with the Si/Al ratio varying. The heat of adsorption and Henry coefficients for CO2 were calculated for these configurations using Monte Carlo (MC) simulations. This generated dataset serves as the training and testing ground for the GNN model.

Key Insights and Ideas

  • Speed vs. Accuracy Trade-off: The GNN model achieves remarkable speedups (4-5 orders of magnitude) over MC simulations without a significant loss in predictive accuracy for heat of adsorption and Henry coefficients. This makes large-scale screening and design feasible.
  • Pore-Level Insights: The model's ability to predict contributions from individual pores provides valuable insights into where CO2 adsorption is most favorable within a zeolite structure, moving beyond a black-box prediction.
  • Enabling Inverse Design: Combining the fast GNN predictor with a genetic algorithm opens up new avenues for designing zeolites with specific adsorption characteristics, directly addressing the need for tailored materials.
  • Generalizability within Topologies: While a new model is trained for each zeolite topology, the approach effectively captures the unique structural nuances of each framework, leading to good performance.

Key Results

  • Predictive Performance: The proposed GNN model demonstrates comparable performance to the original EPCN architecture in predicting CO2 heat of adsorption and Henry coefficients across MOR, MFI, RHO, and ITW zeolites. For RHO, the proposed model even shows improved performance.
  • Speedup: The ML model predicts properties in milliseconds, a stark contrast to the hours or days required by MC simulations.
  • Inverse Design Success: The genetic algorithm, guided by the GNN, successfully generated novel zeolite configurations for MOR and MFI with target heats of adsorption. The study found that most generated structures were new, indicating effective exploration of the configuration space.
  • Interpretability Validation: Visualizations show a correlation between the predicted pore embeddings and the actual CO2 density within those pores, supporting the model's ability to identify adsorption sites.

Limitations and Future Work

  • Topology-Specific Models: A limitation is that a separate model must be trained for each zeolite topology. The authors suggest that future work could explore parameter sharing based on composite building units (CBUs) to create more generalized models applicable to multiple topologies.
  • Expanding Input Features: The model could be extended to include additional factors like operating conditions and cation features to further enhance its predictive power and applicability.
  • Generative Models for Inverse Design: While the current approach uses a discriminative ML model for inverse design, the authors suggest that generative models might offer a better framework for modeling the joint distribution of adsorption properties and zeolite configurations.
  • Broader Applications: The methodology is presented as a step towards computational materials design and can be extended to other properties and applications in materials science.

Summary updated

Abstract

The ability to efficiently predict adsorption properties of zeolites can be of large benefit in accelerating the design process of novel materials. The existing configuration space for these materials is wide, while existing molecular simulation methods are computationally expensive. In this work, we propose a model which is 4 to 5 orders of magnitude faster at adsorption properties compared to molecular simulations. To validate the model, we generated data sets containing various aluminum configurations for the MOR, MFI, RHO and ITW zeolites along with their heat of adsorptions and Henry coefficients for CO<sub>2</sub>, obtained from Monte Carlo simulations. The predictions obtained from the Machine Learning model are in agreement with the values obtained from the Monte Carlo simulations, confirming that the model can be used for property prediction. Furthermore, we show that the model can be used for identifying adsorption sites. Finally, we evaluate the capability of our model for generating novel zeolite configurations by using it in combination with a genetic algorithm.
BibTeX
@inproceedings{petkovic2024graph,
  author = {Marko Petković and José Manuel Vicent‐Luna and Vlado Menkovski and Sofı́a Calero},
  title = {{Graph Neural Networks for Carbon Dioxide Adsorption Prediction in Aluminum-Substituted Zeolites}},
  booktitle = {ACS},
  year = {2024},
  doi = {10.1021/acsami.4c12198},
}
Figure