Design of Modified Polymer Membranes Using Machine Learning

Sarah Glaß, Martin A. Schmidt, Petra Merten, Amira Abdul Latif, Kristina Fischer, Agnes Schulze, Pascal Friederich, Volkan FilizACS 2024 · DOI

TL;DR

This paper demonstrates that machine learning, specifically neural networks, can effectively predict the performance of modified polymer membranes even with small datasets. This approach significantly accelerates the development of high-performance membranes by reducing the need for extensive experimental trial-and-error.

What Problem Does This Paper Address?

Developing advanced polymer membranes for water purification and other applications often involves surface modification to tailor their properties. However, understanding the complex relationships between the modification strategy (e.g., chemical structure of modifying agents, processing parameters) and the resulting membrane performance (like pure water permeability and surface charge) is a significant challenge. These "structure-processing-property" relationships are often unknown, making it difficult to design new membranes or optimize existing ones efficiently. This leads to time-consuming and costly experimental processes.

Methods

The researchers employed machine learning techniques to build predictive models for membrane performance. They started by using various regression models (Random Forest, Gradient Boosting, AdaBoost, Extra Trees, Linear Regression) to analyze existing data and identify key features influencing membrane properties. Gradient Boosting emerged as the best-performing regression model. Subsequently, they applied a neural network, which showed even better predictive capabilities.

The core of their approach involved:

  • Data Collection: Utilizing previously recorded experimental data on modified polyacrylonitrile (PAN) membranes.
  • Feature Engineering: Identifying and selecting relevant features that describe the modification process and substances. These included concentration of the modifying substance, the type of membrane used (M1 or M2), the electron beam irradiation dose, the pKa of the amine group, and whether the acrylic group was methylated or an acrylate. For zeta potential, the pH was also included as a feature.
  • Model Training: Training both regression and neural network models on this dataset.
  • Model Evaluation: Assessing model performance using metrics like the coefficient of determination (R²) and mean absolute error (MAE).
  • Shapley Value Analysis: Using Shapley values to interpret the neural network's predictions and understand the impact of each feature on the output.
  • Prediction and Validation: Using the trained models to predict the performance of membranes modified with new substances and then experimentally validating these predictions.

Datasets

The study utilized previously collected experimental data sets of modified polyacrylonitrile (PAN) membranes.

  • For PWP prediction: 52 membrane samples were used, each with 6 features and one output value (PWP).
  • For zeta potential prediction: 42 independent membrane samples were used, resulting in 2144 data points due to the pH-dependent nature of zeta potential. Each data point had 7 features and one output value (zeta potential).

The researchers also created new datasets for validation by excluding a few representative samples from the original training data. Finally, they experimentally prepared and analyzed eight new membranes to validate their predictions for novel modifications.

Key Insights and Ideas

  • Small Data, Big Impact: Machine learning models, particularly neural networks, can achieve high accuracy in predicting membrane properties even with relatively small experimental datasets, which are common in materials science.
  • Feature Importance Revealed: The models identified that the concentration of the modification substance and the specific pristine membrane material (M1 vs. M2) were the most influential factors for pure water permeability (PWP). For zeta potential, the pH of the measurement and the pKa of the amine group were dominant.
  • Interpretable Predictions: Shapley values provided valuable insights into how the features influenced the predictions, allowing researchers to understand the underlying trends and make informed decisions about future modifications. For instance, they could discern that methylated substances and membrane M1 tended to increase PWP.
  • Accelerated Design Cycle: The study demonstrated that machine learning can significantly reduce the time and cost associated with developing new membranes by predicting performance before synthesis.

Key Results

  • Gradient Boosting Performance: The gradient boosting regressor achieved a high coefficient of determination (R²) of 0.963 for PWP and 0.967 for zeta potential, with low mean absolute errors (122.0 LMH/bar for PWP and 2.1 mV for zeta potential).
  • Neural Network Superiority: The neural network model slightly outperformed the regression models, achieving R² values of 0.968 for PWP and 0.984 for zeta potential, with even lower mean absolute errors (105.9 LMH/bar for PWP and 1.6 mV for zeta potential).
  • Accurate Validation: The neural network accurately predicted the zeta potential curves and PWP of known modification substances under new conditions, with mean absolute errors for zeta potential around 8 mV and for PWP around 273.9 LMH/bar.
  • Prediction of Novel Membranes: The models successfully predicted the performance of membranes modified with new, unseen amine-containing substances (DMAEMA and DMAPMA), showing a significant time saving compared to experimental synthesis.

Limitations and Future Work

  • Extrapolation Challenges: Predictions were most reliable for interpolated values within the trained data space. Discrepancies arose when predicting values at the "edges" of the trained data, particularly for high concentrations or doses.
  • Data Augmentation: The authors suggest that adding the less well-predicted data generated in this study, along with more data in under-represented regions, would improve future predictions.
  • Broader Scope: They recommend expanding the dataset to include other membrane modifications, different functional groups, and alternative membrane materials to further enhance the predictive power and generalizability of the models.
  • Mechanism vs. Correlation: While the models identify important features, they primarily represent statistical correlations rather than directly revealing underlying physicochemical mechanisms. Further investigation would be needed to elucidate these mechanisms.

Summary updated

Abstract

Surface modification is an attractive strategy to adjust the properties of polymer membranes. Unfortunately, predictive structure-processing-property relationships between the modification strategies and membrane performance are often unknown. One possibility to tackle this challenge is the application of data-driven methods such as machine learning. In this study, we applied machine learning methods to data sets containing the performance parameters of modified membranes. The resulting machine learning models were used to predict performance parameters, such as the pure water permeability and the zeta potential of membranes modified with new substances. The predictions had low prediction errors, which allowed us to generalize them to similar membrane modifications and processing conditions. Additionally, machine learning methods were able to identify the impact of substance properties and process parameters on the resulting membrane properties. Our results demonstrate that small data sets, as they are common in materials science, can be used as training data for predictive machine learning models. Therefore, machine learning shows great potential as a tool to expedite the development of high-performance membranes while reducing the time and costs associated with the development process at the same time.
BibTeX
@inproceedings{gla2024design,
  author = {Sarah Glaß and Martin A. Schmidt and Petra Merten and Amira Abdul Latif and Kristina Fischer and Agnes Schulze and Pascal Friederich and Volkan Filiz},
  title = {{Design of Modified Polymer Membranes Using Machine Learning}},
  booktitle = {ACS},
  year = {2024},
  doi = {10.1021/acsami.3c18805},
}
Figure