Machine Learning Benchmarks for the Classification of Equivalent Circuit Models from Electrochemical Impedance Spectra

Joachim Schaeffer, Paul Gasper, Esteban Garcia-Tamayo, Raymond Gasper, Masaki Adachi, Juan Pablo Gaviria-Cardona, Simon Montoya‐Bedoya, Anoushka Bhutani, Andrew Schiek, Rhys E. A. Goodall, Rolf Findeisen, Richard D. Braatz, Simon Engelke

TL;DR

This paper tackles the challenge of automatically identifying the underlying electrical circuit models (ECMs) that describe electrochemical impedance spectroscopy (EIS) data, a crucial but time-consuming step in battery research. They benchmark several machine learning approaches on a large, publicly released dataset, finding that a gradient-boosted tree model with automatically extracted time-series features performs best, achieving a weighted F1-score of 0.50.

What Problem Does This Paper Address?

Electrochemical Impedance Spectroscopy (EIS) is a powerful technique for understanding the complex processes happening within electrochemical systems like batteries. However, interpreting EIS data typically involves manually constructing an Equivalent Circuit Model (ECM) – a network of resistors, capacitors, and other elements that mimics the battery's behavior. This manual process is expert-intensive and becomes a bottleneck when dealing with the massive datasets generated by modern battery research. Automating ECM identification could significantly accelerate battery development and analysis.

Methods

The authors explored three main machine learning approaches for classifying EIS spectra into their corresponding ECMs:

  • Random Forest (RF): A baseline model that uses the raw, preprocessed spectral data as input.
  • XGBoost with tsfresh features: This approach treats each EIS spectrum as a multivariate time series. The tsfresh library automatically extracts hundreds of features (e.g., related to trends, peaks, and statistical properties) from the spectral data, and an XGBoost (gradient-boosted tree) model is trained on these features.
  • Convolutional Neural Network (CNN): This method visualizes the EIS spectra as Nyquist plots (real vs. imaginary impedance) and treats these plots as images. A modified CNN architecture, inspired by models used for image recognition, is then applied.

Datasets

The primary dataset used in this study was provided by QuantumScape for the BatteryDEV hackathon. It consists of approximately 9,300 synthetic EIS spectra, each labeled with its corresponding Equivalent Circuit Model (ECM). The authors also mention an unlabeled dataset containing 80% synthetic and 20% measured data, which was made available but not analyzed in detail for classification. This work introduces a new benchmark dataset for ECM classification.

Key Insights and Ideas

  • Time-series features are powerful: Extracting features that capture the temporal (or frequency-based) dynamics of the EIS spectra, rather than just using raw data, significantly improves classification performance. The tsfresh library proved effective in this regard.
  • ECMs with similar shapes are hard to distinguish: The study highlights that ECMs that produce spectrally similar patterns (e.g., those with varying numbers of RCPE elements) are inherently difficult to differentiate, even for advanced ML models. This points to fundamental identifiability challenges in EIS data.
  • CNNs as a visual approach show promise but face challenges: While treating EIS spectra as images for CNN analysis is an intuitive idea, the current implementation achieved lower accuracy. This suggests that simply visualizing the Nyquist plot might not fully capture the rich information present in EIS data, especially frequency and magnitude details.
  • Open data and code are crucial for progress: The authors emphasize the importance of releasing the data and code to foster further research and interdisciplinary collaboration in this area.

Key Results

  • The tsfresh-XGBoost approach achieved the highest weighted F1-score of 0.50, outperforming the Random Forest baseline (0.38) and the CNN approach (0.32).
  • The Random Forest model, using raw spectral data, achieved a weighted F1-score of 0.38.
  • The CNN model, using Nyquist plot images, achieved a weighted F1-score of 0.32.
  • The models struggled to differentiate between ECMs with similar structures, such as those with varying numbers of RCPE elements (e.g., L-R-nRCPE circuits).
  • ECMs that are physically distinct (e.g., L-R-nRCPE vs. Rs-Ws) were rarely confused.

Limitations and Future Work

  • Identifiability Issues: The inherent similarity in spectral shapes generated by different ECMs poses a significant challenge for accurate classification. The authors note that even human observers can find it difficult to distinguish between certain classes.
  • CNN Limitations: The CNN approach, while a proof of concept, did not fully leverage frequency and magnitude information. Future work could explore better ways to incorporate this data into CNN architectures.
  • Parameter Estimation: While this paper focuses on classification, the authors acknowledge that parameter estimation (finding the actual values for the circuit elements) is a critical next step. They suggest that the trained models could potentially serve as initial guesses for parameter optimization.
  • Generalizability: The models were trained on synthetic data informed by specific battery R&D. Their performance on real-world, diverse EIS data from different battery chemistries or operating conditions remains to be fully explored.
  • Unsupervised Learning: The authors suggest that unsupervised learning approaches for generating candidate ECMs could be a valuable future direction, moving beyond simple classification.

Summary updated

Abstract

Analysis of Electrochemical Impedance Spectroscopy (EIS) data for electrochemical systems often consists of defining an Equivalent Circuit Model (ECM) using expert knowledge and then optimizing the model parameters to deconvolute various resistance, capacitive, inductive, or diffusion responses. For small data sets, this procedure can be conducted manually; however, it is not feasible to manually define a proper ECM for extensive data sets with a wide range of EIS responses. Automatic identification of an ECM would substantially accelerate the analysis of large sets of EIS data. We showcase machine learning methods to classify the ECMs of 9,300 impedance spectra provided by QuantumScape for the BatteryDEV hackathon. The best-performing approach is a gradient-boosted tree model utilizing a library to automatically generate features, followed by a random forest model using the raw spectral data. A convolutional neural network using boolean images of Nyquist representations is presented as an alternative, although it achieves a lower accuracy. We publish the data and open source the associated code. The approaches described in this article can serve as benchmarks for further studies. A key remaining challenge is the identifiability of the labels, underlined by the model performances and the comparison of misclassified spectra.
BibTeX
@article{schaeffer2023machine,
  author = {Joachim Schaeffer and Paul Gasper and Esteban Garcia-Tamayo and Raymond Gasper and Masaki Adachi and Juan Pablo Gaviria-Cardona and Simon Montoya‐Bedoya and Anoushka Bhutani and Andrew Schiek and Rhys E. A. Goodall and Rolf Findeisen and Richard D. Braatz and Simon Engelke},
  title = {{Machine Learning Benchmarks for the Classification of Equivalent Circuit Models from Electrochemical Impedance Spectra}},
  journal = {Journal of The Electrochemical Society},
  year = {2023},
  doi = {10.1149/1945-7111/acd8fb},
}
Figure