Neural Network Design for Impedance Modeling of Power Electronic Systems Based on Latent Features

Yicheng Liao, Yufei Li, Minjie Chen, Lars Nordström, Xiongfei Wang, Prateek Mittal, H. Vincent Poor

TL;DR

This paper introduces a physics-informed approach to designing neural networks that model the impedance of power electronic converters. By using "latent features"—specifically the number of system poles and zeros—the authors eliminate the guesswork in network architecture, creating a model that accurately predicts system behavior across a wide range of operating conditions using significantly less data.

What Problem Does This Paper Address?

As we transition to renewable energy, our power grids are increasingly dominated by power electronic converters (like those in wind turbines, solar inverters, and EVs). To ensure the grid remains stable, engineers perform "small-signal stability analysis," which relies on understanding the frequency-domain impedance of these devices.

The catch? A converter’s impedance changes depending on its operating point (OP)—factors like voltage magnitude, active power, and reactive power. Traditionally, you’d have to measure or calculate this impedance point-by-point. If the OP changes, you start over. Furthermore, manufacturers often keep their control algorithms "black-boxed" for proprietary reasons, making analytical modeling nearly impossible for grid operators.

While neural networks are great at modeling black boxes, standard designs usually rely on tedious trial-and-error to find the right architecture and require massive amounts of data. This paper seeks a "smarter" way to design these networks using the underlying physical properties of the systems they represent.

Methods

The authors propose a Multilayer Feedforward Neural Network (FNN) approach with several key innovations:

  1. Latent Feature-Based Design: Instead of guessing the number of layers and neurons, the authors decompose the mathematical process of calculating a transfer function. They determined that a structure with two hidden layers is sufficient to represent the nonlinearities of impedance. The number of neurons ($N$) is tied directly to the system's "latent features": the number of poles ($n$) and zeros ($m$).
  2. Small Dataset Learning: They developed a flowchart-based training procedure that starts with a small dataset and incrementally increases it only if the validation loss suggests the model is underperforming.
  3. Sensitivity Clustering: To improve data quality, they used K-medoids clustering combined with Dynamic Time Warping (DTW). This allowed them to identify which operating variables (Voltage $V$, Power $P$, or $Q$) the impedance is most sensitive to, allowing for "smarter" sampling rather than just "more" sampling.
  4. Optimization: They compared various algorithms and identified the Levenberg-Marquardt (LM) algorithm as the most efficient for these small-to-medium scale power system problems.

Datasets

The study utilized data generated from a grid-following three-phase converter system.

  • Verification Dataset: 823 Operating Points (OPs) used to validate the FNN structure and optimizer performance.
  • Small Datasets: Three subsets (Dataset A: 49 OPs, Dataset B: 106 OPs, and Dataset C: 244 OPs) were used to test how the model performs with limited information.
  • Clustering Data: The 823 OPs were used to rank variable sensitivity.

Key Insights and Ideas

  • Physics-Informed Architecture: The most significant "aha" moment is that the complexity of a neural network doesn't have to be a mystery. If you know (or can estimate) the order of the system's differential equations, you can calculate the optimal number of neurons. For this study, the theoretical design suggested 26 neurons; empirical trial-and-error found the "sweet spot" at 22—a remarkably close match.
  • The Sensitivity Hierarchy: Through clustering, the authors discovered that converter impedance is most sensitive to changes in reactive power ($Q$), followed by active power ($P$), and least sensitive to voltage magnitude ($V$). This means if you have a limited "data budget," you should spend it sampling different $Q$ values.
  • Efficiency of LM: While many deep learning practitioners default to Adam or SGD, the Levenberg-Marquardt algorithm reached the target error ($10^{-10}$ MSE) in just 6 minutes, while gradient-descent-based methods struggled to converge even after hours.

Key Results

  • Accuracy: The designed FNN successfully predicted impedance across the entire frequency range (1 Hz to 5 kHz) and various OPs with an absolute error of less than $-100$ dB.
  • Data Efficiency: The model achieved high accuracy with as few as 100 operating points, provided the sampling was guided by the sensitivity analysis.
  • Generalization: When tested on randomly selected OPs not included in the training set, the FNN model showed "good agreement" with analytical benchmarks, proving it had learned the underlying physics rather than just memorizing data points.

Limitations and Future Work

  • Fixed Control Structure: The current model is valid for a specific converter with a fixed control structure. If the manufacturer updates the firmware or control logic, the FNN would likely need retraining.
  • Scaling Up: While successful for a single converter, the authors note that future work should explore how this scales to transmission-level systems involving hundreds of multi-vendor converters.
  • Real-world Noise: The study used clean, analytically generated data. Future research could investigate how measurement noise in real-world "frequency-scan" data affects the FNN's performance.

Summary updated

Abstract

Data-driven approaches are promising to address the modeling issues of modern power electronics-based power systems, due to the black-box feature. Frequency-domain analysis has been applied to address the emerging small-signal oscillation issues caused by converter control interactions. However, the frequency-domain model of a power electronic system is linearized around a specific operating condition. It thus requires measurement or identification of frequency-domain models repeatedly at many operating points (OPs) due to the wide operation range of the power systems, which brings significant computation and data burden. This article addresses this challenge by developing a deep learning approach using multilayer feedforward neural networks (FNNs) to train the frequency-domain impedance model of power electronic systems that is continuous of OP. Distinguished from the prior neural network designs relying on trial-and-error and sufficient data size, this article proposes to design the FNN based on latent features of power electronic systems, i.e., the number of system poles and zeros. To further investigate the impacts of data quantity and quality, learning procedures from a small dataset are developed, and K-medoids clustering based on dynamic time warping is used to reveal insights into multivariable sensitivity, which helps improve the data quality. The proposed approaches for the FNN design and learning have been proven simple, effective, and optimal based on case studies on a power electronic converter, and future prospects in its industrial applications are also discussed.
BibTeX
@article{liao2023neural,
  author = {Yicheng Liao and Yufei Li and Minjie Chen and Lars Nordström and Xiongfei Wang and Prateek Mittal and H. Vincent Poor},
  title = {{Neural Network Design for Impedance Modeling of Power Electronic Systems Based on Latent Features}},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  year = {2023},
  doi = {10.1109/tnnls.2023.3235806},
}
Figure