Stability-Constrained Learning for Frequency Regulation in Power Grids With Variable Inertia

Jie Feng, Jie Feng 0006, Manasa Muralidharan, Rodrigo Henriquez-Auba, Patricia Hidalgo-Gonzalez, Yuanyuan Shi

TL;DR

This paper introduces a novel data-driven controller that uses a combination of a linear controller and a neural network to stabilize power grids with rapidly changing inertia, a growing challenge with increased renewable energy integration. The controller guarantees stability even with time-varying inertia and achieves performance comparable to traditional methods like LQR, but in a computationally tractable, real-time manner.

What Problem Does This Paper Address?

The increasing integration of renewable energy sources like solar and wind into power grids presents a significant challenge for grid stability. Unlike traditional synchronous generators that possess inherent rotational inertia, renewable energy sources often interface through power electronic inverters, which lack this inertia. This leads to faster frequency dynamics and reduced system inertia, making the grid more susceptible to disturbances and requiring control systems that can react much faster than before. Existing control methods designed for grids with constant inertia struggle to adapt to these rapidly changing and variable inertia conditions. The paper aims to develop a frequency control strategy that is not only fast-acting but also guarantees stability across a wide range of time-varying inertia levels, a critical requirement for reliable power system operation.

Methods

The core of the proposed solution is a stability-constrained learning framework. The authors first model the power grid's frequency dynamics with variable inertia as a switched affine hybrid system. This allows them to represent different inertia levels as distinct "modes" that the system can switch between.

To ensure stability, they derive a candidate Lyapunov function that is common across all inertia modes. This function is crucial for proving that the system will always return to a stable state. They then propose a controller that combines a stabilizing linear feedback controller with a nonlinear neural network residual. The linear controller provides a baseline stability guarantee, while the neural network is trained to optimize performance (e.g., faster settling times, lower costs) beyond what the linear controller can achieve.

A key innovation is the stability-constrained projection mechanism for the neural network's output. This projection ensures that the controller's actions always satisfy the derived Lyapunov stability conditions, effectively "constraining" the neural network's learning to stay within stable operating regions. The training process involves an iterative approach: first, the neural network residual is trained to mimic the behavior of an optimal, but computationally expensive, finite-horizon Linear Quadratic Regulator (LQR). Then, the linear controller and Lyapunov function are optimized, with stability constraints incorporated as soft penalties. This iterative process allows for end-to-end optimization of the entire controller.

Datasets

The paper does not explicitly mention using pre-existing public datasets. Instead, it generates its own training and testing data. The finite-horizon LQR formulation is used to generate optimal control actions and corresponding state trajectories for a range of inertia scenarios. This generated data serves as the "ground truth" for training the proposed controller. The authors also mention training a separate neural network for estimating online inertia modes, achieving 90.64% accuracy for inertia mode classification.

Key Insights and Ideas

  • Variable Inertia is a Major Stability Challenge: The paper clearly articulates how the shift towards renewables fundamentally alters grid dynamics, necessitating new control paradigms.
  • Hybrid Systems for Modeling: Representing frequency dynamics with variable inertia as a switched affine hybrid system is a powerful way to capture the complex, mode-switching behavior.
  • Lyapunov Stability is Non-Negotiable: The emphasis on guaranteeing stability through Lyapunov functions, even with time-varying parameters, is paramount for safety-critical systems like power grids.
  • Neural Networks as Performance Enhancers, Not Sole Stabilizers: The approach of using neural networks as a "residual" to a provably stable linear controller is a smart way to leverage the learning capabilities of NNs while retaining stability guarantees.
  • Stability Projection is Key: The proposed projection mechanism is a critical component that ensures the neural network's output doesn't lead to instability, effectively bridging the gap between learning and control theory.
  • Data-Driven Optimization with Guarantees: The iterative training process, which optimizes both the neural network and the linear components while enforcing stability, offers a practical way to achieve high performance without sacrificing safety.

Key Results

The proposed stability-constrained controller demonstrates significant improvements over baseline linear controllers:

  • Faster Settling Time: The controller achieves a mean settling time of 147.7 ms, which is faster than the baseline linear controller (554.8 ms) and comparable to LQR (122.8 ms).
  • Reduced Control Cost: It achieves over 50% reduction in average control cost compared to an optimized linear controller (244.7 vs. 4497.4).
  • Comparable Performance to LQR: The controller's performance is close to that of the computationally intensive LQR, but it is real-time tractable.
  • Robustness to Inertia Variations: The controller performs well across 100 different inertia scenarios, demonstrating its ability to handle time-varying dynamics.
  • Hardware Constraint Handling: Even when incorporating hardware constraints (e.g., limits on control action), the proposed controller maintains fast frequency recovery, albeit with a slight increase in cost and settling time compared to unconstrained LQR.

Limitations and Future Work

  • Linearization Assumptions: The paper models the frequency dynamics using a linearized swing equation. While this is standard, it might not fully capture all nonlinearities in a real power system.
  • Common Lyapunov Function: Finding a common Lyapunov function for all modes can be challenging, and the paper relies on analytical guarantees from prior work [15] for its feasibility.
  • Iterative Optimization: The iterative training algorithm does not guarantee global optimality, although numerical experiments show good performance.
  • Future Work: The authors suggest several promising avenues:
  • Adapting the controller to handle nonlinear inverter dynamics.
  • Designing controllers that account for communication delays.
  • Decentralizing the controller to reduce communication overhead.
  • Improving robustness to parameter measurement errors and other uncertainties.
  • Investigating the impact of nonlinear inverter dynamics and communication delays.

Summary updated

Abstract

The increasing penetration of converter-based renewable generation has resulted in faster frequency dynamics, and low and variable inertia. As a result, there is a need for frequency control methods that are able to stabilize a disturbance in the power system at timescales comparable to the fast converter dynamics. This paper proposes a combined linear and neural network controller for inverter-based primary frequency control that is stable at time-varying levels of inertia. We model the time-variance in inertia via a switched affine hybrid system model. We derive stability certificates for the proposed controller via a quadratic candidate Lyapunov function. We test the proposed control on a 12-bus 3-area test network, and compare its performance with a base case linear controller, optimized linear controller, and finite-horizon Linear Quadratic Regulator (LQR). Our proposed controller achieves faster mean settling time and over 50% reduction in average control cost across $100$ inertia scenarios compared to the optimized linear controller. Unlike LQR which requires complete knowledge of the inertia trajectories and system dynamics over the entire control time horizon, our proposed controller is real-time tractable, and achieves comparable performance to LQR.
BibTeX
@article{feng2024stability,
  author = {Jie Feng and Jie Feng and Manasa Muralidharan and Rodrigo Henriquez-Auba and Patricia Hidalgo-Gonzalez and Yuanyuan Shi},
  title = {{Stability-Constrained Learning for Frequency Regulation in Power Grids With Variable Inertia}},
  journal = {IEEE Control. Syst. Lett},
  year = {2024},
  doi = {10.1109/lcsys.2024.3408068},
}
Figure