Fault Detection for agents on power grid topology optimization: A Comprehensive analysis

Malte Lehna, Mohamed Hassouna, Dmitry Degtyar, Sven Tomforde, Christoph ScholzarXiv 2024 · DOI · arXiv

Abstract

As power grids integrate more volatile renewable energy sources, topology optimization via Deep Reinforcement Learning (DRL) has emerged as a promising management strategy. However, the "black box" nature of DRL agents complicates failure analysis. This study analyzes over 40,000 grid failure scenarios using the IEEE 118 bus system to categorize failure modes and develop a predictive forecasting framework. By employing PCA and k-means clustering, five distinct failure archetypes were identified. Furthermore, a LightGBM-based model achieved 82% accuracy in predicting imminent grid collapse, providing a critical 25-minute early warning window for operators.

Introduction

The modern power grid faces unprecedented variability due to the rise of renewable energy. Traditional methods of managing transmission constraints are often costly. Topology optimization—the strategic reconfiguration of substation busbars—offers a flexible, software-driven alternative. While DRL agents have demonstrated high performance in simulated environments like the Learning to Run a Power Network (L2RPN) challenges, their operational reliability remains a concern. Understanding why these agents fail is paramount for their real-world deployment.

Categorizing Failure Modes

To move beyond aggregate performance scores, researchers performed a forensic analysis of 40,000 failure events. High-dimensional grid data was reduced using Principal Component Analysis (PCA) and subsequently grouped via k-means clustering. This process revealed five interpretable failure clusters:

  1. Changed Topology: Failures directly following an agent's reconfiguration action.
  2. Decreased Load Consumption: Localized imbalances leading to instability.
  3. Disconnected Power Lines: Direct overloads resulting from line outages.
  4. Increased Generator Injections: Surges in production that overwhelm local capacity.
  5. Increased Power Flow on Power Lines: General systemic stress.
3D visualization of failure clusters based on modified substations, generator flow increases, and disconnected lines.

The analysis highlighted an "irony of optimization": while advanced agents successfully mitigated failures from external line disconnections, nearly 60% of their own failures were self-induced through destabilizing topological changes. Feature importance analysis further identified specific geographic "hotspots" in the IEEE 118 grid where these vulnerabilities are most acute.

Predictive Forecasting and the "Sudden Death" Threshold

A core contribution of this work is a multi-class forecasting framework designed to predict the time-to-failure. The researchers benchmarked several models, including Random Forest, XGBoost, LightGBM, and specialized neural networks like GANDALF. LightGBM emerged as the superior model, achieving a multi-class accuracy of 82% and a binary accuracy (survival vs. failure) of 87%.

The model's performance reveals a critical temporal dynamic. As the grid approaches a tipping point, the certainty of the prediction increases significantly. At 25 minutes prior to failure ($t=n-5$), the model identifies the correct failure window with moderate confidence, but by 5 minutes prior ($t=n-1$), the accuracy reaches 81%.

Evolution of failure probability predictions as the grid approaches collapse, demonstrating the model's increasing confidence.

This 25-minute window provides a vital buffer for grid operators to intervene manually or trigger automated safety protocols. The study found that timestep_overflow—the duration a line has been over capacity—is the single most critical predictor of imminent failure.

Conclusion

This research provides a robust framework for interpreting and predicting DRL agent failures in power grid management. By identifying specific failure clusters and providing a high-accuracy early warning system, the study bridges the gap between "black box" AI and operational safety. Future work will focus on integrating redispatching capabilities and exploring Graph Neural Networks (GNNs) to further enhance spatial awareness and predictive precision.

Summary updated

Abstract

Optimizing the topology of transmission networks using Deep Reinforcement Learning (DRL) has increasingly come into focus. Various DRL agents have been proposed, which are mostly benchmarked on the Grid2Op environment from the Learning to Run a Power Network (L2RPN) challenges. The environments have many advantages with their realistic grid scenarios and underlying power flow backends. However, the interpretation of agent survival or failure is not always clear, as there are a variety of potential causes. In this work, we focus on the failures of the power grid simulation to identify patterns and detect them in advance. We collect the failed scenarios of three different agents on the WCCI 2022 L2RPN environment, totaling about 40k data points. By clustering, we are able to detect five distinct clusters, identifying common failure types. Further, we propose a multi-class prediction approach to detect failures beforehand and evaluate five different prediction models. Here, the Light Gradient-Boosting Machine (LightGBM) shows the best failure prediction performance, with an accuracy of 82%. It also accurately classifies whether a the grid survives or fails in 87% of cases. Finally, we provide a detailed feature importance analysis that identifies critical features and regions in the grid.
BibTeX
@misc{lehna2024fault,
  author = {Malte Lehna and Mohamed Hassouna and Dmitry Degtyar and Sven Tomforde and Christoph Scholz},
  title = {{Fault Detection for agents on power grid topology optimization: A Comprehensive analysis}},
  year = {2024},
  eprint = {2406.16426},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2406.16426},
}
Figure