An Interactive Insight Identification and Annotation Framework for Power Grid Pixel Maps using DenseU-Hierarchical VAE

Tianye Zhang, Haozhe Feng, Zexian Chen, Can Wang, Yanhao Huang, Yong Tang, Wei ChenarXiv 2019 · arXiv

Abstract

Transient Stability Analysis (TSA) is critical for power grid reliability, yet identifying specific stability "insights" within massive simulation datasets remains a manual, labor-intensive process. This paper presents DUHiV (DenseU-Hierarchical Variational Autoencoder), a framework that combines a novel deep learning architecture with an interactive visual interface. By leveraging hierarchical latent variables and latent space arithmetic, DUHiV enables domain experts to discover and annotate complex grid behaviors in an unsupervised or semi-supervised manner, significantly reducing the reliance on large-scale labeled datasets.

Introduction

Power grid analysts increasingly rely on Power Grid Pixel Maps (PGPMs) to visualize complex simulation data. In these maps, time and bus locations define the axes, while pixel intensity represents critical variables like voltage. Despite their utility, the sheer volume of data—often exceeding hundreds of thousands of maps—makes manual identification of stability insights a major bottleneck. Traditional supervised learning is hindered by the lack of labeled data, while standard unsupervised models often fail to capture the intricate spatial and semantic structures of high-resolution PGPMs.

Overview of the DUHiV framework, including the model architecture, interactive identification interface, and latent space annotation.

The DUHiV Architecture

To address these challenges, the DUHiV framework introduces a hybrid architecture designed for high-fidelity reconstruction and interpretable feature learning.

  1. DenseU Structure: The inference network utilizes Dense blocks to facilitate feature reuse and gradient flow. The generative network employs a symmetric U-Net-like expanding path, ensuring that multi-scale spatial details are preserved during reconstruction.
  2. Hierarchical Latent Variables: Unlike standard VAEs that use a single flat latent vector, DUHiV implements a hierarchy. The top layer is designed to capture high-level semantic "insights," while the bottom layer focuses on local pixel-level "shapes." This separation is crucial for making the latent space navigable for human experts.
Detailed architecture of the DUHiV model, highlighting the DenseU structure and the hierarchical latent variable sampling process.

Interactive Insight Discovery

The core innovation of DUHiV lies in its "human-in-the-loop" approach. Analysts interact with the learned representations through a visual interface, performing latent space arithmetic to define and discover insights. For instance, by subtracting a "stable" state vector from an "anomalous" one, experts can isolate a "difference vector" that represents a specific fault type. This vector can then be used as a template to search the entire dataset (e.g., the PGPM-250k set) for similar occurrences.

Experimental Evaluation

The framework was tested on two industrial datasets from Northern China: PGPM-3K (labeled for ground truth) and PGPM-250k (unlabeled).

  • Reconstruction and ELBO: DUHiV achieved a significantly tighter Evidence Lower Bound (ELBO) of -2416.5, vastly outperforming baseline models like LVAE (-13624.3) and DLGM (-25520.0). This indicates a much more accurate approximation of the underlying data distribution.
  • Annotation Performance: In unsupervised mode, the framework reached a mean Average Precision (mAP) of 64.4%. This performance is comparable to semi-supervised methods requiring 1% labeled data and far exceeds existing unsupervised benchmarks like NPID (25.7%).

Conclusion

DUHiV represents a significant advancement in power grid data analysis. By combining spatial awareness through DenseU blocks with hierarchical latent modeling, it provides a powerful tool for unsupervised insight discovery. While VAE-based reconstructions still exhibit some characteristic blurriness, the framework's ability to facilitate expert-driven discovery through latent arithmetic offers a scalable solution for managing massive, unlabeled industrial datasets.

Summary updated

Abstract

Insights in power grid pixel maps (PGPMs) refer to important facility operating states and unexpected changes in the power grid. Identifying insights helps analysts understand the collaboration of various parts of the grid so that preventive and correct operations can be taken to avoid potential accidents. Existing solutions for identifying insights in PGPMs are performed manually, which may be laborious and expertise-dependent. In this paper, we propose an interactive insight identification and annotation framework by leveraging an enhanced variational autoencoder (VAE). In particular, a new architecture, DenseU-Hierarchical VAE (DUHiV), is designed to learn representations from large-sized PGPMs, which achieves a significantly tighter evidence lower bound (ELBO) than existing Hierarchical VAEs with a Multilayer Perceptron architecture. Our approach supports modulating the derived representations in an interactive visual interface, discover potential insights and create multi-label annotations. Evaluations using real-world PGPMs datasets show that our framework outperforms the baseline models in identifying and annotating insights.
BibTeX
@misc{zhang2019interactive,
  author = {Tianye Zhang and Haozhe Feng and Zexian Chen and Can Wang and Yanhao Huang and Yong Tang and Wei Chen},
  title = {{An Interactive Insight Identification and Annotation Framework for Power Grid Pixel Maps using DenseU-Hierarchical VAE}},
  year = {2019},
  eprint = {1905.12164},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1905.12164},
}
Figure