Robust Powerline Equipment Inspection System Based on a Convolutional Neural Network

Zahid Ali Siddiqui, Unsang Park, Sang-Woong Lee, Nam-Joon Jung, Min-Hee Choi, Chanuk Lim, Jang-Hun SeoSensors 2018 · DOI

TL;DR

This paper introduces a robust, automated system for inspecting powerline equipment using Convolutional Neural Networks (CNNs). It can detect 17 types of equipment in cluttered environments and analyze defects, specifically focusing on gunshot damage, achieving state-of-the-art performance.

What Problem Does This Paper Address?

Maintaining the integrity of electrical power lines is crucial for a stable power supply. Powerline equipment, like insulators, are constantly exposed to harsh environmental conditions, leading to defects that can cause system failures. Traditional inspection methods are labor-intensive, dangerous, and time-consuming, often requiring manual climbing of poles. While aerial and ground vehicle-based inspections have emerged, they face challenges with cluttered backgrounds, varying lighting, and the need for high-resolution defect analysis. This paper aims to bridge this gap by developing an automated, real-time system that can accurately detect and analyze defects in various powerline equipment.

Methods

The core of the proposed system is a multi-stage Convolutional Neural Network (CNN) approach, leveraging the You Only Look Once (YOLO) version 2 framework for its real-time capabilities.

  • Multi-Stage Detection: The system employs three CNN-based detectors:
  • LR Detector: A low-resolution camera captures wide-angle shots, and this detector identifies potential insulators in these images.
  • HR_1 Detector: A high-resolution camera then zooms in on the detected areas, and this detector refines the bounding boxes.
  • HR_2 Detector: This detector works on rotation-normalized images to provide very precise bounding boxes for defect analysis.
  • Rotation Normalization: A novel method is introduced to normalize the in-plane rotation of insulators, making subsequent analysis more consistent regardless of the equipment's orientation. This is achieved by analyzing edge maps and exploiting appearance symmetry.
  • Ellipse Detection: To segment individual caps of insulators for defect analysis, a specialized ellipse detection method is proposed. This method is more robust to color and lighting variations than previous approaches and is designed to work on the rotation-normalized, tightly cropped insulator images.
  • Defect Analyzer (Gunshot Damage): A specific defect analyzer is developed to detect gunshot damage. It involves ellipse detection to segment caps, edge detection, and connected component analysis to identify circular holes. Crucially, it uses circularity and intensity difference between the hole and its surroundings as constraints to distinguish true defects from noise.

Datasets

The authors created a large, unconstrained dataset for training and evaluation.

  • Training Data: 667 low-resolution and 5533 high-resolution images were manually annotated.
  • Evaluation Data: The system was evaluated on a large dataset of 644 cluttered insulator images for detection and 70 polymer insulator images (with 4 defective ones) for defect analysis. This dataset is noted as being significantly larger than those used in many previous studies.

Key Insights and Ideas

  • CNNs for Robust Detection: The paper strongly advocates for CNNs over handcrafted features for powerline equipment detection, demonstrating their superior ability to handle complex backgrounds and variations.
  • Multi-Stage Camera System: The use of both low-resolution (wide-angle) and high-resolution (close-up) cameras is a practical approach to balance coverage and detail for effective inspection.
  • Rotation Normalization is Key: The novel rotation normalization method is critical for consistent defect analysis, as it standardizes the orientation of insulators before detailed examination.
  • Specialized Ellipse Detection: Tailoring ellipse detection for insulator caps, rather than using general-purpose methods, leads to more accurate segmentation, which is vital for precise defect localization.
  • Defect-Specific Constraints: The gunshot defect analyzer's reliance on geometric (circularity) and photometric (intensity difference) constraints effectively filters out false positives from noisy edges and shadows.

Key Results

  • Detection Performance: The proposed system achieved impressive results:
  • LR Detector: Precision of 77.08%, Recall of 77.37%.
  • HR_1 Detector: Precision of 92.14%, Recall of 92.98%.
  • HR_2 Detector: Precision of 88.39%, Recall of 87.18%.
  • Overall Detection: Up to 93% recall with 92% precision.
  • Defect Analysis Performance: The gunshot defect analyzer achieved up to 98% accuracy.
  • Rotation Normalizer Accuracy: The rotation normalizer achieved an average accuracy of 88.20%.
  • Speed: The system is designed for real-time operation, with the HR_2 detector having an average detection time of 20 ms.

Limitations and Future Work

  • Data Availability: The authors acknowledge that the scarcity of annotated defected cap images (especially for gunshot defects) leads to a highly imbalanced testing set, impacting precision.
  • Class Imbalance: The dataset has a significant imbalance, with polymer insulators dominating. This affects the performance for other equipment types.
  • Training Time: While detection is fast, training the CNN models is time-consuming (averaging 48 hours).
  • Edge Quality Dependency: The ellipse detection algorithm's performance is sensitive to the quality of edges, which can be compromised by blurred or occluded images due to the vehicle's movement.
  • Future Work:
    • Gathering more annotated data for training and testing.
  • Addressing class imbalance, potentially through cost-sensitive loss functions.
  • Developing more unified CNN architectures for insulator detection and defect analysis.
  • Extending the system to detect additional types of insulator defects.

Summary updated

Abstract

Electric power line equipment such as insulators, cut-out-switches, and lightning-arresters play important roles in ensuring a safe and uninterrupted power supply. Unfortunately, their continuous exposure to rugged environmental conditions may cause physical or electrical defects in them which may lead to the failure to the electrical system. In this paper, we present an automatic real-time electrical equipment detection and defect analysis system. Unlike previous handcrafted feature-based approaches, the proposed system utilizes a Convolutional Neural Network (CNN)-based equipment detection framework, making it possible to detect 17 different types of powerline insulators in a highly cluttered environment. We also propose a novel rotation normalization and ellipse detection method that play vital roles in the defect analysis process. Finally, we present a novel defect analyzer that is capable of detecting gunshot defects occurring in electrical equipment. The proposed system uses two cameras; a low-resolution camera that detects insulators from long-shot images, and a high-resolution camera which captures close-shot images of the equipment at high-resolution that helps for effective defect analysis. We demonstrate the performances of the proposed real-time equipment detection with up to 93% recall with 92% precision, and defect analysis system with up to 98% accuracy, on a large evaluation dataset. Experimental results show that the proposed system achieves state-of-the-art performance in automatic powerline equipment inspection.
BibTeX
@inproceedings{siddiqui2018robust,
  author = {Zahid Ali Siddiqui and Unsang Park and Sang-Woong Lee and Nam-Joon Jung and Min-Hee Choi and Chanuk Lim and Jang-Hun Seo},
  title = {{Robust Powerline Equipment Inspection System Based on a Convolutional Neural Network}},
  booktitle = {Sensors},
  year = {2018},
  doi = {10.3390/s18113837},
}
Figure