Engineering Vehicles Detection Based on Modified Faster R-CNN for Power Grid Surveillance

Xuezhi Xiang, Ning Lv, Xinli Guo, Shuai Wang, Abdulmotaleb El-SaddikSensors 2018 · OpenReview

TL;DR

This paper tackles the critical problem of detecting engineering vehicles near high-voltage power lines to prevent damage and ensure grid security. They adapt the Faster R-CNN object detection framework by modifying its ROI pooling layer and adding a convolutional layer to the classifier, achieving improved accuracy and a lower false alarm rate on a custom dataset.

What Problem Does This Paper Address?

The security of power grids is paramount, and a significant threat comes from unauthorized engineering vehicles that can inadvertently damage transmission equipment. Traditional surveillance methods rely on human monitoring, which is labor-intensive and prone to fatigue. While automated systems exist, they often struggle with the complex and varied environments of power line corridors, especially with intermittent image capture due to power constraints (e.g., solar power). This paper aims to develop an intelligent surveillance system that can reliably detect and identify specific engineering vehicles (bulldozers and excavators) in these challenging conditions.

Methods

The core of the proposed solution is a modified Faster R-CNN architecture. The authors identified two key areas for improvement:

  • ROI Pooling Layer Adjustment: They adjusted the position of the Region of Interest (ROI) pooling layer. While the paper doesn't detail the exact adjustment, it's implied to better suit the scale and characteristics of the target objects.
  • Enhanced Feature Classification: A convolutional layer was added to the feature classification part of the network. This aims to improve the classifier's ability to learn "region-wise features" that are crucial for distinguishing engineering vehicles from complex backgrounds, complementing the "full-image shared features."

The model is trained using transfer learning, leveraging a pre-trained VGG_CNN_M_1024 model. This is particularly useful given the limited availability of specialized datasets for this specific task. The authors also freeze earlier layers of the network to prevent overfitting and fine-tune the later layers.

Datasets

The paper introduces a newly collected and annotated dataset specifically for power line corridor surveillance. This dataset consists of 2199 images containing bulldozers and excavators. The annotation follows the PASCAL VOC standard. The authors filtered out images captured at night, incomplete images, duplicates, and those without relevant objects. The dataset contains 968 annotated bulldozers and 1173 annotated excavators. This custom dataset was used for training and testing, with a 5-fold cross-validation approach employed for evaluation.

Key Insights and Ideas

  • Modifying ROI Pooling Matters: Even subtle adjustments to established architectures like Faster R-CNN can yield significant improvements for specific tasks, suggesting that off-the-shelf models may not always be optimal.
  • Depth in Classification is Key: Simply relying on deep feature extraction isn't enough. Enhancing the classification stage with additional convolutional layers can significantly boost accuracy, especially in complex visual environments.
  • Custom Datasets are Crucial: For niche applications like power grid surveillance, generic datasets are insufficient. Creating and annotating a domain-specific dataset is essential for training robust models.
  • Transfer Learning is a Lifesaver: When data is scarce, transfer learning from large, general-purpose datasets (like ImageNet) is a powerful technique to initialize models and reduce training time and data requirements.

Key Results

The modified Faster R-CNN model demonstrated improved performance compared to the baseline Faster R-CNN on their custom dataset.

  • Accuracy Improvement: The authors report an average precision (AP) of 89.77% for bulldozers and 90.08% for excavators with their modified model, compared to 89.22% and 89.02% for the baseline, respectively. The mean Average Precision (mAP) improved from 89.12% to 89.93%.
  • Robustness: The system showed robustness to varying illumination conditions and even some severe weather conditions (rain, fog, snow), although performance can degrade in extreme cases.
  • Detection Time: The detection time per image for the modified model is approximately 0.32 seconds, which is comparable to the original Faster R-CNN.

Limitations and Future Work

  • Data Scarcity: While they created a dataset, the authors acknowledge that increasing the amount of data, especially for smaller objects, could further enhance performance. They observed that smaller bulldozers were sometimes missed due to a lack of similar samples in the training set.
  • False Detections: The paper notes instances of false detections, such as a truck being misclassified as a bulldozer, highlighting the ongoing challenge of distinguishing similar objects.
  • Future Work: The authors plan to focus on developing more appropriate network architectures specifically designed for engineering vehicle detection and handling more complex application scenes. They also aim to increase the dataset size.

Summary updated

Abstract

Engineering vehicles intrusion detection is a key problem for the security of power grid operation, which can warn of the regional invasion and prevent external damage from architectural construction. In this paper, we propose an intelligent surveillance method based on the framework of Faster R-CNN for locating and identifying the invading engineering vehicles. In our detection task, the type of the objects is varied and the monitoring scene is large and complex. In order to solve these challenging problems, we modify the network structure of the object detection model by adjusting the position of the ROI pooling layer. The convolutional layer is added to the feature classification part to improve the accuracy of the detection model. We verify that increasing the depth of the feature classification part is effective for detecting engineering vehicles in realistic transmission lines corridors. We also collect plenty of scene images taken from the monitor site and label the objects to create a fine-tuned dataset. We train the modified deep detection model based on the technology of transfer learning and conduct training and test on the newly labeled dataset. Experimental results show that the proposed intelligent surveillance method can detect engineering vehicles with high accuracy and a low false alarm rate, which can be used for the early warning of power grid surveillance.
BibTeX
@inproceedings{xiang2018engineering,
  author = {Xuezhi Xiang and Ning Lv and Xinli Guo and Shuai Wang and Abdulmotaleb El-Saddik},
  title = {{Engineering Vehicles Detection Based on Modified Faster R-CNN for Power Grid Surveillance}},
  booktitle = {Sensors},
  year = {2018},
  url = {https://openreview.net/forum?id=VfWc2LRCyz},
}
Figure