Reidentification of Objects From Aerial Photos With Hybrid Siamese Neural Networks

Alessio Devoto, Indro Spinelli, Francesca Murabito, Fabrizio Chiovoloni, Riccardo Musmeci, Simone ScardapaneIEEE Trans. Industrial Informatics 2023 · DOI · OpenReview

Abstract

Maintaining national power grids requires frequent aerial inspections of millions of components. A critical challenge in this process is object re-identification (Re-ID)—the ability to match specific assets, such as electric poles, across different inspection flights taken from varying angles and altitudes. This paper presents a hybrid Siamese neural network that combines convolutional visual features with structural graph data. By modeling electric poles as graphs of constituent parts (e.g., insulators, transformers), the system achieves a CMC@1 of 0.9306, significantly outperforming traditional image-only methods.

Introduction

In Italy alone, the national power grid spans over 74,000 km, requiring constant monitoring via helicopters and drones. For engineers, the primary difficulty lies in identifying whether an asset in a current image is the same individual unit recorded in previous surveys. Unlike person Re-ID, where clothing provides high-variance cues, industrial assets like electric poles are often structurally identical and set against similar rural backgrounds. Furthermore, changes in camera perspective, lighting, and weather can drastically alter the global visual signature of a pole, making standard Convolutional Neural Network (CNN) approaches insufficient.

Methodology: The Hybrid Pipeline

The researchers propose that the unique "fingerprint" of an industrial asset lies in its topology—the specific spatial arrangement of its sub-components. To capture this, they developed a multi-stage hybrid pipeline.

The hybrid pipeline: combining asset detection, visual feature extraction via ResNet-34, and structural analysis via Graph Neural Networks.
  1. Asset Detection: An EfficientDet-D2 model identifies the pole and its individual components (e.g., jumpers, insulators).
  2. Visual Branch: Detected assets are cropped and processed through a ResNet-34 to extract texture and appearance embeddings.
  3. Graph Branch: The system constructs a graph where nodes represent assets and edges represent spatial proximity. To process this structural data, the authors utilized Chebyshev Graph Neural Networks, which use higher-order polynomials to aggregate neighborhood information more effectively than standard GCNs.
  4. Feature Fusion: The visual and structural embeddings are concatenated to form a comprehensive representation of the asset.

Training Strategy: Metric Learning

To train the model to distinguish between identical-looking poles, the authors employed a Siamese architecture governed by a triplet loss function. This approach compares three samples simultaneously: an anchor image, a positive sample (the same pole from a different angle), and a negative sample (a different but similar-looking pole).

The Siamese architecture utilizes triplet loss to minimize distance between anchor-positive pairs and maximize distance from negative samples.

The triplet loss forces the network to map the anchor and positive samples close together in the embedding space while pushing the negative sample away. This ensures that the model learns to prioritize the subtle structural differences that define a unique asset.

Experimental Results

The study utilized a proprietary dataset from Enel S.p.A., featuring nearly 9,000 images of electrical lines with diverse morphologies. The hybrid model demonstrated superior performance across all key metrics:

  • Top-1 Accuracy (CMC@1): 0.9306
  • Mean Average Precision (mAP): 0.788

Comparatively, a standard Siamese CNN focusing only on the pole's global appearance achieved a CMC@1 of 0.876. The inclusion of graph-based structural information provided a 6 percentage point relative improvement, proving that topology is a more stable descriptor than raw visual appearance in aerial Re-ID tasks.

Conclusion

By fusing visual deep learning with Graph Neural Networks, this research provides a robust framework for industrial object re-identification. The results suggest that structural reasoning—understanding how parts relate to one another—is essential for distinguishing between complex, mass-produced objects in cluttered environments. Future work may involve end-to-end training of the detector and Re-ID components to further enhance system robustness.

Summary updated

Abstract

In this article, we consider the task of reidentifying the same object in different photos taken from separate positions and angles during aerial reconnaissance, which is a crucial task for the maintenance and surveillance of critical large-scale infrastructure. To effectively hybridize deep neural networks with available domain expertise for a given scenario, we propose a customized pipeline, wherein a domain-dependent object detector is trained to extract the assets (i.e., subcomponents) present on the objects, and a siamese neural network learns to reidentify the objects, exploiting both visual features (i.e., the image crops corresponding to the assets) and the graphs describing the relations among their constituting assets. We describe a real-world application concerning the reidentification of electric poles in the Italian energy grid, showing our pipeline to significantly outperform siamese networks trained from visual information alone. We also provide a series of ablation studies of our framework to underline the effect of including topological asset information in the pipeline, learnable positional embeddings in the graphs, and the effect of different types of graph neural networks on the final accuracy.
BibTeX
@article{devoto2023reidentification,
  author = {Alessio Devoto and Indro Spinelli and Francesca Murabito and Fabrizio Chiovoloni and Riccardo Musmeci and Simone Scardapane},
  title = {{Reidentification of Objects From Aerial Photos With Hybrid Siamese Neural Networks}},
  journal = {IEEE Trans. Industrial Informatics},
  year = {2023},
  doi = {10.1109/tii.2022.3184407},
}
Figure