Detection and analysis of deteriorated areas in solar PV modules using unsupervised sensing algorithms and 3D augmented reality

Adel Oulefki, Yassine Himeur, Thaweesak Trongtirakul, Kahina Amara, Sos С. Agaian, Samir Benbelkacem, Mohamed Amine Guerroudji, Mohamed Zemmouri, Sahla Ferhat, Nadia Zenati, Shadi Atalla, Wathiq Mansoor

TL;DR

This paper introduces a novel method for automatically detecting and analyzing defects like hotspots and snail trails in solar PV modules using unsupervised sensing algorithms and 3D Augmented Reality (AR). By combining these techniques, the approach aims to significantly improve the efficiency and reduce the cost of PV system maintenance, offering a more precise and automated solution than current methods.

What Problem Does This Paper Address?

Solar photovoltaic (PV) systems are crucial for global energy security, but their performance can degrade due to issues like hotspots and snail trails, often caused by module cracks. These defects reduce efficiency and power output. Traditional methods for identifying these problems are often manual, time-consuming, and can be inaccurate, especially for large-scale installations. The paper addresses the need for an automated, efficient, and precise system for detecting and visualizing these anomalies to optimize PV system maintenance and performance.

Methods

The proposed methodology integrates several key techniques:

  • Abnormality Analysis: Initially, thermal images are analyzed to identify potential issues. This involves calculating temperature thresholds (Tmax, Tmin, Tmean) to flag modules that deviate from normal operating conditions.
  • Segmentation Framework: For flagged modules, a segmentation framework is employed to isolate the deteriorated areas. This framework utilizes:
  • Exponential Stretching Function: A novel non-linear stretching technique to enhance image contrast and better delineate luminance levels, particularly in bright regions.
  • Region Growing-Based Segmentation: An algorithm that groups similar pixels to form regions, aiding in the precise identification of anomalies.
  • 3D Augmented Reality (AR) Visualization: The segmented deteriorated areas are then integrated into a 3D model of the PV module. This AR visualization allows maintenance personnel to see the exact location and extent of damage in a realistic, interactive environment, facilitating quicker and more accurate repairs. The 3D models were created using SolidWorks and Blender.

Datasets

The study utilized two datasets for training and evaluation:

  • Cali-Thermal Solar Panels Database: This dataset comprises a wide range of test images depicting various types of solar panel deterioration.
  • Solar Panel Infrared Images v5: This dataset contains 934 annotated infrared images of solar panels, specifically formatted for object detection tasks.

Key Insights and Ideas

  • Synergy of Unsupervised Sensing and AR: The core innovation lies in the seamless integration of unsupervised sensing algorithms for anomaly detection and AR for intuitive visualization. This combination moves beyond simple defect identification to provide actionable, spatially-aware information.
  • Automated Diagnosis for Efficiency: By automating the detection and analysis process, the approach significantly reduces the reliance on manual inspections, which are prone to human error and time constraints.
  • Cost Reduction and Performance Boost: Precise anomaly localization through AR visualization directly translates to faster repairs, reduced downtime, and ultimately, lower maintenance costs and improved energy output from PV systems.
  • Beyond Hotspots: While the paper focuses on hotspots and snail trails, the underlying segmentation and visualization framework has the potential to be adapted for detecting a wider range of PV module defects.

Key Results

The proposed method demonstrated superior performance compared to existing approaches like Weka and Meta (Segment Anything Model) in visual inspection and statistical metrics.

  • Statistical Performance: The proposed method achieved the following mean values in key segmentation metrics:
  • Jaccard Index (IoU): 0.7680

    • Dice Similarity Coefficient (DSC): 0.8232
    • Precision: 0.9045
    • Recall: 0.9961
    • Rand Index (RI): 0.7680 These scores indicate a high degree of accuracy and reliability in segmenting deteriorated areas.
  • Visual Inspection: Subjective evaluations indicated that the proposed method achieved more accurate and precise segmentation of hotspots compared to Meta and Weka, with Weka tending to over-segment.

  • Heat-map Analysis: This technique effectively highlighted deteriorated areas, with brighter colors indicating higher levels of surface deterioration.

Limitations and Future Work

  • Dataset Size: The authors acknowledge that the study was evaluated on a limited set of degraded imagery samples. More extensive testing is needed to assess the method's effectiveness on a larger scale.
  • Scope of Defects: The current focus is on detecting and segmenting deteriorated cells. Future research could explore other aspects of PV maintenance, such as broader fault detection and diagnosis.
  • Future Integration: The paper suggests exploring generative models (like ChatGBT and GBT-4) to further enhance AR-based visualization and localization. This could lead to more dynamic and adaptive maintenance systems, including real-time monitoring and proactive alerts. The integration of real-time monitoring systems with AI could also enable proactive maintenance strategies.

Summary updated

Abstract

Solar Photovoltaic (PV) systems are increasingly vital for enhancing energy security worldwide. However, their efficiency and power output can be significantly reduced by hotspots and snail trails, predominantly caused by cracks in PV modules. This article introduces a novel methodology for the automatic segmentation and analysis of such anomalies, utilizing unsupervised sensing algorithms coupled with 3D Augmented Reality (AR) for enhanced visualization. The methodology outperforms existing segmentation techniques, including Weka and the Meta Segment Anything Model (SAM), as demonstrated through computer simulations. These simulations were conducted using the Cali-Thermal Solar Panels and Solar Panel Infrared Image Datasets, with evaluation metrics such as the Jaccard Index, Dice Coefficient, Precision, and Recall, achieving scores of 0.76, 0.82, 0.90, 0.99, and 0.76, respectively. By integrating drone technology, the proposed approach aims to revolutionize PV maintenance by facilitating real-time, automated solar panel detection. This advancement promises substantial cost reductions, heightened energy production, and improved performance of solar PV installations. Furthermore, the innovative integration of unsupervised sensing algorithms with 3D AR visualization opens new avenues for future research and development in the field of solar PV maintenance.
BibTeX
@inproceedings{oulefki2024detection,
  author = {Adel Oulefki and Yassine Himeur and Thaweesak Trongtirakul and Kahina Amara and Sos С. Agaian and Samir Benbelkacem and Mohamed Amine Guerroudji and Mohamed Zemmouri and Sahla Ferhat and Nadia Zenati and Shadi Atalla and Wathiq Mansoor},
  title = {{Detection and analysis of deteriorated areas in solar PV modules using unsupervised sensing algorithms and 3D augmented reality}},
  booktitle = {Heliyon},
  year = {2024},
  doi = {10.1016/j.heliyon.2024.e27973},
}
Figure