Simulation-aided infrared thermography with decomposition-based noise reduction for detecting defects in ancient polyptychs

Guimin Jiang, Xin Wang, Jue Hu, Yang Wang, Xin Li, Dazhi Yang, Miranda Mostacci, Стефано Сфарра, Xavier Maldague, Qiang Jiang, Hai ZhangHeritage 2023 · DOI

TL;DR

This paper presents a novel approach for detecting hidden defects in ancient polyptychs using infrared thermography (IRT). By combining numerical simulations with a sophisticated noise reduction technique (LRTDTV), the researchers can accurately identify subsurface flaws without damaging delicate artworks, a crucial advancement for cultural heritage preservation.

What Problem Does This Paper Address?

The conservation of ancient cultural heritage is a delicate process, and non-destructive testing (NDT) methods are essential to avoid causing further damage. Infrared thermography (IRT) is a promising NDT technique for detecting defects in artworks, as it can reveal subsurface anomalies by analyzing heat transfer patterns. However, IRT images often suffer from significant noise, which can obscure subtle defects, making accurate detection challenging. Furthermore, conducting repeated experiments on priceless artifacts is often impossible due to the risk of damage. This paper addresses these challenges by developing a method that leverages numerical simulations to predict thermal behavior and a robust image processing technique to enhance defect visibility in experimental IRT data, all while minimizing the need for extensive testing on actual artifacts.

Methods

The core of this research lies in a two-pronged approach:

  • Numerical Simulation: To understand the heat transfer dynamics and predict temperature distributions without repeatedly testing the actual samples, the researchers created detailed 3D geometric models of polyptych mock-ups. These models were built using COMSOL Multiphysics, incorporating the material properties of the pigments and layers. This simulation step is crucial for verifying experimental procedures and reducing the number of physical tests required.
  • Decomposition-Based Noise Reduction (LRTDTV): To improve the quality of the experimental IRT images and enhance defect detectability, a Total-Variation Regularized Low-Rank Tensor Decomposition (LRTDTV) algorithm was employed. This advanced technique is designed to effectively reduce various types of noise (Gaussian, impulse, etc.) by exploiting the spatial and spectral correlations within the thermographic image sequences. The method aims to decompose the noisy image into a clean image, sparse noise, and Gaussian noise components. Following denoising, a Fourier transform is applied to further enhance image contrast and clarity.

Datasets

The study utilized two mock-up polyptych samples, meticulously recreated based on a 14th-century painting by Pietro Lorenzetti. These mock-ups were crafted using the traditional tempera technique and incorporated artificial defects (simulated by Teflon inserts) at various depths and locations. These samples served as the primary "dataset" for both the numerical simulations and the experimental IRT acquisition.

Key Insights and Ideas

  • Simulation as a Precursor: The study highlights the power of numerical simulation in art conservation. By accurately modeling heat transfer, researchers can optimize experimental setups and predict outcomes, significantly reducing the risk of damaging priceless artifacts.
  • Tensor Decomposition for Heritage Science: The application of tensor decomposition (specifically LRTDTV) for denoising IRT images of cultural heritage is a novel contribution. This method proves effective in capturing complex spatial-spectral relationships, leading to cleaner images where subtle defects become more apparent.
  • Balancing Noise Reduction and Defect Visibility: The LRTDTV method, combined with a Fourier transform, effectively reduces noise while simultaneously enhancing the contrast of defects. This is critical for distinguishing between genuine flaws and image artifacts.
  • Defect Depth Matters: The study demonstrates that the depth of a defect influences its detectability. While shallower defects are generally easier to spot, the proposed method shows promise in identifying even those located deeper within the artwork.

Key Results

  • Simulation-Experiment Correlation: The numerical simulations showed a good match with the experimental surface temperature measurements, validating the simulation approach.
  • Effective Noise Reduction: The LRTDTV denoising method significantly reduced Gaussian noise in the thermographic images.
  • Enhanced Defect Detection: After processing, defects that were barely visible in the raw images became much clearer. For instance, defect 3 was consistently detected in both simulated and experimental images.
  • Quantitative Assessment: Metrics like SSIM, PSNR, and ERGAS were used to compare simulated and experimental data, showing similar trends and confirming the reliability of the simulations. For sample A, the processed image showed a decrease in MC and an increase in HFM and HS, indicating enhanced defect contrast.

Limitations and Future Work

  • Sample Specificity: The study focused on two specific mock-up samples. While representative, the generalization of the method to a wider range of ancient artworks with varying materials and degradation states requires further investigation.
  • Defect Type Limitations: The artificial defects were Teflon inserts. Future work could explore the detection of naturally occurring defects like cracks, delaminations, or pigment degradation.
  • Computational Cost: While effective, tensor decomposition can be computationally intensive. Further optimization of the algorithm for faster processing could be beneficial.
  • Material Complexity: The paper acknowledges the complexity of mineral pigments and their impact on thermal properties. Future research could delve deeper into characterizing these properties for more precise simulations.

Summary updated

Abstract

In recent years, the conservation and protection of ancient cultural heritage have received increasing attention, and non-destructive testing (NDT), which can minimize the damage done to the test subject, plays an integral role therein. For instance, NDT through active infrared thermal imaging can be applied to ancient polyptychs, which can realize accurate detection of damage and defects existing on the surface and interior of the polyptychs. In this study, infrared thermography is used for non-invasive investigation and evaluation of two polyptych samples with different pigments and artificial defects, but both reproduced based on a painting by Pietro Lorenzetti (1280/85-1348) using the typical tempera technique of the century. It is noted that, to avoid as far as possible secondary damages done to the ancient cultural heritages, repeated damage-detection experiments are rarely carried out on the test subjects. To that end, numerical simulation is used to reveal the heat transfer properties and temperature distributions, as to perform procedural verification and reduce the number of experiments that need to be conducted on actual samples. Technique-wise, to improve the observability of the experimental results, a total variation regularized low-rank tensor decomposition algorithm is implemented to reduce the background noise and improve the contrast of the images. Furthermore, the efficacy of image processing is quantified through the structural-similarity evaluation.
BibTeX
@inproceedings{jiang2023simulation,
  author = {Guimin Jiang and Xin Wang and Jue Hu and Yang Wang and Xin Li and Dazhi Yang and Miranda Mostacci and Стефано Сфарра and Xavier Maldague and Qiang Jiang and Hai Zhang},
  title = {{Simulation-aided infrared thermography with decomposition-based noise reduction for detecting defects in ancient polyptychs}},
  booktitle = {Heritage},
  year = {2023},
  doi = {10.1186/s40494-023-01040-0},
}
Figure