Deep Learning for Micro-Scale Crack Detection on Imbalanced Datasets Using Key Point Localization

Fatahlla Moreh, Yusuf Hasan, Mohammad Ammar, Bilal Zahid Hussain, Sven TomfordeSubmission to ICLR 2025 · Rejected

TL;DR

Detecting internal micro-scale cracks typically relies on dense pixel-wise segmentation, which suffers from severe class imbalance and heavy compute requirements. This paper reframes internal crack detection from non-visual, spatio-temporal seismic wave data as a 4-point bounding box coordinate regression problem. Using a multi-scale "wide" convolutional network with attention, the method achieves an average bounding IoU of 0.511 across all micro-cracks while training over seven times faster than prior deep segmentation baselines.

What Problem Does This Paper Address?

Structural health monitoring often requires identifying internal micro-cracks that are completely invisible on a material's surface. Engineers detect these flaws by analyzing how mechanical or seismic waves disperse through the material: cracks scatter, refract, and disrupt wave propagation.

Historically, deep learning approaches have tackled this using pixel-wise semantic segmentation masks. However, this creates a punishing class imbalance—micro-scale cracks occupy only a tiny fraction of the overall spatial grid, biasing networks toward predicting background ("no-crack") pixels. Furthermore, dense segmentation over long time-series sensor arrays incurs massive computational and memory overhead.

Methods

The authors introduce MicroCrackPointNet, an architecture designed to locate cracks by directly predicting bounding keypoint coordinates rather than classifying individual grid cells:

  • Keypoint Localization: Instead of a segmentation mask, the network outputs four normalized coordinates defining the bounding boundary of the crack, bypassing the majority-background class imbalance entirely.
  • Temporal Downsampling: Raw inputs consist of wave displacement data across 2,000 time steps and an array of 81 sensors ($9 \times 9$ grid) with two directional components (shape: 2000 × 81 × 2). A 1D MaxPooling layer downsamples the temporal dimension by a factor of 4 (down to 500 time steps), filtering for the strongest wave disturbance signals.
  • Wide Multi-Scale Convolutions: Rather than stacking deep layers, the network employs wide Inception-style blocks with parallel $1\times1$, $3\times3$, and $5\times5$ convolutional branches alongside a pooling branch. This captures local fine-grained variations and global wave dispersion patterns simultaneously.
  • Self-Attention & Regression Head: Spatial pooling stages are followed by self-attention mechanisms to recalibrate important sensor regions. The extracted representations pass through dimensional reduction layers and dense layers to output the four boundary coordinates, trained using regression losses (MSE, MAE, and Huber loss).

Datasets

  • Synthetic dLEM Dataset: Real-world internal crack measurements are prohibitively expensive and difficult to label. The authors use data generated via the dynamic Lattice Element Method (dLEM), simulating seismic wave mechanics across cracked material lattices.
  • Data Specifications: Wave motion (displacements) is recorded across 2,000 time steps over a $9 \times 9$ sensor grid. Bounding coordinates are extracted from 2D ground-truth masks by determining the spatial extremes of the crack with an added one-pixel margin.

Key Insights and Ideas

  • Reformulating Dense Segmentation as Coordinate Regression: Eliminating pixel-level classification fundamentally bypasses the extreme spatial imbalance typical of structural micro-defects.
  • Wide vs. Deep Architectures for Wave Mechanics: Wave disturbance features span multiple spatial scales at any given instant. Inception-style wide architectures extract multi-scale spatial correlations far more efficiently than ultra-deep 1D networks.
  • Evaluating True Geometric Overlap: The authors highlight an evaluation artifact in earlier segmentation models (like 1D-DenseNet200E): pixel-level IoU can be inflated by thresholding decisions and skewed by high true-negative regions, whereas bounding-box IoU, Purity (precision), and Integrity (recall) give a truer reflection of spatial crack localization.

Key Results

  • Detection Accuracy:
  • Overall IoU: Achieves an average Intersection-over-Union (IoU) of 0.511 for all micro-cracks ($> 0.00\,\mu\text{m}$), climbing to 0.632 for cracks $> 4.0\,\mu\text{m}$.
  • Purity & Integrity: Purity increases from 0.655 (all cracks) to 0.829 (larger cracks); Integrity scales from 0.678 to 0.760.
  • Regression Errors: Reaches an MAE of 0.0731, MSE of 0.0134, and Huber Loss of 0.0067.
  • Computational Efficiency:
  • MicroCrackPointNet requires only 90 layers and 1.23M parameters, compared to 444 layers and 1.39M parameters for 1D-DenseNet200E.
  • Total training time dropped from 15,560.56 seconds (~4.3 hours) down to 2,160.53 seconds (~36 minutes)—a 7.2× speedup.

Limitations and Future Work

  • Single-Crack Assumption: The current formulation can only detect one rectangular crack per sample using four fixed coordinates. It cannot represent branched, curved, or multiple simultaneous cracks.
  • Purely Synthetic Data: Evaluations rely entirely on numerical dLEM simulations; real-world acoustic noise, imperfect sensor couplings, and heterogeneous materials remain untested.
  • Future Directions: The authors propose incorporating multi-object detection paradigms (e.g., YOLO or Faster R-CNN) with flexible polygonal keypoints to handle complex multi-crack geometries, alongside recurrent neural networks (RNNs) to better capture continuous temporal dependencies in wave propagation.

Summary updated

Abstract

Internal crack detection has been a subject of focus in structural health monitoring. By focusing on crack detection in structural datasets, it is demonstrated that deep learning (DL) methods can effectively analyse seismic wave fields interacting with micro-scale cracks, which are beyond the resolution of conventional visual inspection. This work explores a novel application of DL based key point detection technique, where cracks are localized by predicting the coordinates of four key points that define a bounding region of the crack. The study not only opens new research directions for non-visual applications but also effectively mitigates the impact of imbalanced data which poses a challenge for previous DL models, as it can be biased toward predicting the majority class (non-crack regions). Popular DL techniques, such as the Inception blocks are used and investigated. The model shows an overall reduction in loss when applied to micro-scale crack detection and is reflected in the lower average deviation between the location of actual and predicted cracks, with an average IOU being 0.511 for all micro cracks (> 0.00 µm) and 0.631 for larger micro cracks (> 4 µm).
BibTeX
@misc{moreh2024deep,
  author = {Fatahlla Moreh and Yusuf Hasan and Mohammad Ammar and Bilal Zahid Hussain and Sven Tomforde},
  title = {{Deep Learning for Micro-Scale Crack Detection on Imbalanced Datasets Using Key Point Localization}},
  year = {2024},
  eprint = {2411.10389},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2411.10389},
}
Figure