A Local Gaussian Filter and Adaptive Morphology as Tools for Completing Partially Discontinuous Curves

Przemyslaw Spurek, Alena Chaikouskaya, Jacek Tabor, Elzbieta Zajac

TL;DR

This paper introduces a novel two-step method combining a local Gaussian filter with adaptive morphology to effectively connect and reconstruct discontinuous curves found in electron microscopy images of metal nanograins. This approach is crucial for analyzing the structure of nanograins, which impacts nanosensor performance.

What Problem Does This Paper Address?

Analyzing the structure of materials at the nanoscale is vital for developing advanced technologies like nanosensors. Specifically, this paper focuses on electron microscopy (EM) images of carbonaceous-nanopalladium (nPd-C) films. These films contain palladium nanograins embedded in a carbon matrix, and their topography is critical for sensor characteristics. The challenge arises because the wire-like structures formed by agglomerated nanograins in these images often appear as discontinuous curves with breaks of varying widths. Existing methods struggle to reliably connect these broken segments, especially when the breaks are significant or the nanograins have diverse shapes and sizes. This paper aims to provide a robust solution for detecting and completing these fragmented curve-type structures.

Methods

The proposed method consists of two main stages:

  1. Local Gaussian Filter: Instead of a standard Gaussian filter, this method employs a local Gaussian filter. This means the filter's weights are adapted based on the local properties of the image, specifically using a weighted covariance matrix. This allows the filter to blur curve segments in a way that considers their local direction and intensity, effectively bridging small gaps and creating a more continuous, albeit blurred, representation. The background, which often has a more uniform texture, is smoothed into a uniform layer.
  2. Adaptive Morphology Operation: Following the Gaussian filtering and thresholding (using the CEC algorithm), an adaptive morphology operation is applied. Unlike traditional morphology that uses a fixed structural element, this method uses an elliptical structural element whose size and orientation are determined locally by the covariance matrix derived from the image data. This allows the operation to intelligently extend the curve segments specifically in the direction of the gaps, rather than uniformly in all directions, which can lead to unwanted artifacts. The decision to apply the morphology operation is based on the eigenvalues of the covariance matrix, aiming to fill gaps only when necessary and in the most appropriate way.

Finally, the process includes skeletonization, thinning, and pruning to extract a clean, optimal curve that represents the completed structure.

Datasets

The paper primarily uses electron microscopy (EM) images of carbonaceous-nanopalladium (nPd-C) films for demonstration and evaluation. Specific examples are shown in Figures 1, 2, 4, 5, 7, 8, 10, 11, and 12. The paper also mentions potential applications to satellite images of Earth for road and river detection, referencing existing work in that domain. No new datasets were introduced.

Key Insights and Ideas

  • Local Adaptability is Key: The core insight is that adapting image processing operations (like Gaussian filtering and morphology) to local image properties, rather than using global or fixed parameters, is crucial for handling complex, discontinuous structures.
  • Covariance Matrix as a Geometric Descriptor: The weighted covariance matrix serves as a powerful tool to capture local image structure, providing information about direction and scale. This is leveraged to guide both the blurring and the morphological expansion.
  • Adaptive Morphology for Targeted Gap Filling: The adaptive nature of the morphology operation, using elliptical structural elements tailored to local image geometry, is significantly more effective than classical morphology for filling gaps in curves without over-expanding the structures.
  • Bridging Small vs. Large Gaps: The Gaussian filter is effective for smaller gaps, while the adaptive morphology handles larger ones, creating a synergistic two-step approach.

Key Results

The paper demonstrates the effectiveness of the proposed method through visual examples.

  • The local Gaussian filter successfully blurs curve segments and smooths the background, making the curves more amenable to thresholding.
  • The adaptive morphology operation effectively connects discontinuous curve segments, filling gaps that remain after the Gaussian filtering and thresholding stages.
  • The final output is a well-defined, completed curve that accurately represents the underlying nanostructure.
  • The method is shown to be more effective than classical dilation in filling gaps without introducing excessive noise or artifacts (as seen in Figure 8).
  • The paper also shows successful application to line detection in synthetic images (Figure 11), suggesting broader applicability.

Quantitative results are not explicitly detailed in terms of metrics like accuracy or success rate, but the qualitative results are presented as strong evidence of the method's efficacy.

Limitations and Future Work

  • Parameter Selection: The method requires defining parameters such as the neighborhood radius (r) for both the Gaussian filter and the adaptive morphology, and a parameter (α) for the morphology operation. The paper acknowledges that choosing an optimal value for α can be difficult and depends on the neighborhood size and the geometry of the gaps.
  • Computational Complexity: While not explicitly detailed, adaptive methods often involve higher computational costs than fixed-parameter approaches.
  • Future Work: The authors suggest that the method could be used to estimate the length of rivers in satellite images. They also mention that the presented algorithm can be used for other types of images, such as connecting parts of rivers and roads divided by bridges in satellite images. An implementation of the local Gaussian filter and adaptive morphology operation as a plug-in for ImageJ is available.

Summary updated

Abstract

This paper presents a method for extraction and analysis of curve–type structures, which consist of disconnected components. Such structures are found in electron–microscopy (EM) images of metal nano- grains, which are widely used in the field of nanosensor technology. The topography of metal nanograins in compound nanomaterials is crucial to nanosensor characteristics. The method of completing such templates consists of three steps. In the first step, a local Gaussian filter is used with different weights for each neighborhood. In the second step, an adaptive morphology operation is applied to detect the endpoints of curve segments and connect them. In the last step, pruning is employed to extract a curve which optimally fits the template.
BibTeX
@inproceedings{spurek2014local,
  author = {Przemyslaw Spurek and Alena Chaikouskaya and Jacek Tabor and Elzbieta Zajac},
  title = {{A Local Gaussian Filter and Adaptive Morphology as Tools for Completing Partially Discontinuous Curves}},
  booktitle = {CISIM},
  year = {2014},
  doi = {10.1007/978-3-662-45237-0\_51},
}
Figure