Comparative Studies on Similarity Measures for Remote Sensing Image Retrieval Based on Histogram

Qian Bao, Ping Guo, 北京师范大学图像处理与模式识别实验室 北京100875National 2006 · DOI

TL;DR

This paper provides a comprehensive evaluation of histogram-based similarity measures for retrieving remote sensing images. Beyond identifying "hidden gem" metrics like $\chi^2$ distance and Cosine similarity, the authors propose a novel retrieval method for images with distinct target-background distributions by modeling them as Gaussian mixtures and applying K-Nearest Neighbor (K-NN) logic.

What Problem Does This Paper Address?

As satellite technology advances, the volume of remote sensing data is exploding, making efficient image retrieval a critical bottleneck. Traditional "content-based" retrieval relies on measuring the "distance" between image features (like histograms). However, there is no universal standard for which distance metric works best for the unique characteristics of remote sensing data.

Furthermore, many remote sensing images aren't just a random jumble of pixels; they often consist of a clear "target" (e.g., a building or a specific crop) against a "background" (e.g., soil or water). This creates complex, often bimodal, pixel distributions that standard single-distribution similarity measures struggle to characterize accurately.

Methods

The authors split their investigation into two main experimental groups:

  1. Feature Vector-Based Measures: They tested eight standard metrics across both frequency and cumulative histogram spaces. These included:
  2. Minkowski Distances: Manhattan ($r=1$), Euclidean ($r=2$), and Hausdorff ($r=\infty$).
  3. Statistical/Information Metrics: $\chi^2$ statistical distance, Kullback-Leibler (K-L) divergence, and Histogram Intersection.
  4. Geometric/Moment Metrics: Cosine similarity and Central Moments (up to the 3rd order).
  5. Probability-Based Measures (The Novel Approach): For images with distinct targets and backgrounds, the authors modeled the histograms as Gaussian Mixture Models (GMMs).
  6. They used Savitzky-Golay smoothing to eliminate noise and find the "valley" between peaks to set a threshold.
  7. They estimated parameters for the target and background distributions.
  8. They then applied class separability criteria—specifically Bhattacharyya distance, Divergence, and the Fisher criterion—combined with a K-NN rule to calculate similarity between these complex distributions.

Datasets

The study utilized sub-images extracted from Indian satellite imagery:

  • Experiment 1: A small library of 60 sub-images (100x100 pixels) categorized into three classes: Water (W), Mountains (M), and Administrative Units (U).
  • Experiment 2: 30 sub-images specifically chosen for having clear target-background distinctions to test the GMM-based approach.

Key Insights and Ideas

  • The "Hidden Gems": While Euclidean distance is a common default, the authors found that $\chi^2$ statistical distance and Cosine similarity—metrics less commonly used in remote sensing at the time—actually provided superior and more stable retrieval performance.
  • Histogram Space Matters: The effectiveness of a metric changes depending on whether you are looking at a standard frequency histogram or a cumulative one. For instance, Histogram Intersection performs better on frequency histograms, while Central Moments and K-L divergence are better suited for cumulative ones.
  • Modeling Complexity: The "aha moment" here is that treating an image as a mixture of two distributions (target vs. background) rather than one global distribution allows for much more precise similarity matching in specific remote sensing contexts.

Key Results

  • Top Performers: In the general retrieval test, the $\chi^2$ distance achieved the highest average return accuracy (AE) at approximately 89% in the frequency histogram space.
  • Stability: Cosine similarity proved to be one of the most stable metrics, performing consistently well across different types of terrain and histogram spaces.
  • GMM Success: In the targeted second experiment, the Bhattacharyya distance and Divergence measures both achieved high average accuracies (ranging from 76% to 92%), significantly outperforming the Fisher criterion, which struggled with the complexity of the distributions.

Limitations and Future Work

The primary limitation acknowledged is the scale of the dataset; the experiments were conducted on a relatively small number of sub-images from a single source. Additionally, the study focused on single-band images, whereas modern remote sensing often deals with multi-spectral or hyper-spectral data.

The authors suggest that future work should explore:

  • Integrating multiple similarity measures to create a "hybrid" retrieval system.
  • Scaling the GMM approach to handle multi-modal distributions (more than just two peaks).
  • Testing these methods on larger, multi-source databases to ensure broader applicability.

Summary updated

Abstract

ç›¸ä¼¼æ€§åº¦é‡æ˜¯ç”¨äºŽç ”ç©¶å¤šæºæ•°æ®ä¹‹é—´ç›¸ä¼¼ç¨‹åº¦çš„,æ˜¯å¯¹ç©ºé—´æ•°æ®è¿›è¡Œæ¨¡å¼è¯†åˆ«çš„åŸºç¡€ã€‚é€šè¿‡å•æ³¢æ®µé¥æ„Ÿå›¾åƒçš„æ£€ç´¢å¯¹ä¸¤ç»„ç›´æ–¹å›¾ç›¸ä¼¼æ€§æ£€ç´¢æ–¹æ³•è¿›è¡Œäº†å®žéªŒç ”ç©¶,即基于特征向量的相似性度量和基于概率的相似性度量。实验中发现第一组相似度量中有两种以往较少用于遥感图像检索的方法表现出色,它们分别是2χ统计距离和相似夹角余弦度量。第二组实验中,é’ˆå¯¹å ¶ä¸­åŒ å«è¾ƒæ˜Žæ˜¾çš„ç›®æ ‡ç‰©ä½“ä¸”èƒŒæ™¯è¾ƒä¸ºå•ä¸€çš„é¥æ„Ÿå›¾åƒï¼ˆå ¶ç›´æ–¹å›¾å¯çœ‹ä½œæ··åˆé«˜æ–¯åˆ†å¸ƒï¼‰,在类别可分离判据的基础上,æ ¹æ®K-近邻法则提出了一种计算该类图像之间相似值的方法。实验结果表明基于K-近邻法则的计算方法行之有效。所得出的结论将对多源数据分析中相似性度量的理解与选择有积极意义。
BibTeX
@inproceedings{bao2006comparative,
  author = {Qian Bao and Ping Guo and 北京师范大学图像处理与模式识别实验室 北京100875},
  title = {{Comparative Studies on Similarity Measures for Remote Sensing Image Retrieval Based on Histogram}},
  booktitle = {National},
  year = {2006},
  doi = {10.11834/jrs.200606131},
}
Figure