Automated building change detection using UltraCamD images and existing CAD data

Zhen Liu, Peng Gong, Peijun Shi, Howu Chen, Lin Zhu, T. SasagawaInternational Journal of Remote Sensing 2010 · DOI

TL;DR

This paper introduces a novel method for automatically detecting changes in urban buildings, such as collapse or height alteration, by integrating high-resolution aerial imagery with existing 3D CAD data. By comparing projected building silhouettes from CAD models with extracted image edges, the system aims to provide rapid damage assessment crucial for disaster response.

What Problem Does This Paper Address?

Following natural disasters like earthquakes or typhoons, quickly and accurately assessing building damage is critical for emergency response and urban planning. Traditional remote sensing methods struggle with high-resolution imagery due to the increased detail, texture, and varying perspectives, making it hard to distinguish genuine damage from other changes. The authors address the need for an automated, building-level change detection system that can efficiently identify collapsed, removed, or height-altered structures, especially in the context of post-disaster scenarios where timely information is paramount.

Methods

The proposed method operates in two main stages: processing on the plane (during data acquisition) and processing on the ground.

On the Plane: * Data Acquisition: High-resolution aerial images are captured using an UltraCamD sensor. * Tiled Processing: Due to the large image size, processing is done in tiles. * Edge Feature Extraction: Buildings' edge features are extracted. This involves: * Preprocessing. * Edge detection using the Canny algorithm. * Edge denoising. * Line segmentation. * Compression: Extracted edge features are compressed for efficient transmission.

On the Ground: * Uncompression and Denoising: Received edge data is uncompressed and further denoised. * CAD Data Projection: 3D CAD models of buildings are projected onto the image plane using camera parameters. This generates building silhouettes. * Silhouette Extraction: Two types of silhouettes are considered: overall and top silhouettes. * Portion Hausdorff Matching: This is the core comparison technique. It calculates the similarity between the projected CAD silhouettes and the extracted image edges. * A Voronoi surface is generated from the image edges. * The projected silhouette is used as a mask, which is moved across the Voronoi surface. * Similarity is calculated based on the distance between the mask and the Voronoi surface. * Change Detection: * Collapse/Removal: Buildings with low similarity between their projected silhouette and image edges are flagged as collapsed or removed. * Height Change: By analyzing the maximal similarity in the projection direction, changes in building height are detected.

Datasets

The method was tested using an airborne UltraCamD image over the city of Tokyo, Japan. The paper does not explicitly mention the creation or release of a new benchmark dataset.

Key Insights and Ideas

  • Leveraging CAD Data: The integration of existing 3D CAD data with high-resolution imagery is a powerful approach for building-level change detection, overcoming limitations of image-only methods.
  • Edge Features as Key Information: Focusing on edge features for buildings is an effective strategy for reducing data volume while retaining crucial structural information for damage assessment.
  • Building-by-Building Analysis: The method's strength lies in its ability to analyze changes at an individual building level, providing more granular and actionable information than broader area assessments.
  • Portion Hausdorff Matching for Similarity: This technique provides a robust way to quantify the resemblance between geometric shapes (CAD silhouettes) and image features (edges), enabling reliable change detection.

Key Results

  • Collapsed/Removed Buildings: Out of 1320 buildings tested (with 10 known to be collapsed), 45 were detected as collapsed or removed. Of these, 9 were correctly identified from the known collapsed buildings.
  • Height-Changed Buildings: For height-change detection, 2885 buildings were analyzed.
  • For a 3m height change, 429 buildings were detected, with 9 of the 27 known cases identified.
  • For a 6m height change, 483 buildings were detected, with 10 of the 27 known cases identified.
  • For a 10m height change, 456 buildings were detected, with 12 of the 27 known cases identified.

Limitations and Future Work

Limitations: * CAD Model Errors: Inaccuracies in the existing CAD data can lead to false positives or negatives. * Building Crowding/Density: Densely packed buildings make it difficult to extract individual building edges and silhouettes accurately, leading to occlusion issues. * Small Height Changes: Detecting minor changes in building height is challenging. * Displacement: Discrepancies between projected CAD silhouettes and image edges (due to data inaccuracies or perspective shifts) complicate matching and can increase sensitivity to noise. * Edge Extraction Performance: The overall accuracy is highly dependent on the quality of edge extraction, which can be affected by noise, shadows, and complex urban environments.

Future Work: * Reducing Displacement: Improving the accuracy of CAD data and camera parameters to minimize projection displacement. * Improving Edge Extraction: Developing more robust edge extraction algorithms that are less sensitive to noise and better handle complex urban scenes. * Dealing with Occlusion: Investigating techniques like depth buffer technology (used in computer graphics for hidden surface removal) to handle overlapping buildings. * Active Contours: Utilizing active contour models to refine edge detection, especially for broken or missed edges, by using CAD silhouettes as initial guides. * Typical Noise Removal: Developing specific algorithms to address common noise patterns in the imagery.

Summary updated

Abstract

The aim of this research is to develop a technique that can detect changes in urban buildings after natural disasters such as earthquakes, typhoons or tsunamis. The increasing demands for real-time and effective change detection methodologies for urban buildings, including collapsed, height-changed and removed buildings, require the use of high spatial resolution images. Conventional change detection techniques, developed for medium resolution remotely sensed data, are neither effective nor efficient due to their difficulties in discriminating real changes from changes caused by change in perspective view, as well as due to the increased spatial detail in texture and edges in high spatial resolution images. In this paper, an automatic change detection method, using UltraCamD images and existing 3-dimensional computer-aided design (CAD) data, which analyse changes at the building level, is presented. The edge features of every building in the image are first extracted, using the following steps: pre-processing, edge extraction using a Canny detector, edge denoising, and line segmentation. Then, the silhouettes of each building, which are extracted from the CAD model based on camera parameters, are projected onto the image and are compared to the edge features of each building in the image. The portion Hausdorff matching methodology is employed to calculate the similarities between the projected silhouettes of each building from the CAD model, and the edge features of each building are extracted from the image. Using the calculated similarity, collapsed or removed buildings can be detected. The maximal similarity between the edge features and the projected silhouettes in the direction of projection is used to detect changes in building height. The methods are illustrated with an airborne UltraCamD image over the city of Tokyo, Japan. The results indicate that among 1320 buildings (10 were collapsed) used in the test, 45 buildings were successfully detected to have had collapsed or been removed. Nine out of the forty-five buildings were correctly detected from the list of 10 collapsed buildings. Overall, 2885 buildings were used to test the method for detecting changes in building height, of which 11 of the 27 buildings known to have changed heights with the CAD model were successfully detected. However, our methodology faces challenges from factors such as CAD model errors, high building density, and small changes in building height.
BibTeX
@article{liu2010automated,
  author = {Zhen Liu and Peng Gong and Peijun Shi and Howu Chen and Lin Zhu and T. Sasagawa},
  title = {{Automated building change detection using UltraCamD images and existing CAD data}},
  journal = {International Journal of Remote Sensing},
  year = {2010},
  doi = {10.1080/01431160903475340},
}
Figure