Minimal Camera Networks for 3D Image Based Modeling of Cultural Heritage Objects

Bashar Alsadik, M. Gerke, George Vosselman, Afrah Daham, Luma Khalid JasimSensors 2014 · DOI

TL;DR

This paper presents a novel method for automatically designing minimal camera networks for 3D modeling of cultural heritage objects. By filtering dense image datasets, they significantly reduce image capture and processing time while maintaining high accuracy, making 3D documentation more efficient and less disruptive.

What Problem Does This Paper Address?

Creating detailed 3D models of cultural heritage objects is crucial for preservation, virtual museums, and restoration. However, traditional photogrammetry often requires capturing a very dense network of images, leading to lengthy acquisition times and massive datasets that are computationally expensive to process. This is particularly problematic for delicate artifacts that cannot be moved or for sites where visitor disruption must be minimized. The challenge is to achieve high-quality 3D models with a significantly reduced number of images, optimizing both the capture and processing phases.

Methods

The core of this research lies in developing methods to filter a pre-designed dense imaging network down to a minimal set of cameras. They propose two main strategies:

  1. Filtering based on Object Point Accuracy: This method focuses on identifying and removing redundant cameras that have the least impact on the overall accuracy of the 3D model. It leverages the relationship between ray intersection geometry and point accuracy, prioritizing camera configurations that ensure strong intersections.
  2. Filtering with Fuzzy Logic Inference (FIS) / Adaptive Neuro-Fuzzy Inference System (ANFIS): This approach aims to find a compromise between coverage and accuracy. It uses a fuzzy logic system that considers four input parameters: camera uncertainty, number of visible points per image, proximity of the image center to object points, and the area covered by points in the image plane. This system iteratively identifies and filters out redundant cameras.

Both methods are applied iteratively to ensure that the remaining cameras provide sufficient coverage and accuracy. The process involves checking visibility, classifying points (over-covered vs. fair-covered), and then filtering cameras based on their impact on accuracy or their fuzzy suitability score.

Datasets

The primary dataset used for evaluation is a dense imaging network of 45 high-resolution images captured around the "Lamassu" statue, an ancient Iraqi sculpture. This dataset was captured with a 1mm object sample distance. The paper also mentions using simulated dense networks for testing the filtering algorithms.

Key Insights and Ideas

  • Minimal networks are sufficient: The research demonstrates that a significantly reduced set of images can yield 3D models comparable in quality to those produced from dense networks.
  • Accuracy vs. Coverage Trade-off: The fuzzy logic approach effectively balances the need for good object coverage with the requirement for high positional accuracy, offering a more nuanced filtering strategy.
  • Automation is key: The proposed methods are designed to be automated, making them accessible to non-professionals in cultural heritage documentation.
  • Efficiency gains are substantial: Reducing the number of images leads to dramatic improvements in processing time, with reported reductions of over 60%.

Key Results

  • The filtering methods successfully reduced the initial 45-image dense network to 22 images (accuracy-based filtering) and 25 images (FIS-based filtering).
  • The minimal networks achieved accuracy levels comparable to the dense network, with an average RMSE of less than 5 mm for checkpoints.
  • A significant reduction in processing time (approximately 60%) was observed with the filtered networks.
  • The final 3D models produced from the minimal networks were visually comparable to those from the dense network, with minimal gaps and high detail.
  • The FIS-filtered network showed slightly better results in terms of error ellipsoids and point cloud comparison, indicating its effectiveness in balancing coverage and accuracy.

Limitations and Future Work

  • No Ground Truth for Entire Surface: The authors acknowledge that they do not have a ground truth for the entire surface of the Lamassu statue, which limits a complete validation of the 3D models.
  • General Rules are Difficult: Establishing universal rules for minimal network design is challenging due to the complexity of objects and the expertise required for image capture.
  • Future Work:
    • Investigating ANFIS or other machine learning techniques for even more reliable 3D models.
  • Applying these methods to different types of cultural heritage objects, such as ancient buildings, which might require additional considerations like facade segmentation.
  • Further development to make the automated simulation and filtering process more robust for non-professionals.

Summary updated

Abstract

3D modeling of cultural heritage objects like artifacts, statues and buildings is nowadays an important tool for virtual museums, preservation and restoration. In this paper, we introduce a method to automatically design a minimal imaging network for the 3D modeling of cultural heritage objects. This becomes important for reducing the image capture time and processing when documenting large and complex sites. Moreover, such a minimal camera network design is desirable for imaging non-digitally documented artifacts in museums and other archeological sites to avoid disturbing the visitors for a long time and/or moving delicate precious objects to complete the documentation task. The developed method is tested on the Iraqi famous statue "Lamassu". Lamassu is a human-headed winged bull of over 4.25 m in height from the era of Ashurnasirpal II (883-859 BC). Close-range photogrammetry is used for the 3D modeling task where a dense ordered imaging network of 45 high resolution images were captured around Lamassu with an object sample distance of 1 mm. These images constitute a dense network and the aim of our study was to apply our method to reduce the number of images for the 3D modeling and at the same time preserve pre-defined point accuracy. Temporary control points were fixed evenly on the body of Lamassu and measured by using a total station for the external validation and scaling purpose. Two network filtering methods are implemented and three different software packages are used to investigate the efficiency of the image orientation and modeling of the statue in the filtered (reduced) image networks. Internal and external validation results prove that minimal image networks can provide highly accurate records and efficiency in terms of visualization, completeness, processing time (>60% reduction) and the final accuracy of 1 mm.
BibTeX
@inproceedings{alsadik2014minimal,
  author = {Bashar Alsadik and M. Gerke and George Vosselman and Afrah Daham and Luma Khalid Jasim},
  title = {{Minimal Camera Networks for 3D Image Based Modeling of Cultural Heritage Objects}},
  booktitle = {Sensors},
  year = {2014},
  doi = {10.3390/s140405785},
}

Loading related content...

Figure