A Specialized Pipeline for Efficient and Reliable 3D Semantic Model Reconstruction of Buildings from Indoor Point Clouds

Cedrique Fotsing, Willy Carlos Tchuitcheu, Lemopi Isidore Besong, Douglas W. Cunningham, Christophe Bobda

TL;DR

This paper introduces a novel, automated pipeline for reconstructing detailed 3D semantic models of multi-level buildings from indoor point clouds. By breaking down the process into specialized steps for segmenting floors, detecting walls, identifying openings, and then assembling these components hierarchically, the pipeline achieves high accuracy and efficiency, paving the way for more accessible BIM creation.

What Problem Does This Paper Address?

Creating accurate 3D Building Information Models (BIM) of existing structures is crucial for the Architecture, Engineering, and Construction (AEC) industry, aiding in everything from renovation planning to facility management. However, manually generating these models from dense 3D point cloud data acquired by laser scanners is a time-consuming, labor-intensive, and often inconsistent process. Existing automated methods often struggle with multi-level buildings, lack robustness in handling complex indoor environments, or rely on less reliable component detection techniques. This paper aims to bridge this gap by proposing an efficient and reliable automated pipeline specifically designed for reconstructing multi-level indoor building structures.

Methods

The proposed pipeline tackles the reconstruction problem through a series of specialized steps:

  • Level Segmentation: The pipeline first segments the point cloud into potential building floors using a simple histogram of Z-axis point distribution. This is a straightforward yet effective method for identifying distinct levels.
  • Wall Detection: For each floor, walls are detected using an extension of a 2D-grid approach. This involves projecting the point cloud onto a 2D plane, creating a binary grid, and then using a deterministic algorithm to extract continuous wall segments.
  • Opening Detection: After wall extraction, openings (doors and windows) are identified. This is a two-step process: first, potential holes are extracted from wall segments using a grid-based approach, and then a deep learning-based classifier is employed to distinguish between doors, windows, and non-opening holes. The classifier uses a 7-feature vector capturing characteristics like hole size and position.
  • Room and Ground Extraction: Using the detected wall constellations, new methods are proposed for room detection and ground extraction.
  • Hierarchical IFC Model Generation: Finally, the extracted architectural elements (floors, walls, ceilings, openings, rooms) are assembled hierarchically into a 3D semantic model in the Industry Foundation Classes (IFC) format. This format is chosen for its vendor-neutrality and widespread adoption in the AEC industry.

What's novel about this approach is the decomposition of the complex reconstruction task into specialized, optimized steps for each architectural element, rather than relying on global segmentation. The use of a deep learning classifier for opening detection and the hierarchical assembly into IFC are also key contributions.

Datasets

The paper mentions using the Matterport3D datasets for evaluation. These datasets are acquired using a rotating system with three color cameras and three depth cameras, resulting in dense point clouds of indoor environments. The point clouds are generated by stitching panoramic images and integrating depth information. The authors note that many Matterport3D scans have doors and windows closed, which can affect opening detection.

Key Insights and Ideas

  • Specialization is Key: Breaking down the complex task of 3D building reconstruction into specialized modules for each architectural element (floors, walls, openings) leads to more robust and accurate results than global segmentation approaches.
  • 2D Grids for 3D Structures: The clever use of 2D grid representations, derived from point cloud projections, proves effective for detecting walls and then for identifying potential openings within those walls.
  • Deep Learning for Ambiguity: Distinguishing between actual openings (doors/windows) and noise or reconstruction artifacts is a challenging problem. The paper demonstrates that a deep learning classifier, trained on specific features, can effectively handle this ambiguity.
  • Hierarchical Assembly for BIM: The final assembly into an IFC model using a hierarchical structure is crucial for creating a semantically rich and interoperable BIM, ensuring that the relationships between building components are preserved.

Key Results

The paper reports high precision and recall values in the extraction of architectural elements, ensuring the fidelity of the generated models. The pipeline's efficiency and accuracy are highlighted as valuable contributions. While specific quantitative metrics like overall accuracy percentages for the entire pipeline are not explicitly detailed in the summary, the results of the opening classification are presented:

  • Opening Classification Dataset Distribution: 59.3% noise, 28.5% doors, 12.2% windows.
  • Opening Classification Performance (Table 1):
    • Doors: Precision 0.95, Recall 0.90, F1-Score 0.92
    • Windows: Precision 0.86, Recall 0.86, F1-Score 0.86
    • Non-opening: Precision 0.98, Recall 0.99, F1-Score 0.99
  • Overall Accuracy: Macro average F1-Score of 0.93, weighted average F1-Score of 0.98.

The visual inspections confirmed that the generated models closely resembled ground truth, capturing geometric and semantic properties.

Limitations and Future Work

  • Non-Rectilinear Shapes: The authors acknowledge that the current approach struggles to represent non-rectilinear shapes, such as circular walls. While detected, they are erroneously represented as rectilinear in the final model.
  • Future Work: The paper suggests that the implemented methods can be further improved for efficiency and to handle more complex structures. The authors imply that extending the pipeline to better capture curved geometries would be a valuable future direction.

Summary updated

Abstract

Recent advances in laser scanning systems have enabled the acquisition of 3D point cloud representations of scenes, revolutionizing the fields of Architecture, Engineering, and Construction (AEC). This paper presents a novel pipeline for the automatic generation of 3D semantic models of multi-level buildings from indoor point clouds. The architectural components are extracted hierarchically. After segmenting the point clouds into potential building floors, a wall detection process is performed on each floor segment. Then, room, ground, and ceiling extraction are conducted using the walls 2D constellation obtained from the projection of the walls onto the ground plan. The identification of the openings in the walls is performed using a deep learning-based classifier that separates doors and windows from non-consistent holes. Based on the geometric and semantic information from previously detected elements, the final model is generated in IFC format. The effectiveness and reliability of the proposed pipeline are demonstrated through extensive experiments and visual inspections. The results reveal high precision and recall values in the extraction of architectural elements, ensuring the fidelity of the generated models. In addition, the pipeline’s efficiency and accuracy offer valuable contributions to future advancements in point cloud processing.
BibTeX
@article{fotsing2024specialized,
  author = {Cedrique Fotsing and Willy Carlos Tchuitcheu and Lemopi Isidore Besong and Douglas W. Cunningham and Christophe Bobda},
  title = {{A Specialized Pipeline for Efficient and Reliable 3D Semantic Model Reconstruction of Buildings from Indoor Point Clouds}},
  journal = {J. Imaging},
  year = {2024},
  doi = {10.3390/jimaging10100261},
}
Figure