TL;DR
This paper provides a comprehensive literature review on the use of Extended Reality (XR) technologies—Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR)—for the condition assessment of civil engineering structures. It highlights the growing adoption of XR in this field and identifies a critical gap in existing review studies, offering valuable insights and guidelines for researchers and practitioners.
What Problem Does This Paper Address?
Civil engineering structures, from bridges to buildings, are aging and facing increasing safety concerns. Effectively assessing their condition is crucial for maintenance, repair, and ensuring public safety. Traditional methods, while foundational, can be labor-intensive, time-consuming, and subjective. Structural Health Monitoring (SHM) has emerged as a more sophisticated approach, but visualizing and interpreting the vast amounts of data generated by SHM systems and other inspection techniques remains a challenge. The paper addresses the need for more efficient, immersive, and collaborative ways to conduct these assessments, particularly by exploring the potential of XR technologies.
Methods
The paper employs a two-phase research methodology:
- Exploratory Review: An initial broad literature search using general keywords in databases like Scopus and Google Scholar to identify relevant studies.
- Refined Review: A more focused data collection and analysis phase using specific, on-target keywords derived from the exploratory review.
The authors systematically screened and analyzed studies, ultimately including 43 papers in their review. They categorized these studies based on the XR technology used (VR, AR, or MR) and their application in civil structure condition assessment. Notably, the paper clarifies that studies using MR are presented under the AR category due to common confusion in the literature.
Datasets
Not discussed in the paper. The paper is a literature review and does not present new experimental data or datasets.
Key Insights and Ideas
- XR as a Paradigm Shift: XR technologies are not just visualization tools; they are fundamentally changing how we approach structural condition assessment by offering immersive and interactive experiences.
- Bridging the Data-to-Decision Gap: XR excels at visualizing complex SHM data, making it more accessible and understandable for inspectors and stakeholders, thus facilitating better decision-making.
- Collaboration is Key: VR environments, in particular, enable collaborative work among geographically dispersed teams, allowing multiple users to interact with the same structural model and data simultaneously.
- AR Enhances On-Site Inspections: AR overlays digital information onto the real world, providing inspectors with real-time data, defect identification assistance, and historical context directly in their field of view.
- The Rise of Human-Machine Collaboration: The integration of XR with AI and robotics is paving the way for more autonomous and efficient inspection processes, reducing human labor and subjectivity.
- A Critical Review Gap: Despite the growing interest in XR for civil engineering, there was a notable absence of comprehensive review studies specifically focusing on its application in structural condition assessment. This paper aims to fill that void.
Key Results
The review identified a significant increase in research on XR for civil structure condition assessment, particularly in the last five years.
- Study Distribution: The paper includes 43 studies, with 16 focusing on VR and 27 on AR (including MR).
- Timeline: AR applications for condition assessment appeared earlier (around 2000), while VR applications gained traction later (around 2017).
- Common Themes:
- VR: Primarily used for creating collaborative work environments and remote assessment, reducing site visits and improving communication efficiency.
- AR: Focuses on enhancing on-site inspections with digital visual aids, enabling real-time data interaction, and assisting with defect detection and documentation.
- Emerging Trends: The paper highlights trends towards reducing site visits, minimizing human labor, and integrating XR with AI and robotics for more automated and intelligent assessment.
Limitations and Future Work
- Distinguishing AR and MR: The authors acknowledge the common confusion between AR and MR in the literature, leading them to group MR studies under AR for this review.
- VR Immersion: Earlier VR studies often used digital screens rather than immersive HMDs, and these were excluded from the review to focus on truly immersive experiences.
- Comparative Analysis: The authors emphasize the need for more comparative studies that quantify the benefits of XR over conventional methods using specific indices (accuracy, time, practicality).
- Future Work:
- Conducting comparative analyses of different XR tools and HMDs for efficiency.
- Further research into the integration of AI, robots, and XR for fully autonomous assessment.
- Developing more robust methodologies for image registration in AR systems.
- Expanding the application of these technologies to a wider range of civil structures beyond bridges and tunnels.
- Investigating the practical feasibility and cost-effectiveness of XR solutions in real-world scenarios.
Summary updated