Supporting the Conservation and Restoration OpenLab of the Acropolis of Ancient Tiryns through Data Modelling and Exploitation of Digital Media

Efthymia Moraitou, Markos Konstantakis, Angeliki Chrysanthi, Yannis Christodoulou, George Pavlidis, George Alexandridis, Konstantinos I. Kotsopoulos, Nikolaos Papastamatiou, Alkistis Papadimitriou, George CaridakisComput 2023 · DOI · OpenReview

TL;DR

This paper introduces a digital approach to enhance "OpenLabs" at cultural heritage sites, specifically the Acropolis of Ancient Tiryns. By integrating semantic web technologies for data modeling and developing mixed/virtual reality applications, the project aims to make complex conservation and restoration processes more accessible and engaging for the public.

What Problem Does This Paper Address?

Cultural heritage institutions are increasingly transforming conservation and restoration (CnR) laboratories into "OpenLabs" to offer the public a behind-the-scenes look at preservation efforts. However, these labs often face challenges:

  • Limited Visitor Understanding: The complex nature of CnR processes and the inherent risks involved can make it difficult for the general public to grasp what they are seeing. OpenLabs often present simplified or pre-designed workflows, and direct communication with specialists is limited.
  • Underutilization of Documentation: The extensive documentation generated during CnR work (textual, visual, 3D) is typically inaccessible to non-expert audiences, missing an opportunity for broader dissemination and education.
  • Site-Specific Limitations: Sites like the Acropolis of Ancient Tiryns present unique challenges due to their scale, complexity, and the need to restrict public access during active conservation work.

This paper addresses these issues by proposing a digital framework to bridge the gap between specialists, documentation, and the public, thereby enriching the visitor experience and promoting a deeper understanding of cultural heritage preservation.

Methods

The CAnTi (Conservation of Ancient Tiryns) project employs a multi-faceted digital approach:

  • Semantic Web Technologies for Data Modelling:
    • An OWL ontology was developed to model CnR data from the Acropolis of Ancient Tiryns. This ontology aligns with existing standards like CIDOC CRM and CRMdig to ensure interoperability and facilitate data organization.
  • The ontology captures information about materials, damages, intervention types, and digital processes, enabling a structured representation of complex heritage data.
  • SKOS was utilized for representing specific types of concepts (e.g., materials, interventions) to enhance thesaurus-like organization.
  • 3D Digitization:
    • The site of the Acropolis of Tiryns, a large immovable monument, was digitized using a combination of ground and aerial photogrammetry.
  • This resulted in detailed 3D models, dense point clouds, and texture files, providing a comprehensive digital representation of the site and specific areas undergoing conservation.
  • Mixed Reality (MR) and Virtual Reality (VR) Applications:
    • MR Mobile App: This application allows visitors to navigate the monument, explore points of interest related to CnR interventions, and access visual and textual materials from different stages of the conservation process.
  • VR App: This application offers a virtual experience of restoration interventions, enabling users to comprehend the stages and outcomes of conservation work in a 3D virtual environment.
  • Business Process Modelling Notation (BPMN):
    • BPMN diagrams were used to model the processes and functional requirements of the MR and VR applications. This aids in understanding the flow of activities, identifying bottlenecks, and facilitating development for both content creators and software developers.
  • Four-Tier Architecture:
    • The system is built on a four-tier architecture: Presentation Layer (online portal, MR/VR apps), Service Layer (APIs), Business Logic Layer (core services), and Data Layer (digital repository). This modular design supports scalability and maintainability.
  • Digital Repository:
    • A digital repository was developed to aggregate and search CnR data, organized by Program/Intervention/Phase. It stores visual and textual records, including 3D files, with metadata for easy access and linking to specific intervention points.

Datasets

The paper discusses the use of data collected from the Acropolis of Ancient Tiryns for the project. This includes:

  • Photographic Data: Approximately 18,000 photographs (3000 aerial, 15,000 ground-based) were collected for 3D reconstruction.
  • 3D Reconstruction Data: This includes reference points, dense point clouds, and polygonal meshes derived from photogrammetry.
  • CnR Documentation: Textual records (notes, reports, presentations) and visual records (photographs, orthophotographs, designs) produced during conservation work.

The paper also mentions the reuse of existing ontologies like CIDOC CRM and CRMdig, and the SKOS model. The developed CAnTi ontology is made available via a GitHub repository.

Key Insights and Ideas

  • Bridging the Digital Divide in Heritage: The project demonstrates how digital technologies can effectively bridge the gap between complex scientific conservation work and public understanding, transforming passive observation into active engagement.
  • Semantic Modeling as a Foundation: The use of semantic web technologies and ontologies is crucial for organizing and interlinking diverse CnR data, creating a structured knowledge base that supports both internal project needs and future external integrations.
  • Immersive Experiences for Education: MR and VR applications offer powerful tools for immersive learning, allowing users to "experience" conservation processes in ways that traditional methods cannot replicate, especially for inaccessible or dangerous sites.
  • BPMN for Application Design Clarity: Utilizing BPMN for application development provides a clear, visual representation of complex user flows and functional requirements, improving communication and efficiency in the development lifecycle.
  • OpenLab Evolution: The research suggests a path forward for OpenLabs, moving beyond static displays to dynamic, digitally-enhanced experiences that are synchronous with ongoing conservation efforts.

Key Results

The paper describes the development and ongoing implementation of the CAnTi project. Key results include:

  • Development of the CAnTi Ontology: A comprehensive ontology for modeling CnR data of the Acropolis of Ancient Tiryns, comprising 140 classes, 364 object properties, 27 data properties, and 111 individuals.
  • 3D Digitization of the Site: Creation of a detailed 3D model of the entire Acropolis of Ancient Tiryns, including a dense point cloud of a region of interest undergoing extensive conservation.
  • Development of Digital Applications: The MR mobile app and VR application are under development, designed to enhance visitor experience and understanding of CnR processes.
  • Architecture Design: A four-tier architecture has been established for the system, supporting the integration of various digital components.
  • BPMN Models: Process models for the MR and VR applications have been created, detailing their functional requirements and user interactions.

Limitations and Future Work

Limitations:

  • The paper acknowledges that the OpenLab initiative faces limitations due to the nature of interventions, restricted public access, and inherent risks at the site.
  • The development of the applications is described as "in progress," indicating that the full functionality and evaluation are yet to be completed.
  • The paper mentions that some files may be too large for server upload and are stored externally, which could present challenges for direct access or management.

Future Work:

  • Completion of Application Development: The ongoing project involves completing the development of the proposed MR and VR applications.
  • Evaluation of Applications: The applications will be evaluated in four primary areas:
  • Level of public engagement with the CnR domain.
  • Visitor comprehension of the presented information.
  • User-friendliness and effectiveness of the developed applications.
  • Satisfaction of specialists regarding their communication with the public.
  • Further Ontology Refinement: While the first version of the ontology is developed, further refinement and extension are implied for comprehensive data modeling.
  • Enhancing User Experience: The research aims to provide valuable insights into the effectiveness of digital applications for cultural heritage sites and to enhance visitor engagement.

Summary updated

Abstract

Open laboratories (OpenLabs) in Cultural Heritage institutions are an effective way to provide visibility into the behind-the-scenes processes and promote documentation data collected and produced by domain specialists. However, presenting these processes without proper explanation or communication with specialists may cause issues in terms of visitors’ understanding. To support OpenLabs and disseminate information, digital media and efficient data management can be utilized. The CAnTi (Conservation of Ancient Tiryns) project seeks to design and implement virtual and mixed reality applications that visualize conservation and restoration data, supporting OpenLab operations at the Acropolis of Ancient Tiryns. Semantic Web technologies will be used to model the digital content, facilitating organization and interoperability with external sources in the future. These applications will be part of the OpenLab activities on the site, enhancing visitors’ experiences and understanding of current and past conservation and restoration practices.
BibTeX
@article{moraitou2023supporting,
  author = {Efthymia Moraitou and Markos Konstantakis and Angeliki Chrysanthi and Yannis Christodoulou and George Pavlidis and George Alexandridis and Konstantinos I. Kotsopoulos and Nikolaos Papastamatiou and Alkistis Papadimitriou and George Caridakis},
  title = {{Supporting the Conservation and Restoration OpenLab of the Acropolis of Ancient Tiryns through Data Modelling and Exploitation of Digital Media}},
  journal = {comput.},
  year = {2023},
  doi = {10.3390/computers12050096},
}
Figure