QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)

Andrew Perkis, Christian Timmerer, Sabina Baraković, Jasmina Baraković Husić, Søren Bech, Sebastian Bosse, Jean Botev, Kjell Brunnström, Luís A. da Silva Cruz, Katrien De Moor, Andrea de Polo Saibanti, Wouter Durnez, Sebastian Egger-Lampl, Ulrich Engelke, Tiago H. Falk, Asim Hameed, Andrew Hines, Tanja Kojić, Dragan Kukolj, Eirini Liotou, Dragorad A. Milovanovic, Sebastian Möller, Niall Murray, Babak Naderi, Manuela Pereira, Stuart Perry, António Pinheiro, Andrés Pinilla, Alexander Raake, Sarvesh Rajesh Agrawal, Ulrich Reiter, Rafael Rodrigues, Raimund Schatz, Peter Schelkens, Steven Schmidt, Saeed Shafiee Sabet, Ashutosh Singla, Lea Skorin‐Kapov, Mirko Sužnjević, Stefan Uhrig, Sara Vlahović, Jan‐Niklas Voigt-Antons, Saman Zadtootaghaj, Zadtootaghaj, Saman

Abstract

With the coming of age of virtual/augmented reality and interactive media, numerous definitions, frameworks, and models of immersion have emerged across different fields ranging from computer graphics to literary works. Immersion is oftentimes used interchangeably with presence as both concepts are closely related. However, there are noticeable interdisciplinary differences regarding definitions, scope, and constituents that are required to be addressed so that a coherent understanding of the concepts can be achieved. Such consensus is vital for paving the directionality of the future of immersive media experiences (IMEx) and all related matters. The aim of this white paper is to provide a survey of definitions of immersion and presence which leads to a definition of immersive media experience (IMEx). The Quality of Experience (QoE) for immersive media is described by establishing a relationship between the concepts of QoE and IMEx followed by application areas of immersive media experience. Influencing factors on immersive media experience are elaborated as well as the assessment of immersive media experience. Finally, standardization activities related to IMEx are highlighted and the white paper is concluded with an outlook related to future developments.

Introduction: Addressing Terminological Drift

The field of immersive media, encompassing Virtual Reality (VR), Augmented Reality (AR), and interactive systems, has experienced rapid growth. However, this expansion has been accompanied by a lack of conceptual clarity. The QUALINET community produced this white paper to serve as a foundational "toolbox," establishing rigorous, consensus-based definitions to harmonize research and engineering efforts.

A primary hurdle in immersive media research is "terminological drift." For instance, "immersion" might be used by engineers to describe technical specifications like display resolution, while psychologists use it to refer to emotional engagement. This inconsistency hinders the creation of universal benchmarks and interoperable standards. By synthesizing perspectives from computer graphics, psychology, and communication science, this paper provides a stable conceptual platform for future development.

Methodology: Collaborative Consensus

This white paper is the result of a large-scale collaborative effort initiated at the 13th QUALINET meeting. The process involved:

  • Expert Coordination: Led by 10 section leads with contributions from 44 experts across academia and industry.
  • Consensus Building: A multi-stage review process including internal, community, and public consultations with organizations like ACM and IEEE.
  • Taxonomy Development: Categorizing existing literature into a framework linking technical capabilities to human perception.

Conceptual Framework: Immersion vs. Presence

The paper clarifies the distinction between system properties and psychological states. Immersion is an objective system property (e.g., field of view, tracking accuracy, haptic feedback). Presence is the subjective human response—the "sense of being there." A highly immersive system may fail to induce presence if the content lacks "plausibility."

The IMEx Triad and Five Pillars

A true Immersive Media Experience (IMEx) is defined by the interplay of the IMEx Triad: immersivity (sensory cues), interactivity (user agency), and narrativity (the internal logic or story). To further characterize IMEx, the authors identify five pillars:

  1. Immersivity: The combination of physical and symbolic cues.
  2. Interactivity: The ability to manipulate virtual artifacts.
  3. Explorability: The freedom to move and discover within the environment.
  4. Believability: The sensory fidelity (e.g., photorealism).
  5. Plausibility: The internal consistency of the world's logic.

Defining Immersive Media Experience (IMEx)

The paper proposes a formal, standardized definition of IMEx:

"A high-fidelity simulation provided and communicated to the user through multiple sensory and semiotic modalities. Users are emplaced in a technology-driven environment with the possibility to actively partake and participate in the information and experiences dispensed by the generated world."

Influencing Factors and Quality of Experience (QoE)

In traditional media, "context" and "system" are separate. In IMEx, the system often creates the context, making Quality of Experience (QoE) assessment uniquely challenging. The paper classifies Influencing Factors (IFs) into three categories:

  • Human IFs: Visual acuity, sensitivity to "cybersickness," and psychological traits.
  • System IFs: Network latency, device weight, resolution, and tracking accuracy.
  • Context IFs: Social setting, physical space constraints, and task requirements.

Assessment Strategies and Future Outlook

Measuring IMEx requires a multi-method approach across three essential strands:

  • Subjective: Questionnaires and self-reports to capture the user's felt experience.
  • Behavioral: Tracking user movements, gaze, and choices within the environment.
  • Psycho-physiological: Monitoring heart rate, skin conductance, or brain activity (EEG) to provide objective correlates of presence.

Future work must address the interplay between different types of presence (physical, social, self) and continue standardization efforts for emerging technologies like the Tactile Internet and volumetric media (point clouds and light fields) to ensure reliable delivery across diverse hardware and networks.

Summary updated

Abstract

With the coming of age of virtual/augmented reality and interactive media, numerous definitions, frameworks, and models of immersion have emerged across different fields ranging from computer graphics to literary works. Immersion is oftentimes used interchangeably with presence as both concepts are closely related. However, there are noticeable interdisciplinary differences regarding definitions, scope, and constituents that are required to be addressed so that a coherent understanding of the concepts can be achieved. Such consensus is vital for paving the directionality of the future of immersive media experiences (IMEx) and all related matters. The aim of this white paper is to provide a survey of definitions of immersion and presence which leads to a definition of immersive media experience (IMEx). The Quality of Experience (QoE) for immersive media is described by establishing a relationship between the concepts of QoE and IMEx followed by application areas of immersive media experience. Influencing factors on immersive media experience are elaborated as well as the assessment of immersive media experience. Finally, standardization activities related to IMEx are highlighted and the white paper is concluded with an outlook related to future developments.
BibTeX
@misc{perkis2020qualinet,
  author = {Andrew Perkis and Christian Timmerer and Sabina Baraković and Jasmina Baraković Husić and Søren Bech and Sebastian Bosse and Jean Botev and Kjell Brunnström and Luís A. da Silva Cruz and Katrien De Moor and Andrea de Polo Saibanti and Wouter Durnez and Sebastian Egger-Lampl and Ulrich Engelke and Tiago H. Falk and Asim Hameed and Andrew Hines and Tanja Kojić and Dragan Kukolj and Eirini Liotou and Dragorad A. Milovanovic and Sebastian Möller and Niall Murray and Babak Naderi and Manuela Pereira and Stuart Perry and António Pinheiro and Andrés Pinilla and Alexander Raake and Sarvesh Rajesh Agrawal and Ulrich Reiter and Rafael Rodrigues and Raimund Schatz and Peter Schelkens and Steven Schmidt and Saeed Shafiee Sabet and Ashutosh Singla and Lea Skorin‐Kapov and Mirko Sužnjević and Stefan Uhrig and Sara Vlahović and Jan‐Niklas Voigt-Antons and Saman Zadtootaghaj and Zadtootaghaj, Saman},
  title = {{QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)}},
  year = {2020},
  eprint = {2007.07032},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2007.07032},
}
Figure