Abstract
With the coming of age of virtual/augmented reality and interactive media, numerous definitions, frameworks, and models of immersion have emerged across different fields ranging from computer graphics to literary works. Immersion is oftentimes used interchangeably with presence as both concepts are closely related. However, there are noticeable interdisciplinary differences regarding definitions, scope, and constituents that are required to be addressed so that a coherent understanding of the concepts can be achieved. Such consensus is vital for paving the directionality of the future of immersive media experiences (IMEx) and all related matters. The aim of this white paper is to provide a survey of definitions of immersion and presence which leads to a definition of immersive media experience (IMEx). The Quality of Experience (QoE) for immersive media is described by establishing a relationship between the concepts of QoE and IMEx followed by application areas of immersive media experience. Influencing factors on immersive media experience are elaborated as well as the assessment of immersive media experience. Finally, standardization activities related to IMEx are highlighted and the white paper is concluded with an outlook related to future developments.
Introduction: Addressing Terminological Drift
The field of immersive media, encompassing Virtual Reality (VR), Augmented Reality (AR), and interactive systems, has experienced rapid growth. However, this expansion has been accompanied by a lack of conceptual clarity. The QUALINET community produced this white paper to serve as a foundational "toolbox," establishing rigorous, consensus-based definitions to harmonize research and engineering efforts.
A primary hurdle in immersive media research is "terminological drift." For instance, "immersion" might be used by engineers to describe technical specifications like display resolution, while psychologists use it to refer to emotional engagement. This inconsistency hinders the creation of universal benchmarks and interoperable standards. By synthesizing perspectives from computer graphics, psychology, and communication science, this paper provides a stable conceptual platform for future development.
Methodology: Collaborative Consensus
This white paper is the result of a large-scale collaborative effort initiated at the 13th QUALINET meeting. The process involved:
- Expert Coordination: Led by 10 section leads with contributions from 44 experts across academia and industry.
- Consensus Building: A multi-stage review process including internal, community, and public consultations with organizations like ACM and IEEE.
- Taxonomy Development: Categorizing existing literature into a framework linking technical capabilities to human perception.
Conceptual Framework: Immersion vs. Presence
The paper clarifies the distinction between system properties and psychological states. Immersion is an objective system property (e.g., field of view, tracking accuracy, haptic feedback). Presence is the subjective human response—the "sense of being there." A highly immersive system may fail to induce presence if the content lacks "plausibility."
The IMEx Triad and Five Pillars
A true Immersive Media Experience (IMEx) is defined by the interplay of the IMEx Triad: immersivity (sensory cues), interactivity (user agency), and narrativity (the internal logic or story). To further characterize IMEx, the authors identify five pillars:
- Immersivity: The combination of physical and symbolic cues.
- Interactivity: The ability to manipulate virtual artifacts.
- Explorability: The freedom to move and discover within the environment.
- Believability: The sensory fidelity (e.g., photorealism).
- Plausibility: The internal consistency of the world's logic.
Defining Immersive Media Experience (IMEx)
The paper proposes a formal, standardized definition of IMEx:
"A high-fidelity simulation provided and communicated to the user through multiple sensory and semiotic modalities. Users are emplaced in a technology-driven environment with the possibility to actively partake and participate in the information and experiences dispensed by the generated world."
Influencing Factors and Quality of Experience (QoE)
In traditional media, "context" and "system" are separate. In IMEx, the system often creates the context, making Quality of Experience (QoE) assessment uniquely challenging. The paper classifies Influencing Factors (IFs) into three categories:
- Human IFs: Visual acuity, sensitivity to "cybersickness," and psychological traits.
- System IFs: Network latency, device weight, resolution, and tracking accuracy.
- Context IFs: Social setting, physical space constraints, and task requirements.
Assessment Strategies and Future Outlook
Measuring IMEx requires a multi-method approach across three essential strands:
- Subjective: Questionnaires and self-reports to capture the user's felt experience.
- Behavioral: Tracking user movements, gaze, and choices within the environment.
- Psycho-physiological: Monitoring heart rate, skin conductance, or brain activity (EEG) to provide objective correlates of presence.
Future work must address the interplay between different types of presence (physical, social, self) and continue standardization efforts for emerging technologies like the Tactile Internet and volumetric media (point clouds and light fields) to ensure reliable delivery across diverse hardware and networks.
Summary updated