For decades, cultural institutions and historical archives have operated on a unidirectional broadcasting model. Artifacts sit behind glass panes, historical testimonies are confined to flat 2D screens, and expert interpretations are delivered via top-down text placards or linear audio monologues. While this approach excels at physical preservation, it creates a profound passive engagement gap.
Modern, digitally native audiences are accustomed to participatory, responsive media. When confronted with static exhibitions, they frequently experience cognitive fatigue, surface-level aesthetic appreciation, and a sense of historical detachment. To bridge this gap, researchers are shifting from a paradigm of watching to one of using and participating. By deploying conversational AI, spatial computing, and gamified interaction, this research direction aims to transform passive observers into active co-creators of historical meaning.
From Monologue to Dialogue: Conversational and Reflective Agents
Traditional information delivery in museums relies on a one-way flow of data. Linear audio guides, for example, often induce "monologue fatigue" because they treat the listener as an empty vessel to be filled with facts, rather than an active participant in an educational journey (LI Zheng-yan et al.).
To break this passivity, researchers are replacing static text and audio with personified, dialogue-based interfaces. Wei Wang proposes a framework for digital tour guides that utilizes interactive virtual characters to convert static historical data into dynamic, conversational narratives. This shift works because dialogue forces an exploratory form of learning; instead of passively absorbing a pre-recorded script, the user actively directs the narrative flow through inquiry. To make these interactions seamless and contextually accurate, Haofeng Wang et al. developed RiverEcho, a system combining streaming Retrieval-Augmented Generation (RAG) pipelines with talking-head digital humans to provide real-time, low-latency responses to complex historical queries.
[Static Archive] --------(Unidirectional Broadcast)-------> [Passive Recipient]
| (Fatigue)
v
[AI Chatbot / RAG] <======(Bidirectional Dialogue)========> [Active Thinker]
However, simply answering user questions is not enough to foster deep historical empathy. True engagement requires cognitive friction. To achieve this, Gollapalli et al. introduced ArtMuse, an AI-powered chatbot designed to proactively ask visitors "reflective questions." By prompting users with open-ended questions that connect an artwork's visual elements to their personal lived experiences, the system triggers active cognitive processing. The visitor can no longer just glance and walk away; they must look closer, analyze, and articulate an opinion.
From Observation to Embodiment: Spatial and Multi-Sensory Immersion
A major psychological barrier in traditional exhibitions is the physical separation between the visitor and the artifact. The "hands-off" rule enforced by glass displays restricts interaction to visual observation alone, which limits emotional impact and spatial understanding (Yuwei Meng).
To bypass this restriction, researchers are leveraging spatial computing to create embodied interactions. Instead of viewing historical testimonies on a flat screen, Worchel et al. utilize volumetric video—dynamic 3D reconstructions of real people—to preserve the accounts of Holocaust survivors. This works because volumetric video introduces spatial presence; future generations can physically "sit with" a witness in a virtual space, capturing the subtle nuances of body language and depth that 2D video archives lose. As reviewed by Xinda Liu et al., this multi-modal feedback simulates the tactile and spatial reality of an environment, which is essential for fostering deep historical empathy.
Furthermore, this embodiment transforms how abstract concepts are learned. Jianhua Wei et al. demonstrated that Location-Based Entertainment Virtual Reality (LBE VR) significantly boosts engagement among adolescents studying Paleolithic sites. By allowing users to physically walk through a reconstructed prehistoric environment, the technology shifts history from an abstract academic subject into a lived reality. When the body moves through a space, the brain processes the information as an experiential memory rather than a memorized fact. This digital immersion can be further anchored by pairing it with tactile 3D-printed replicas, allowing visitors to physically handle artifacts without risking damage to the originals (Yuwei Meng).
From Recipient to Participant: Gamification and Crowdsourcing
Traditional heritage communication often relies on an expert-led, top-down model that broadcasts jargon-heavy narratives to a silent public (Marcelo D. T. Torres). Bridging the engagement gap requires shifting agency back to the audience, transforming them from passive recipients into active participants.
One method is the gamification of physical behavior. Donadio et al. designed interactive museum applications like "Strike a Pose" and "Face-Fit," which challenge visitors to physically replicate the body postures and facial expressions of figures in historical artworks. This mechanism leverages kinetic empathy; by physically embodying the art, visitors break through the traditional disconnect and form a playful, memorable bond with the piece.
| Engagement Model | Directionality | User Role | Primary Outcome |
|---|---|---|---|
| Traditional Exhibition | Top-Down / Unidirectional | Passive Observer | Surface-level awareness, monologue fatigue |
| Participatory Exhibition | Bottom-Up / Bidirectional | Active Co-Creator | Deep cognitive reflection, shared institutional meaning |
On a structural level, this participatory shift allows the public to shape institutional knowledge itself. Zeng et al. developed a framework for a "Participatory Art Museum" that uses Natural Language Processing (NLP) to collect and model non-expert public opinions into a shared semantic space. By mapping how everyday visitors interpret art—rather than relying solely on scholarly curation—the system integrates diverse public perspectives into the institutional discourse. This democratizes the cultural space, making visitors feel that their interpretations are valued components of the exhibition.
The Paradox of Modern Dissemination: Depth vs. Novelty
As cultural heritage transitions to modern digital channels, researchers face a critical paradox: modern media formats excel at maximizing reach, but often struggle to sustain depth.
For instance, short-video platforms like TikTok and algorithmic curation are highly effective at distributing intangible cultural heritage (ICH) to younger, digital-first demographics (Yang Li et al.). However, an empirical study by Latiff et al. reveals that while audiences express highly positive emotions toward these short videos, their engagement remains superficial. User comments focus overwhelmingly on visual appeal and novelty rather than the historical context or intricate craftsmanship of the heritage.
The consensus across recent literature is that modern digital media should not be used merely as a tool for passive broadcasting. Instead, visual novelty must serve as an initial "hook" to pull users into deeper, structured, and life-integrated experiences. Whether through cross-industry collaborations that turn ancient symbols into modern cultural intellectual property (Ruizhen Hu), or by embedding traditional crafts into functional consumer goods and interactive tourism routes (Dan Xu; Hang Wang), the goal remains the same: closing the interactive engagement gap by transforming historical observation into a participatory, lived reality.
Key Foundational Work
Audio indexing for an interactive Italian literature management system (2008) — contributed 1 concept elements to this direction.
Engaging Users: The Future of Academic Library Web Sites (2008) — contributed 1 concept elements to this direction.
Design and implementation of an affect-responsive interactive photo frame (2011) — contributed 1 concept elements to this direction.