Abstract
Starting from the concept and development of AR interactive books, this paper conducts theoretical analysis to summarize how AR interactive books break the traditional reading mode and provide users with a new reading experience combining the virtual and the real. Taking the analysis of multisensory experience design in AR interactive books as a starting point, it concludes the different experiences that users gain from this new reading mode through five senses. It is proposed that in the process of innovating AR interactive books, each stage from topic selection to graphic design, AR content design, and production should be combined with its content, and design methods should be considered from the perspective of users’ usage to promote the continuous development of AR interactive books among young audiences. This paper also provides a reference for interactive book creators to consider routes and methods.
Introduction
Traditional reading has long been a static, visual-centric activity. While the advent of Augmented Reality (AR) technology promised to revolutionize this medium, early implementations—particularly in the children’s educational sector—have often treated AR as a digital overlay or a gimmick rather than a fundamental shift in narrative design. This research addresses the current lack of a cohesive design philosophy for AR books, arguing that many existing works fail to leverage the full spectrum of human perception. By failing to align digital content with sensory expectations, creators create a "barrier to acceptance." This paper explores a transition toward a holistic "multi-sensory" design framework that transforms passive readers into active, immersed participants.
Methodology
The study employs a theoretical analysis and qualitative review of the current AR and interactive book landscape. Rather than focusing on hardware specifications or algorithmic improvements, the authors synthesize principles from psychology, material science, and digital media arts. The methodology is structured around three pillars:
- Sensory Deconstruction: Analyzing the reading experience through five distinct sensory channels (visual, tactile, auditory, olfactory, and gustatory).
- Case Study Analysis: Examining successful integrations, such as the material innovations in Journey to the West and the structural/auditory design of David Carter’s White Noise.
- Design Workflow Proposal: Outlining a user-centric production pipeline that integrates topic selection, graphic design, and AR content creation.
The Multi-Sensory Framework
Visual and Material Hybridity
Visual experience in AR is not limited to the digital 3D model. The authors emphasize that the physical materiality of the book acts as a foundation for the "hybrid reality." For instance, using non-traditional materials like transparent PVC to simulate water ripples in a physical book can enhance the immersion of the digital overlay, creating a seamless blend between the physical and virtual worlds.
Bidirectional Tactile Interaction
Tactile experience in AR books evolves from simple page-turning to "bidirectional content creation." When a user’s physical interaction—such as moving a jointed part or choosing a physical path—triggers a specific AR response, the reader ceases to be a spectator and becomes a co-author of the narrative experience.
Auditory Authenticity
The paper identifies a unique "natural" auditory appeal: the friction of paper. Designers can exploit this by creating paper structures specifically engineered to produce sound, which then complements AR-triggered narration or ambient background music. This combination of physical and digital soundscapes reinforces the authenticity of the experience.
Psychological Olfactory and Gustatory Triggers
While books cannot be safely consumed, the authors propose the use of "gustatory associations." By utilizing plant-fiber papers infused with scents like vanilla or tea, creators can trigger psychological taste responses. These olfactory cues deepen immersion in scenes involving nature or food, though the authors note that current scented inks only maintain their efficacy for 1-2 years.
Key Results and Discussion
The research concludes that the "perfect form" of a modern book is one that induces a comprehensive, correlated sensory response. Key findings include:
- Information Density: AR books provide significantly higher information intake than traditional media. By engaging the ~80% of human perception that is visual while simultaneously utilizing auditory and tactile channels, comprehension and retention are reinforced.
- Design Framework: The study provides a checklist for creators to ensure sensory elements are not just present, but are contextually correlated to the narrative.
- Market Evolution: To move beyond a niche children's product, AR books must adopt these multisensory innovations to meet the rising expectations of tech-savvy young audiences.
Limitations and Future Work
The analysis of olfactory and gustatory experiences remains introductory, requiring further research into the safety and longevity of chemical scents. Additionally, the current focus is heavily weighted toward children's education. Future research should explore how these multisensory principles apply to technical documentation, medical training, or adult fiction, where the threshold for "gimmickry" is higher. Finally, quantitative user testing is needed to measure the exact impact of these sensory additions on emotional resonance and long-term memory retention.
Summary updated