Augmenting reality to diminish distractions for cognitive enhancement

JangHyeon Lee, Lawrence H. Kim

TL;DR

This paper introduces "DiminishAR," a novel approach using holographic Augmented Reality (AR) to visually "cancel out" distracting objects, like smartphones, from a user's field of view. Their study shows that these AR interventions significantly improve cognitive performance, matching the benefits of physically removing the distracting object, offering a practical solution for managing everyday distractions.

What Problem Does This Paper Address?

In our hyper-connected world, smartphones are ubiquitous. While essential for communication and information access, their mere presence has been shown to negatively impact cognitive functions like attention and memory – a phenomenon dubbed the "brain drain effect." Physically removing smartphones can mitigate this, but it's often inconvenient and can induce anxiety. This paper tackles the challenge of reducing these cognitive impairments caused by smartphone distractions without the drawbacks of complete removal. They aim to find a way to make distracting objects less perceptually salient, thereby freeing up cognitive resources.

Methods

The core of DiminishAR lies in two AR interventions implemented using a Microsoft HoloLens 2:

  • Visual Camouflage: This technique projects a customized holographic cuboid over the smartphone. The hologram's dimensions match the phone, and its color and texture are designed to blend seamlessly with the background, effectively disguising the phone.
  • Visual Substitution: Instead of blending, this method occludes the smartphone with a contextually relevant hologram. For instance, on a desk, it might project a hologram of books, repurposing the distracting space to appear more conducive to focus.

The researchers conducted a study with 60 participants, comparing cognitive performance across four conditions: smartphone physically nearby, physically removed, visually camouflaged via AR, and visually substituted via AR. They used standardized cognitive tasks (OSPAN, RSPM for cognitive capacity, and GNG for sustained attention) to measure performance.

Datasets

Not discussed in the paper. The study relies on participant interaction and cognitive task performance rather than training or evaluating on specific datasets.

Key Insights and Ideas

  • AR as "Visual Noise-Canceling": The paper frames AR not just as an augmentation tool but as a "visual noise-canceling" technology, drawing a parallel to how headphones reduce auditory distractions. This reframes AR's potential for cognitive enhancement.
  • Habituation to Holograms: Participants reported that while the holograms were initially noticeable, they became less distracting over time, suggesting a habituation effect that allows users to maintain focus on their primary tasks.
  • Beyond Smartphones: While the study focuses on smartphones, the underlying principle of visually diminishing distractions is generalizable to any object that might impede concentration.
  • Dual Mechanisms for Cognitive Benefit: The authors propose that DiminishAR works through two complementary mechanisms: salience reduction (making distracting objects less noticeable) and attentional guidance (using visual substitution to direct focus towards task-relevant elements).

Key Results

  • Cognitive Performance Improvement: Both Visual Camouflage and Visual Substitution significantly improved cognitive performance (measured by OSPAN and RSPM scores) compared to having the smartphone physically nearby.
  • Comparable to Physical Removal: The cognitive benefits of the AR interventions were comparable to those achieved when the smartphone was physically removed from the room.
  • Sustained Attention Unaffected: The study found no significant difference in sustained attention (measured by the GNG task) across the conditions, suggesting that while cognitive capacity is impacted by smartphone presence, sustained attention might be more resilient or less affected by visual salience alone.
  • High Likelihood of Future Adoption: Participants expressed a favorable likelihood of using these holographic features in the future, particularly for studying and working, citing their ability to reduce distractions.

Limitations and Future Work

  • Limited Field of View (FOV): The Microsoft HoloLens 2 has a limited FOV, which constrained participant positioning during the experiment. Future work should explore AR devices with wider FOVs.
  • Hologram Translucency: AR's additive display can make holograms translucent, which can be a limitation in varying lighting conditions. Future research could explore advancements in occlusion capabilities.
  • Ecological Validity of "Phone Off": Participants were asked to turn off their phones to control for notifications. While this aligns with prior research showing power condition doesn't affect performance, it limits ecological validity. Future studies could investigate active phones with notifications silenced.
  • Ethical Considerations: The paper touches upon ethical concerns regarding selective manipulation of reality, potential for misuse, and the need for context-aware adaptations to ensure safety-relevant cues are not obscured.
  • Personalization: The authors suggest future work should focus on user-customizable holographic experiences, potentially using machine learning to predict and suggest overlays that enhance well-being and focus.

Summary updated

Abstract

Smartphones are integral to modern life, yet research highlights the cognitive drawbacks associated with their mere presence. While physically removing them can mitigate these effects, it is often inconvenient and may heighten anxiety due to prolonged separation. To address this, we use holographic augmented reality (AR) displays to visually diminish distractions with two interventions: 1) Visual Camouflage, which disguises the smartphone with a hologram that matches its size and blends with the background, making it less noticeable, and 2) Visual Substitution, which occludes the smartphone with a contextually relevant hologram, like books on a desk. In a study with 60 participants, we compared cognitive performance with the smartphone nearby, remote, and visually diminished by our AR interventions. Our findings show that the interventions significantly reduce cognitive impairment, with effects comparable to physically removing the smartphone. The adaptability of our approach opens new avenues to manage visual distractions in daily life.
BibTeX
@misc{lee2024augmenting,
  author = {JangHyeon Lee and Lawrence H. Kim},
  title = {{Augmenting reality to diminish distractions for cognitive enhancement}},
  year = {2024},
  eprint = {2403.03875},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2403.03875},
}
Figure