Situated Visualization in Physical Contexts

This direction is split into other directions: in situ spatial authoring. Its last version stays readable and citable here.

Version 1 of 169 papers87 conceptsfrozen 2026-10-04

Traditional data interfaces suffer from a "2D bottleneck." As Chen Chen argues in From 2D Document Interactions into Immersive Information Experience, flat screens force users to perform a constant "mental translation" between abstract data on a display and the physical objects they are actually working with. This disconnection creates a high cognitive load, known as the split-attention effect, where the brain must repeatedly switch focus and re-orient itself.

Situated visualization solves this by embedding digital information directly into the physical environment where it is most relevant. By leveraging Augmented Reality (AR) and Mixed Reality (MR), researchers like Pan Hui 0001 and Christoph Peylo suggest that AR acts as the ultimate intuitive interface for Big Data, grounding abstract measurements in real-world context (When Augmented Reality Meets Big Data).

Spatial Anchoring as Cognitive Scaffolding

The core mechanism of situated visualization is spatial anchoring. Instead of floating in a user's field of view, digital data is "world-locked" to specific physical coordinates or objects. Anna Yu and colleagues demonstrate in XAIR: A Framework of Explainable AI in Augmented Reality that anchoring AI explanations directly to the objects they reference is significantly less intrusive than traditional 2D pop-ups.

These anchors serve as "cognitive scaffolding." In AR-TMT: Investigating the Impact of Distraction Types on Attention and Behavior in AR-based Trail Making Test, Sihun Baek and Zhehan Qu found that when virtual objects lose their spatial anchors, users exhibit disorganized scanning patterns and higher mental fatigue. Anchoring provides a stable structure that allows the human visual system to process digital and physical information as a single, unified scene.

Eliminating the Split-Attention Effect

The primary reason situated visualization works is the reduction of cognitive overhead. In sports analytics, Chunggi Lee and Hanspeter Pfister developed Sportify, which embeds player-tracking data and text bubbles directly onto the video frame (Sportify: Question Answering with Embedded Visualizations and Personified Narratives for Sports Video). This ensures fans don't miss critical on-court action while looking at a side-bar dashboard.

This principle extends to education and training. Wei Chen applies this to online learning in HyperMOOC: Augmenting MOOC Videos with Concept-based Embedded Visualizations, while Ken Holstein uses MR glasses to give teachers "superpowers" by projecting real-time student performance data directly over each student in the classroom (Designing for human-AI complementarity in K-12 education). In both cases, the information is placed at the "site of action," removing the need for the user to look away from their primary task.

Visualizing the Invisible

Situated visualization is particularly powerful for making intangible phenomena perceptible. By overlaying complex data onto physical models, practitioners can gain immediate spatial intuition that spreadsheets cannot provide:

Intuition and Performance

The effectiveness of this approach is backed by comparative studies. Elena Sibirtseva and her team found that projecting a robot's "thoughts" directly onto a shared workspace was more accurate and less disruptive than using a standard monitor (A Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interaction). Similarly, Tica Lin and Yalong Yang demonstrated that situated 3D trajectories help athletes focus on their holistic "feel" and body form rather than just numerical targets (Towards an Understanding of Situated AR Visualization for Basketball Free-Throw Training).

By merging the analytical power of digital data with the intuitive spatial reasoning of the human brain, situated visualization transforms abstract information into a tangible part of our physical reality.

Papers in this version

Showing 60 of 69 papers.

History & citationVersion 1 · 2026-10-04

Split into other directions · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_situated_visualization_in_physical_conte_5fc575ca,
  title = {Situated Visualization in Physical Contexts},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/situated-visualization-in-physical-contexts/rdr_5fc575ca07844c428a2b757a0f76e224},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_situated_visualization_in_physical_conte_5fc575ca_v1,
  title = {Situated Visualization in Physical Contexts},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/situated-visualization-in-physical-contexts/rdr_5fc575ca07844c428a2b757a0f76e224/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}