Spatial Formations and Embodiment in Collaborative Interaction

21 concepts15 papers1 proposal

When multiple people collaborate, their interaction is not merely a meeting of minds or an exchange of words; it is a dance of physical bodies. Humans naturally navigate physical space to negotiate attention, establish social hierarchies, and signal engagement. However, traditional digital interfaces are often "selfish"—designed for a single user interacting with a isolated screen. When these screen-bound tools are introduced into collaborative environments, they frequently disrupt natural human spatial dynamics, causing social fragmentation and communication breakdowns.

To fix this mismatch, a growing body of research focuses on understanding and modeling the physical geography of interaction. By treating spatial orientation, bodily movement, and tangible artifacts as core components of the user interface, researchers are designing systems that harmonize digital data with our natural, embodied ways of collaborating and learning.

The Geometry of Social Interaction

Why does physical positioning matter so much in collaboration? The answer lies in how humans naturally organize themselves to manage shared attention. Sociologists have long observed that interacting groups form distinct spatial arrangements, known as F-formations, where participants maintain a shared, exclusive space to facilitate face-to-face communication.

When digital artifacts enter this space, they reshape these formations. For instance, in a study of intensive care unit ward rounds, Cecily Morrison et al. discovered in Electronic patient record use during ward rounds: a qualitative study of interaction between medical staff that introducing fixed electronic patient record screens disrupted the natural physical formations of medical teams. Instead of maintaining a cohesive, patient-centered circle, the team's physical layout fractured as members were forced to orient themselves toward static monitors, altering communication flows and social dynamics.

To quantify and predict these disruptions, researchers use spatial interaction modeling. In Interaction Manifolds: Understanding Behaviour Around a Shareable Interface, Cecily Morrison introduced the concept of the interaction manifold—a formal analytical construct that maps how physical group formations and non-verbal behaviors evolve around different technological configurations. By evaluating these manifolds experimentally, as detailed by Cecily Morrison et al. in Interaction Manifolds: Theory from Experiments, designers can mathematically evaluate whether a technology will foster collaboration or stifle it.

[Traditional Screen]                  [Shareable Interface]
   Selfish Design                       Interaction Manifold

    User A   User B                       User A       User B
      \        /                               \       /
       v      v                                 v     v
     [ Screen ]                            [ Shared Display ]
                                                ^     ^
  (Awkward orientation,                         |     |
   broken F-formation)                       (Maintains natural 
                                              social geometry)

This spatial awareness is so fundamental to human communication that it even extends to remote and simulated environments. For example, Sai Krishna Pathi et al. demonstrated in F-Formations for Social Interaction in Simulation Using Virtual Agents and Mobile Robotic Telepresence Systems that human operators controlling mobile telepresence robots naturally attempt to adopt F-formations when interacting with virtual agents, proving that our instinct to structure physical space persists even when mediated by a robotic body.

Space as a Syntax for Collaboration

In collaborative learning environments, physical movement does not just accompany interaction—it structures it. Researchers in Computer-Supported Collaborative Learning (CSCL) increasingly view physical layout and movement patterns as a "spatial syntax" that directly dictates collaborative opportunities.

In Future direction for the CSCL field: Methodologies and eight controversies, Sten Ludvigsen et al. argue that traditional learning models fail when they ignore how spatial navigation and bodily gestures contribute to knowledge building. By adopting multimodal approaches that track physical movement alongside verbal data, researchers can uncover collaborative dynamics that remain invisible in text logs alone.

This perspective is formalized by Sanna Järvelä et al. in Experiencing CSCL: from motivation to the embodied experience and beyond through embodied activity theory. This framework prioritizes how the body's engagement with both tangible and digital artifacts facilitates the transition from individual physical experience to collective understanding.

Physical Movement  -->  Spatial Syntax  -->  Collaborative Engagement  -->  Shared Knowledge

Because spatial orientation serves as an effective proxy for engagement, tracking it allows for automated support of face-to-face collaboration. As Augusto Dias Pereira dos Santos et al. explain in How to Capitalise on Mobility, Proximity and Motion Analytics to Support Formal and Informal Education?, using computer vision and depth sensors to monitor F-formations allows systems to measure collaborative depth in real time.

Even when interaction is confined to a screen, the physical dimension remains vital. In a study of touch-screen musical performance, Charles Patrick Martin et al. showed in A Percussion-Focussed Approach to Preserving Touch-Screen Improvisation that visualizing the spatial distribution of touch events reveals that performers unconsciously mimic each other's physical movements. This physical synchrony is critical to the ensemble's cohesion, yet it is completely lost if one only analyzes the resulting audio.

Cognitive Scaffolding Through Embodiment

Why does physical embodiment improve learning and collaboration? The core mechanism is cognitive offloading: humans use physical space and bodily gestures to ground abstract concepts, reducing mental workload and creating a shared reference point for the group.

Consider how groups negotiate complex spatial concepts. The authors of “Where is the Z-Axis?”: Negotiating Understanding of Servo Rotation Through Gestures and Tools observed that when students grapple with abstract coordinate systems in robotics, they use spatial hand motions to "draw" invisible planes in the air. These physical gestures serve as a cognitive scaffold, allowing the group to synchronize their mental models and master mathematical transformations that are difficult to articulate through words alone.

When learning environments lack this physical context, engagement drops. In museum settings, Jun Chen argues in Research on Cognitively Assisted Interaction Design for Children in Museums: Taking Anhui Museum as an Example that purely screen-based interfaces create a "digital mismatch" for children. Without environmental grounding and physical context, digital displays fail to sustain deep conceptual understanding. Conversely, integrating physical movement within a space—such as the Location-Based Entertainment Virtual Reality explored by Jianhua Wei et al. in Innovative Digital Technology in Education about Paleolithic Sites: A Case Study of the Peking Man Site at Zhoukoudian—enhances a user's sense of presence, making abstract historical or scientific data feel tangible and intuitive.

Designing Beyond the Screen

Recognizing the limitations of purely virtual tools, researchers are designing physical toolkits that bring abstract digital concepts into the physical world. This is particularly crucial in fields like artificial intelligence education, which has historically relied on text and static images.

To bridge this gap, Brian Jordan et al. developed PoseBlocks: A Toolkit for Creating (and Dancing) with AI. By integrating real-time body and gesture tracking into a block-based programming environment, PoseBlocks allows students to use their own physical movements to interact with and build AI systems, aligning the educational tool with the movement-based interactions of modern consumer technology.

[Abstract AI Concept] 
         |
         v (Physical Embodiment)
[Tangible Hardware / Movement] 
         |
         v (Cognitive Offloading)
[Deep Conceptual Understanding]

Similarly, to demystify machine learning for young learners, Tanushree Burman et al. created the Smart Motor: A Low-Cost Hardware and Software Toolkit for Introducing Supervised Machine Learning to Elementary School Students. By connecting a transparent machine learning algorithm directly to a physical servo motor, the toolkit moves AI education out of the virtual "black box."

This strategy of pairing physical robotics with no-code software playgrounds, also championed by Anssi Lin et al. in A Versatile Low-Cost Kit for Teaching Novice Learners AI Using Robotics Components and a No-Code Development Playground, succeeds because it gives abstract code immediate, physical consequences. When a student can see how an algorithm alters a machine's physical behavior or changes the spatial dynamics of a room, the digital concept ceases to be an abstraction—it becomes a tangible reality.

Key Foundational Work

Interaction Manifolds: Theory from Experiments (2007) — contributed 1 concept elements to this direction.
Electronic patient record use during ward rounds: a qualitative study of interaction between medical staff (2008) — contributed 1 concept elements to this direction.
Interaction Manifolds: Understanding Behaviour Around a Shareable Interface (2007) — contributed 1 concept elements to this direction.
History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_f_formation_analysis_6a21045e,
  title = {F-formation analysis},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/f-formation-analysis/rdr_6a21045e20814dc1b77107b994580351},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_f_formation_analysis_6a21045e_v1,
  title = {F-formation analysis},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/f-formation-analysis/rdr_6a21045e20814dc1b77107b994580351/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake