Multisensory Origin of the Subjective First-Person Perspective: Visual, Tactile, and Vestibular Mechanisms

Christian Pfeiffer, Christophe Lopez, Valentin Schmutz, Julio Dueñas, Roberto Martuzzi, Olaf BlankePLoS 2013 · DOI

Abstract

This study investigates how the brain constructs the subjective first-person perspective (1PP) by integrating visual, tactile, and vestibular signals. Through three experiments involving 78 participants, researchers explored the effects of visuo-tactile and visuo-vestibular conflicts on bodily self-consciousness (BSC). The findings reveal that while self-identification (body ownership) is primarily driven by synchronous visuo-tactile stimulation, self-location and the direction of 1PP are heavily influenced by visual gravitational cues and individual differences in sensory integration strategies.

Introduction

Bodily self-consciousness (BSC) is typically characterized by three components: self-identification (the feeling that a body is "mine"), self-location (where one feels located in space), and the first-person perspective (the point from which one perceives the world). While previous research has focused on visuo-tactile integration (e.g., the Rubber Hand Illusion), the role of the vestibular system—which provides information about gravity and spatial orientation—has been less explored. This paper examines how the brain reconciles visual cues of gravity with actual vestibular signals to shape our sense of self.

Methods

Participants lay supine (face-up) while receiving robotic visuo-tactile stimulation on their backs. Using a Head-Mounted Display (HMD), they viewed a virtual body being stroked either synchronously or asynchronously.

Experimental timeline showing visuo-tactile stroking followed by mental ball dropping tasks and perspective ratings.

The experimental setup introduced a visuo-vestibular conflict: while participants were physically supine (vestibular "up"), the HMD presented a virtual body from an elevated, downward-looking perspective (visual "down").

Visual stimuli showing the virtual body with different visual gravity vectors (g*).

To measure self-location, the researchers employed a Mental Ball Dropping (MBD) task, where participants timed how long it took for an imagined ball to hit the floor. Perceived self-location was inferred from these timings. Additionally, a Rod and Frame Test (RFT) was used to categorize participants as "Field Dependent" (relying on visual cues) or "Field Independent" (relying on internal vestibular cues).

Key Results

The study yielded several critical insights into the multisensory nature of BSC:

  • Dissociation of Ownership and Perspective: Synchronous stroking increased self-identification with the virtual body regardless of the 1PP direction. However, strong visuo-vestibular conflict (180° difference between seen and felt gravity) reduced the strength of this ownership illusion.
  • Gravity as a Self-Anchor: The brain utilizes visual gravitational signals (e.g., the orientation of the virtual body and environment) to define the 1PP.
  • Up-group vs. Down-group: Participants naturally split into two groups based on how they resolved sensory conflict. The "Up-group" prioritized vestibular cues (feeling they were looking up), while the "Down-group" prioritized visual cues (feeling they were looking down).
  • Predictive Sensory Strategies: Individual differences in the Rod and Frame Test predicted 1PP direction. Field Dependent individuals were significantly more likely to adopt the visually-implied "Down" perspective.

Conclusion

The subjective first-person perspective is not a fixed construct but emerges from the integration of multiple sensory streams. This research demonstrates that the direction of 1PP depends on the weighting of visual and vestibular gravitational signals, which varies between individuals. These findings have implications for understanding clinical conditions involving body image distortions and out-of-body experiences, suggesting that idiosyncratic sensory strategies play a fundamental role in how we experience our "self" in space.

Summary updated

Abstract

In three experiments we investigated the effects of visuo-tactile and visuo-vestibular conflict about the direction of gravity on three aspects of bodily self-consciousness: self-identification, self-location, and the experienced direction of the first-person perspective. Robotic visuo-tactile stimulation was administered to 78 participants in three experiments. Additionally, we presented participants with a virtual body as seen from an elevated and downward-directed perspective while they were lying supine and were therefore receiving vestibular and postural cues about an upward-directed perspective. Under these conditions, we studied the effects of different degrees of visuo-vestibular conflict, repeated measurements during illusion induction, and the relationship to a classical measure of visuo-vestibular integration. Extending earlier findings on experimentally induced changes in bodily self-consciousness, we show that self-identification does not depend on the experienced direction of the first-person perspective, whereas self-location does. Changes in bodily self-consciousness depend on visual gravitational signals. Individual differences in the experienced direction of first-person perspective correlated with individual differences in visuo-vestibular integration. Our data reveal important contributions of visuo-vestibular gravitational cues to bodily self-consciousness. In particular we show that the experienced direction of the first-person perspective depends on the integration of visual, vestibular, and tactile signals, as well as on individual differences in idiosyncratic visuo-vestibular strategies.
BibTeX
@inproceedings{pfeiffer2013multisensory,
  author = {Christian Pfeiffer and Christophe Lopez and Valentin Schmutz and Julio Dueñas and Roberto Martuzzi and Olaf Blanke},
  title = {{Multisensory Origin of the Subjective First-Person Perspective: Visual, Tactile, and Vestibular Mechanisms}},
  booktitle = {PLoS},
  year = {2013},
  doi = {10.1371/journal.pone.0061751},
}
Figure