Dynamic Neural Remapping for Trans-Saccadic Visual Stability

72 concepts45 papers

The Retinotopic Paradox

Our eyes are in constant motion. Even when we attempt to stare steadily at a single point, microscopic drifts and microsaccades continuously shift visual stimuli across the retina, as detailed by James M. McFarland et al. in High-resolution eye tracking using V1 neuron activity. When we actively explore our environment, rapid eye movements—saccades—cause violent retinal image shifts and blurring (Xiao Wang et al. in Learning Peri-saccadic Remapping of Receptive Field from Experience in Lateral Intraparietal Area).

One might assume the brain resolves this instability by transforming sensory inputs into a static, world-centered (spatiotopic) map early in the visual pipeline. However, in Maps of Visual Space in Human Occipital Cortex Are Retinotopic, Not Spatiotopic, Justin L. Gardner et al. demonstrated that early visual maps remain strictly eye-centered (retinotopic). Every eye movement fundamentally alters the spatial coordinates of the incoming sensory data.

This creates a profound paradox: our early visual system operates like a shaky handheld camera, yet our conscious experience is entirely seamless. As argued by Saloni Sharma et al. in Feature-selective responses in macaque visual cortex follow eye movements during natural vision, environmental continuity does not stem from low-level neural stabilization in the primary visual cortex. Instead, visual stability is a dynamic computational construct managed by real-time neural updates across the visual hierarchy.

Transforming Space via Spatial Gain Fields

To construct a stable perception from a shifting retinotopic input, the brain must continuously integrate the eye's physical position with incoming visual signals. It begins this process early in the visual hierarchy using a mechanism called spatial gain fields.

In Hierarchical Transformation of Space in the Visual System, Alexandre Pouget et al. demonstrated via neural network modeling that when retinal inputs are combined with eye-position signals, spatial gain fields naturally emerge. Rather than completely re-routing connections to a new coordinate map, the eye's position acts as a modulator, adjusting the amplification (gain) of visual responses.

This architecture was confirmed in humans by Elisha P. Merriam in Modulation of Visual Responses by Gaze Direction in Human Visual Cortex, showing that gaze direction systematically modulates signal strength in the early visual cortex. By labeling eye-centered visual data with gaze-position metrics, the brain establishes the mathematical foundation required to compute a stable representation of space.

Predictive Remapping and Split Sensitivity

The visual system does not merely react to eye movements after they occur; it predictively updates its internal maps in advance of the movement. This proactive adjustment is known as predictive remapping.

During a gaze shift, certain visual neurons exhibit what is known as "split sensitivity." As shown by Robert M. Morrison in A Probabilistic Approach to Receptive Field Mapping in the Frontal Eye Fields, neurons in the frontal eye fields can simultaneously respond to both their current retinal location and their future, post-saccadic spatial target before the eye movement is even completed.

By predicting visual changes before the eyes land, the brain prevents the perception of motion blur and maintains continuous spatial awareness (Mécanisme connexionniste pour l'anticipation visuelle by Jérémy Fix et al.). Furthermore, this predictive capability is highly adaptable; Xiao Wang et al. demonstrated that these predictive "cortical waves" can be learned directly from visual experience via spike-timing-dependent plasticity (STDP).

Sensory Buffering and Trans-Saccadic Memory

During the actual execution of a rapid eye movement, the brain temporarily downregulates its sensitivity to prevent the perception of motion smear—a phenomenon called saccadic suppression (Saccadic modulation of stimulus processing in primary visual cortex by Adrian Bondy). To bridge these brief sensory gaps, the brain relies on a trans-saccadic sensory buffer.

In Decoding Trans-Saccadic Memory, Grace Edwards et al. showed that the brain "pre-loads" information about a visual target before the eyes even land on it. A neural memory trace persists within a sensory buffer, maintaining the last known state of the environment in the absence of immediate retinal input.

This buffering process is so critical to maintaining continuity that it is triggered automatically. Na Shao et al. found in Saccades elicit obligatory allocation of visual working memory that the act of making a saccade forces an obligatory upload of the target's visual properties into working memory, ensuring that the object's representation survives the transition.

To minimize these disruptive transitions altogether, the visual system can also dynamically shift its behavioral strategy. As shown by Christian Vater et al. in Examining the functionality of peripheral vision, observers in high-speed environments often prioritize peripheral monitoring over foveal tracking, anchoring their gaze to bypass the temporal processing costs imposed by saccadic suppression.

This strategy of active buffering and concealment is a fundamental design principle used to handle other self-generated visual disruptions, such as eye blinks. Blinking blacks out our vision for up to 10% of our waking hours, yet we rarely perceive the world darkening.

As reviewed by Shawn M. Willett et al. in The perceptual consequences and neurophysiology of eye blinks, the brain maintains a continuous visual stream during blinks by recycling recent visual information within a reverberating corticothalamic loop. This loop acts as a short-term frame buffer, filling in the sensory gap until the eyelids reopen.

This mechanism mirrors how other sensory modalities maintain continuity. In the auditory system, when an external noise interrupts a continuous sound, the brain actively suppresses neural "off-responses" to hide the evidence of the gap, maintaining a stable auditory stream (Hearing an Illusory Vowel in Noise: Suppression of Auditory Cortical Activity by Lars Riecke et al.). Whether dealing with an eye blink or an external occlusion event, the brain relies on a persistent internal state to bridge the interruption, ensuring that a reappearing stimulus is seamlessly integrated rather than treated as a completely novel object (Learning to Predict Visibility and Invisibility from Occlusion Events).

The Fragility and Constraints of the Stable Construct

While this dynamic remapping and buffering system provides a remarkably stable conscious experience, it operates under strict temporal and structural limitations.

Because the system relies on precise temporal coordination, it can be vulnerable to internal neural rhythms. For example, Rodika Sokoliuk demonstrated in The Flickering Wheel Illusion: When α Rhythms Make a Static Wheel Flicker that the brain's internal alpha rhythm can occasionally become visible when viewing specific geometric patterns, exposing the periodic inhibition underlying visual processing. Similarly, the phase of these prestimulus alpha oscillations acts as a gatekeeper for the recurrent processing required to stabilize fleeting visual perceptions (Kristina Krasich et al. in Prestimulus oscillatory brain activity interacts with evoked recurrent processing to facilitate conscious visual perception).

When these continuous streams are artificially broken, the fragility of the system becomes apparent. Rüdiger Ilg et al. demonstrated in Stimulus frequency influences spontaneous perceptual reversals in ambiguous apparent motion that a minor temporal glitch in a moving stimulus forces the brain to completely recalculate its motion vectors, often triggering sudden perceptual reversals.

Furthermore, the brain's remapping capacity is highly selective. In No Evidence for Automatic Remapping of Stimulus Features or Location Found with fMRI, Mark D. Lescroart et al. discovered that while the visual system tracks object locations across eye movements, it does not automatically remap detailed object features like identity or fine texture. The brain prioritizes spatial continuity over exhaustive feature preservation, demonstrating that our stable visual world is not a perfect, continuous recording, but a highly optimized, dynamically updated sketch.

Key Foundational Work

Cortical dynamics of feature binding and reset: Control of visual persistence (1994) — contributed 2 concept elements to this direction.
Hierarchical Transformation of Space in the Visual System (1991) — contributed 1 concept elements to this direction.
History & citationVersion 2 · 2026-10-04

Current · Permanent link

  1. Version 2 (latest) · 2026-10-04 · 46 papers
  2. Version 1 · 2026-10-04 · 24 papers
Cite this direction

Latest version (a living page):

@misc{lacuna_perceptual_visual_stability_2e24c494,
  title = {perceptual visual stability},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/perceptual-visual-stability/rdr_2e24c4942386442a90b0aae0f6e2e359},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-22},
}

This exact version (version 2, frozen text):

@misc{lacuna_perceptual_visual_stability_2e24c494_v2,
  title = {perceptual visual stability},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/perceptual-visual-stability/rdr_2e24c4942386442a90b0aae0f6e2e359/v/2},
  note = {Version 2, frozen 2026-10-04. Accessed 2026-11-22},
}

See something wrong? Report a mistake