Response of MSTd Neurons to Simulated 3D Orientation of Rotating Planes

Hiroki Sugihara, Ikuya Murakami, Krishna V. Shenoy, Richard A. Andersen, Hidehiko KomatsuJournal of Neurophysiology 2002 · DOI

TL;DR

This study investigates how neurons in the macaque MSTd area process 3D structure from motion. Researchers found that a significant portion of MSTd neurons are selectively tuned to the orientation (tilt and slant) of rotating planar surfaces, suggesting MSTd plays a crucial role in structure-from-motion (SFM) perception.

What Problem Does This Paper Address?

Our brains are remarkably adept at inferring the 3D structure of objects and environments from 2D retinal images, a phenomenon known as structure-from-motion (SFM). While we know that early visual areas like V1 process basic motion, the neural mechanisms underlying SFM, particularly how complex 3D information is extracted and represented, remain unclear. Previous research pointed to the middle temporal area (MT) and its dorsal projection, MSTd, as potential candidates for SFM processing due to their sensitivity to optic flow patterns. However, it was not definitively known if MSTd neurons could specifically encode the 3D orientation of surfaces based solely on motion cues. This paper aims to bridge this gap by examining MSTd neuron responses to simulated 3D rotating planes.

Methods

The researchers recorded the neural activity of 114 MSTd neurons in awake, behaving macaques performing a visual fixation task. They presented a variety of optic flow stimuli, including basic patterns like translation, expansion/contraction, and rotation. The core of the experiment involved presenting a "plane stimulus" – a random dot pattern designed to simulate a rotating planar surface with a specific 3D orientation. This orientation was defined by two parameters: "tilt" (the orientation of the surface normal on the frontoparallel plane) and "slant" (the angle between the surface normal and the line of sight).

To understand the selectivity of MSTd neurons, they systematically varied the tilt and slant of these rotating planes and measured the neuron's firing rate. They then quantified this selectivity using selectivity indices. Crucially, they conducted several control experiments to rule out alternative explanations for observed selectivity:

  • Position Invariance: Tested if selectivity was dependent on the specific location of the stimulus within the receptive field, to differentiate from local motion direction sensitivity.
  • Rotation Speed: Varied the speed of the dots to see if slant selectivity was merely a byproduct of sensitivity to local speed or speed gradients.
  • Shuffled Plane Stimuli: Presented scrambled versions of the plane stimuli where dot positions were randomized but velocities were preserved, to determine if selectivity was due to the overall motion pattern or just the distribution of velocities.

Datasets

Not discussed in the paper. The study used custom-generated visual stimuli.

Key Insights and Ideas

  • MSTd as a 3D Orientation Detector: The most significant finding is that a substantial number of MSTd neurons are not just sensitive to basic optic flow but can discriminate between different 3D orientations of a rotating plane. This suggests MSTd is actively involved in constructing a representation of surface geometry from motion.
  • Tilt and Slant Selectivity: The study identified neurons selective for "tilt," "slant," or both. This implies a distributed coding scheme where different neurons might specialize in different aspects of surface orientation.
  • Global Motion Processing: The control experiments, particularly the shuffled stimuli test, strongly indicate that MSTd neurons are responding to the global structure of the motion field, not just local motion components. This is a critical step beyond simple motion detection.
  • Cue Invariance Potential: While not directly tested, the findings open the door to the idea that MSTd might contribute to cue-invariant representations of surface orientation, meaning it could represent orientation regardless of whether it's derived from motion, disparity, or texture.

Key Results

  • Out of 114 recorded MSTd neurons, 97 responded significantly to the plane stimuli.
  • Of these 97 neurons, a majority (65/97, ~67%) showed selectivity for either tilt, slant, or both.
  • 18% (17/97) were selective only for tilt.
  • 24% (23/97) were selective only for slant.
  • 26% (25/97) were selective for both tilt and slant.
  • Control experiments ruled out explanations for selectivity based on:
  • Local translational motion direction.
  • Local speed or speed gradients.
  • Simple distributions of velocities (shuffled stimuli did not elicit the same selectivity).
  • Many neurons also showed selectivity for the direction of rotation, though some appeared to encode orientation somewhat independently of rotation direction.

Limitations and Future Work

  • Simulated Stimuli: The study used simulated 3D planes. Future work could explore responses to more complex, naturalistic 3D scenes.
  • Limited Stimulus Set: While comprehensive, the tilt and slant parameters were sampled discretely. A finer sampling might reveal more nuanced selectivity.
  • Role in Behavior: The study recorded neural activity during a fixation task. Future research could investigate how this selectivity relates to actual SFM perception and behavior.
  • Interactions with Other Cues: The paper speculates about cue invariance. Investigating how MSTd neurons integrate motion-derived orientation with information from other cues (like disparity) would be a valuable next step.
  • Connectivity: The paper notes MSTd's projection to areas like the intraparietal sulcus (CIP), which is known to process surface orientation from other cues. Understanding these downstream connections could illuminate how MSTd's motion-derived orientation information is used in a broader perceptual context.

Summary updated

Abstract

We studied whether the dorsal division of the medial superior temporal area (MSTd) in the macaque has activity related to structure-from-motion (SFM) processing. As the simplest form of three-dimensional (3D) structure, we chose a planar stimulus and examined the relation between the neural responses and the simulated 3D orientation of the plane defined by motion cues. We recorded from 114 MSTd neurons while monkeys were performing a visual fixation task. These neurons responded to a basic set of optic flow patterns such as translation, expansion/contraction, and rotation. Responses of these neurons to rotating plane stimuli were examined to see whether the MSTd neurons exhibited selectivity to the tilt and slant that characterize the 3D orientation of the plane. We found that most MSTd neurons tested (97 of 114) responded to the plane stimuli, and many neurons (65 of 97) exhibited selectivity to tilt and/or slant. Of 97 neurons, 18% (17/97) were selective only to tilt, 24% (23/97) only to slant, and 26% (25/97) to both. Control experiments rejected the possibility that the selectivity could be explained solely by the sensitivity to local stimulus components such as local translation, local speed, and local speed gradients. These results suggest that MSTd neurons are sensitive to stimulus features specific to the perceived 3D orientation of the rotating plane stimuli and suggest that area MSTd is involved in SFM processing.
BibTeX
@article{sugihara2002response,
  author = {Hiroki Sugihara and Ikuya Murakami and Krishna V. Shenoy and Richard A. Andersen and Hidehiko Komatsu},
  title = {{Response of MSTd Neurons to Simulated 3D Orientation of Rotating Planes}},
  journal = {Journal of Neurophysiology},
  year = {2002},
  doi = {10.1152/jn.00900.2000},
}
Figure