Multivariate Patterns in Object-Selective Cortex Dissociate Perceptual and Physical Shape Similarity

Johannes Haushofer, Margaret S. Livingstone, Nancy KanwisherPLoS 2008 · DOI

Abstract

Prior research has identified the lateral occipital complex (LOC) as a critical cortical region for the representation of object shape in humans. However, little is known about the nature of the representations contained in the LOC and their relationship to the perceptual experience of shape. We used human functional MRI to measure the physical, behavioral, and neural similarity between pairs of novel shapes to ask whether the representations of shape contained in subregions of the LOC more closely reflect the physical stimuli themselves, or the perceptual experience of those stimuli. Perceptual similarity measures for each pair of shapes were obtained from a psychophysical same-different task; physical similarity measures were based on stimulus parameters; and neural similarity measures were obtained from multivoxel pattern analysis methods applied to anterior LOC (pFs) and posterior LOC (LO). We found that the pattern of pairwise shape similarities in LO most closely matched physical shape similarities, whereas shape similarities in pFs most closely matched perceptual shape similarities. Further, shape representations were similar across participants in LO but highly variable across participants in pFs. Together, these findings indicate that activation patterns in subregions of object-selective cortex encode objects according to a hierarchy, with stimulus-based representations in posterior regions and subjective and observer-specific representations in anterior regions.

Introduction

Understanding how the human brain represents object shape is a central goal of visual neuroscience. The lateral occipital complex (LOC) has long been recognized as a key region for shape processing. However, a fundamental question remains: does the LOC represent the objective physical geometry of an object, or the subjective perceptual experience of the observer? While traditional fMRI analyses focusing on mean activation levels can mask fine-grained information, Multivoxel Pattern Analysis (MVPA) allows researchers to examine the "neural fingerprint" of individual stimuli. This study investigates the functional dissociation between two LOC subregions—the posterior lateral occipital (LO) and the anterior posterior fusiform (pFs)—to determine if they prioritize physical or perceptual information.

Methods

The study employed a set of four novel, complex shapes designed to vary systematically in a parametric "shape space" defined by aspect ratio and skew. By using novel stimuli, the researchers avoided confounding variables such as semantic meaning or learned associations.

Three distinct similarity measures were compared:

  1. Physical Similarity: Defined by the inverse of the distance between shapes in the parametric coordinate space.
  2. Perceptual Similarity: Measured via a psychophysical "same-different" task performed outside the scanner. The frequency with which participants confused two different shapes served as the metric for subjective similarity.
  3. Neural Similarity: Derived from fMRI data using MVPA. The researchers calculated the correlation between spatial patterns of voxel activity evoked by each shape within the LO and pFs.

Results

The results demonstrated a clear hierarchical transformation of shape information within the LOC.

Figure 1: Comparison of physical, perceptual, and neural similarity matrices for novel shapes.

In the posterior LO, neural patterns were found to correlate significantly with physical similarity (r ≈ 0.41) but showed no significant relationship with perceptual similarity (r ≈ 0.001). In contrast, the anterior pFs showed neural patterns that correlated significantly with perceptual similarity (r ≈ 0.35), while the relationship with physical similarity was much weaker and non-significant (r ≈ 0.10). Control regions, such as the primary visual cortex (V1) and the fusiform face area (FFA), did not exhibit these specific shape-similarity correlations.

Additionally, the study examined inter-participant reliability. Neural representations in the LO were highly consistent across the eight participants (r = 0.42), whereas representations in the pFs were highly idiosyncratic (r = 0.07). This indicates that while the posterior cortex maintains a relatively objective representation of the physical world, the anterior cortex encodes a more "private," observer-specific version of reality.

Discussion

These findings support a functional hierarchy within the object-selective cortex. As visual information progresses from posterior to anterior regions of the LOC, it is transformed from a stimulus-based, objective representation into a subjective, perceptual one. This dissociation highlights the role of the anterior LOC in constructing the idiosyncratic perceptual experiences that define human vision.

While the study's sample size is small (n=8), the robust within-subject correlations provide strong evidence for this posterior-anterior gradient. Future research should investigate whether this hierarchy persists for familiar objects or if top-down semantic knowledge further alters these representations.

Summary updated

Abstract

Prior research has identified the lateral occipital complex (LOC) as a critical cortical region for the representation of object shape in humans. However, little is known about the nature of the representations contained in the LOC and their relationship to the perceptual experience of shape. We used human functional MRI to measure the physical, behavioral, and neural similarity between pairs of novel shapes to ask whether the representations of shape contained in subregions of the LOC more closely reflect the physical stimuli themselves, or the perceptual experience of those stimuli. Perceptual similarity measures for each pair of shapes were obtained from a psychophysical same-different task; physical similarity measures were based on stimulus parameters; and neural similarity measures were obtained from multivoxel pattern analysis methods applied to anterior LOC (pFs) and posterior LOC (LO). We found that the pattern of pairwise shape similarities in LO most closely matched physical shape similarities, whereas shape similarities in pFs most closely matched perceptual shape similarities. Further, shape representations were similar across participants in LO but highly variable across participants in pFs. Together, these findings indicate that activation patterns in subregions of object-selective cortex encode objects according to a hierarchy, with stimulus-based representations in posterior regions and subjective and observer-specific representations in anterior regions.
BibTeX
@inproceedings{haushofer2008multivariate,
  author = {Johannes Haushofer and Margaret S. Livingstone and Nancy Kanwisher},
  title = {{Multivariate Patterns in Object-Selective Cortex Dissociate Perceptual and Physical Shape Similarity}},
  booktitle = {PLoS},
  year = {2008},
  doi = {10.1371/journal.pbio.0060187},
}
Figure