Retinotopic Organization of Scene Areas in Macaque Inferior Temporal Cortex

Michael J. Arcaro, Margaret S. Livingstone

TL;DR

This study used fMRI to map visual processing areas in macaque monkeys, revealing that even higher-level areas in the inferior temporal cortex (IT) have a structured retinotopic organization. Specifically, they identified two new visual field maps (OTS1 and OTS2) within scene-selective cortex, demonstrating that these areas are not just category-specific but also spatially organized, mirroring findings in humans and suggesting a conserved organization of visual processing across primate species.

What Problem Does This Paper Address?

For a long time, the inferior temporal (IT) cortex in primates was thought to be primarily organized by object categories (like faces, bodies, or scenes) rather than by spatial location (retinotopy). While retinotopic maps are a well-established organizing principle in earlier visual areas (like V1 and V2), their presence in higher-level IT areas was debated. Recent studies began to suggest retinotopy in some parts of IT, particularly around the superior temporal sulcus (STS). However, the extent of this retinotopic organization, especially within scene-selective areas of the ventral IT, remained unclear. This paper aims to clarify whether scene-selective regions in the macaque ventral IT cortex exhibit retinotopic maps and how this organization compares to that found in humans.

Methods

The researchers employed functional magnetic resonance imaging (fMRI) in four macaque monkeys. They used two primary retinotopic mapping techniques:

  • Polar Angle Mapping: A rotating wedge stimulus was used to map the representation of different angles in the visual field.
  • Eccentricity Mapping: An expanding or contracting annulus stimulus was used to map the representation of different distances from the center of vision.

To identify category-selective areas, they presented static images of scenes, faces, bodies, and objects. The fMRI data were analyzed using standard neuroimaging software (AFNI, SUMA, Freesurfer) to identify voxels with significant retinotopic responses and category selectivity. They also performed statistical analyses, including Fourier analysis for retinotopy and regression analysis for category selectivity, to quantify their findings.

Datasets

Not discussed in the paper. The study utilized fMRI data collected from four macaque monkeys.

Key Insights and Ideas

  • IT Cortex is More Organized Than Previously Thought: The study strongly supports the idea that IT cortex, even at later stages of visual processing, is not just a jumble of category-tuned neurons but has a systematic spatial organization.
  • Scene Areas Have Retinotopic Maps: The identification of two new retinotopic maps (OTS1 and OTS2) within the scene-selective regions of the ventral IT cortex is a major finding. This directly challenges the notion that IT is solely category-driven.
  • Peripheral Bias in Scene Processing: The newly identified scene areas (OTS1 and OTS2) predominantly represent the peripheral visual field, suggesting that scene recognition might be heavily reliant on peripheral vision.
  • Human-Macaque Parallels: The retinotopic organization and the peripheral bias observed in macaque scene areas closely mirror findings in human ventral temporal cortex (specifically areas PHC1/2), suggesting a conserved evolutionary organization of scene processing.
  • OTS1/OTS2 as Homologues to Human PHC: The study proposes that macaque OTS1/2 are the functional homologues of human PHC1/2, strengthening the cross-species comparison of visual processing.
  • Ubiquitous Retinotopy: The findings suggest that retinotopic representations are widespread throughout the macaque visual system, from early visual areas to higher-order temporal and parietal regions, and even into subcortical structures like the LGN and pulvinar.

Key Results

  • Two new retinotopic visual field maps, OTS1 and OTS2, were identified in the occipitotemporal sulcus (OTS) of macaque ventral IT cortex.
  • These areas (OTS1 and OTS2) were found to be selectively responsive to scene stimuli over faces, bodies, or objects.
  • OTS1 and OTS2 primarily represented the contralateral peripheral visual field, with a slight bias towards the upper visual field.
  • The retinotopic organization of OTS1 and OTS2 showed a mirror-image relationship in polar angle representation between the two areas.
  • The study confirmed the presence of retinotopic maps in numerous other visual areas, including dorsal extrastriate, posterior parietal, and frontal cortex, as well as the thalamus.
  • The scene-selective region LPP (previously identified) overlapped with the retinotopic maps OTS1 and OTS2, supporting their role in scene processing.
  • The functional organization of these scene-selective areas and their retinotopic organization showed strong parallels with human visual cortex.

Limitations and Future Work

  • Sample Size: The study was conducted on four juvenile monkeys. While the results were consistent across these individuals, a larger sample size would further strengthen the generalizability of the findings.
  • Juvenile Subjects: While the retinotopic organization was mature in the juvenile monkeys, future studies could explore developmental trajectories.
  • "Gap" in Medial Cortex: The paper notes a small region of medial ventral temporal cortex that did not clearly belong to the identified OTS maps or surrounding areas, suggesting potential for further investigation into this region.
  • Human VO Comparison: The exact correspondence of macaque visual areas to human VO maps remains unclear, presenting an avenue for future research.
  • Functional Specialization Nuances: While a strong correspondence between OTS and human PHC is proposed, the authors acknowledge that novel functional specializations might have emerged in these regions over evolutionary time. Future work could delve deeper into these potential differences.
  • AIT Retinotopy: The lack of clear retinotopic responses in anterior temporal STS (AIT) despite visual activation warrants further investigation, possibly with different mapping paradigms.

Summary updated

Abstract

Primates have specialized domains in inferior temporal (IT) cortex that are responsive to particular image categories. Though IT traditionally has been regarded as lacking retinotopy, several recent studies in monkeys have shown that retinotopic maps extend to face patches along the lower bank of the superior temporal sulcus (STS) and neighboring regions of IT cortex. Here, we used fMRI to map the retinotopic organization of medial ventral temporal cortex in four monkeys (2 male and 2 female). We confirm the presence of visual field maps within and around the lower bank of the STS and extend these prior findings to scene-selective cortex in the ventral-most regions of IT. Within the occipitotemporal sulcus (OTS), we identified two retinotopic areas, OTS1 and OTS2. The polar angle representation of OTS2 was a mirror reversal of the OTS1 representation. These regions contained representations of the contralateral periphery and were selectively active for scene versus face, body, or object images. The extent of this retinotopy parallels that in humans and shows that the organization of the scene network is preserved across primate species. In addition retinotopic maps were identified in dorsal extrastriate, posterior parietal, and frontal cortex as well as the thalamus, including both the lateral geniculate nucleus and pulvinar. Together, it appears that most, if not all, of the macaque visual system contains organized representations of visual space.<b>SIGNIFICANCE STATEMENT</b> Primates have specialized domains in inferior temporal (IT) cortex that are responsive to particular image categories. Though retinotopic maps are considered a fundamental organizing principle of posterior visual cortex, IT traditionally has been regarded as lacking retinotopy. Recent imaging studies have demonstrated the presence of several visual field maps within the lateral IT. Using neuroimaging, we found multiple representations of visual space within ventral IT cortex of macaques that included scene-selective cortex. Scene domains were biased toward the peripheral visual field. These data demonstrate the prevalence of visual field maps throughout the primate visual system, including late stages in the ventral visual hierarchy, and support the idea that domains representing different categories are biased toward different parts of the visual field.
BibTeX
@article{arcaro2017retinotopic,
  author = {Michael J. Arcaro and Margaret S. Livingstone},
  title = {{Retinotopic Organization of Scene Areas in Macaque Inferior Temporal Cortex}},
  journal = {Journal of Neuroscience},
  year = {2017},
  doi = {10.1523/jneurosci.0569-17.2017},
}
Figure