Neuroimaging Findings on Amodal Completion: A Review

Jordy Thielen, Sander Bosch, Tessa M. van Leeuwen, Marcel van Gerven, Rob van Lieri-Perception 2019 · DOI

TL;DR

This review synthesizes neuroimaging studies to understand how our brains complete partially hidden objects (amodal completion). It reveals that amodal completion is a complex process involving multiple brain regions and temporal stages, suggesting it's a fundamental mechanism for navigating our visually incomplete world.

What Problem Does This Paper Address?

We live in a world where objects are frequently occluded. Despite this, our visual system seamlessly perceives these objects as whole and complete. This phenomenon, known as amodal completion, is the brain's ability to infer the presence and form of unseen parts of an object. The challenge is to understand the neural underpinnings of this process: where in the brain does it happen, when does it occur, and how are these unseen parts represented? This review aims to consolidate findings from neuroimaging studies to answer these questions, moving beyond behavioral observations to explore the neural correlates.

Methods

This paper is a review of existing neuroimaging literature. The authors categorize studies based on the neuroimaging techniques used, including:

  • Single-unit recordings (SURs): Invasive but offer high temporal and spatial resolution at the neuronal level, primarily used in animal studies.
  • Electroencephalography (EEG): Non-invasive, providing excellent temporal resolution but limited spatial resolution.
  • Magnetoencephalography (MEG): Non-invasive, offering good temporal resolution and better spatial resolution than EEG.
  • Functional Magnetic Resonance Imaging (fMRI): Non-invasive, providing high spatial resolution but lower temporal resolution.

The review also discusses how different stimulus conditions (occluded, completed, mosaic) and occlusion types (static, dynamic, pictorial, stereoscopic) are employed in these studies.

Datasets

Not discussed in the paper. The paper reviews existing studies and does not introduce new datasets or benchmarks.

Key Insights and Ideas

  • Amodal completion is not a single event: The process appears to unfold over time and involve multiple brain areas, from early visual cortex to higher-level processing regions.
  • Low-level vs. High-level involvement: While early visual areas (V1, V2) show some evidence of involvement, their role is debated, with some studies suggesting they represent the "mosaic" (uncompleted) stage. Higher-level areas like the Lateral Occipital Complex (LOC) and Fusiform Face Area (FFA) appear more consistently involved, showing responses that are often invariant to occlusion for general objects and faces, respectively.
  • Temporal dynamics are complex: Amodal completion likely involves a mix of feedforward, recurrent, and feedback processes. Some studies suggest rapid feedforward processing, while others point to longer processing times and the involvement of feedback loops, especially for more complex stimuli or when learning is involved.
  • Representation of unseen parts is nuanced: It's unclear if the invisible parts are represented with full detail or as an abstract representation. While some studies show decoding of object identity from occluded regions, this is often more robust in higher-level areas.
  • Stimulus complexity matters: Simple stimuli might be completed in lower-level visual areas, while more complex objects or scenes may require higher-level processing and top-down influences.

Key Results

  • LOC and FFA invariance: These high-level areas often show similar responses to completed objects and occluded objects, suggesting they represent the object as a whole, regardless of occlusion.
  • Motor area involvement: Motor areas (e.g., MT, PMC) show increased activity during dynamic occlusion, potentially related to object permanence.
  • Temporal latencies vary: Responses in early visual areas can occur as early as 80-100ms for simple stimuli, but later responses (up to 500ms or more) are observed, especially for more complex scenarios or when feedback is involved.
  • Decoding evidence: Some studies show successful decoding of object identity from higher visual areas even when objects are occluded, but this is often less successful in early visual areas.

Limitations and Future Work

  • Ambiguity in early visual cortex: The role of V1 and V2 in amodal completion remains debated, with conflicting results regarding whether they represent the completed object or the uncompleted mosaic. This might be due to the type of stimuli used (simple vs. complex) and the experimental paradigms.
  • Representation uncertainty: It's still not definitively clear how the invisible parts of an occluded object are represented – whether in full detail or as an abstract representation. The term "amodal presence" is suggested as an alternative to "amodal completion" in some contexts.
  • Future directions: The authors suggest further research to investigate different levels of amodal completion based on object complexity and saliency, and to clarify the interplay between feedforward, recurrent, and feedback processes. Understanding amodal completion could provide insights into other perceptual phenomena like mental imagery and visual working memory.

Summary updated

Abstract

Amodal completion is the phenomenon of perceiving completed objects even though physically they are partially occluded. In this review, we provide an extensive overview of the results obtained from a variety of neuroimaging studies on the neural correlates of amodal completion. We discuss whether low-level and high-level cortical areas are implicated in amodal completion; provide an overview of how amodal completion unfolds over time while dissociating feedforward, recurrent, and feedback processes; and discuss how amodal completion is represented at the neuronal level. The involvement of low-level visual areas such as V1 and V2 is not yet clear, while several high-level structures such as the lateral occipital complex and fusiform face area seem invariant to occlusion of objects and faces, respectively, and several motor areas seem to code for object permanence. The variety of results on the timing of amodal completion hints to a mixture of feedforward, recurrent, and feedback processes. We discuss whether the invisible parts of the occluded object are represented as if they were visible, contrary to a high-level representation. While plenty of questions on amodal completion remain, this review presents an overview of the neuroimaging findings reported to date, summarizes several insights from computational models, and connects research of other perceptual completion processes such as modal completion. In all, it is suggested that amodal completion is the solution to deal with various types of incomplete retinal information, and highly depends on stimulus complexity and saliency, and therefore also give rise to a variety of observed neural patterns.
BibTeX
@inproceedings{thielen2019neuroimaging,
  author = {Jordy Thielen and Sander Bosch and Tessa M. van Leeuwen and Marcel van Gerven and Rob van Lier},
  title = {{Neuroimaging Findings on Amodal Completion: A Review}},
  booktitle = {i-Perception},
  year = {2019},
  doi = {10.1177/2041669519840047},
}
Figure