A Superadditive-Impairment Theory of Optic Aphasia

Michael Mozer, Mark Sitton, Martha J. FarahNeurIPS 1997 · OpenReview

TL;DR

This paper proposes that the puzzling neurological disorder optic aphasia—where patients can recognize but not name visual objects—is caused by "superadditive" damage. By using a connectionist model, the authors demonstrate that partial damage to two separate pathways (vision-to-meaning and meaning-to-naming) creates a massive deficit only when both are used together, explaining why patients can still name objects by sound or gesture their use.

What Problem Does This Paper Address?

The authors tackle a classic mystery in neuropsychology: optic aphasia. Imagine being shown a picture of a hammer. You can’t say the word "hammer," but you can perfectly mimic the motion of hammering a nail. If someone plays the sound of a hammer, you can name it instantly.

Standard "box-and-arrow" models of the brain struggle to explain this. If the "naming" system were broken, you couldn't name anything. If the "visual" system were broken, you couldn't gesture the object's use.

Standard box-and-arrow model of visual naming

To explain this highly specific deficit, some researchers suggested the brain must have multiple, redundant semantic (meaning) systems—a messy and unparsimonious theory. This paper asks: Can we explain this specific deficit using a simpler architecture with just partial, distributed damage?

Methods

The authors built a computational model using a connectionist (neural network) architecture consisting of four pathways:

  1. Visual $\to$ Semantics ($V \to S$)
  2. Auditory $\to$ Semantics ($A \to S$)
  3. Semantics $\to$ Naming ($S \to N$)
  4. Semantics $\to$ Gesturing ($S \to G$)

Each pathway is a two-stage system:

  • Mapping Network: A standard feedforward network that provides a "quick and dirty" first guess.
  • Clean-up (Attractor) Network: A recurrent network that iteratively refines the noisy output of the mapping network until it settles on a clear "concept" or "word."

To simulate a patient, the researchers "lesioned" the model by randomly removing 30% of the connections in both the $V \to S$ and $S \to N$ mapping networks. They also implemented a priming mechanism that makes recently used concepts easier to access, which helps simulate common clinical errors.

Datasets

The study uses synthetic datasets rather than real-world images or audio:

  • Representational Spaces: 200-dimensional vectors representing visual, auditory, semantic, naming, and gesturing domains.
  • Patterns: 200 unique patterns were generated. For visual and semantic spaces, these were organized into 50 "similarity clusters" (4 siblings each) to mimic the way real-world objects (like different types of chairs) share features.
  • Correspondences: Arbitrary links were established so that "Visual Pattern 7" corresponded to "Semantic Pattern 7" and "Name Pattern 7."

Key Insights and Ideas

  • The Superadditive Effect: This is the core breakthrough. If you damage one pathway slightly, the "clean-up" network can fix the noise. However, when you chain two slightly damaged pathways together (Vision $\to$ Semantics $\to$ Naming), the noise from the first stage overwhelms the second stage. The error isn't just added; it's multiplied.
  • Cascade Dynamics: The model assumes the brain doesn't wait for one stage to finish before starting the next. Because the $S \to N$ pathway starts processing the "noisy" and "unstable" output of the $V \to S$ pathway immediately, it is much more likely to settle on the wrong word.
  • Semantic "Siblings": Because the model uses similarity clusters, when it makes an error, it doesn't just pick a random word. It usually picks a "sibling"—a semantically related word (e.g., saying "orange" for an apple). This perfectly matches how human patients behave.
  • Parsimony: The model explains a complex clinical condition without needing to invent extra "semantic modules" in the brain. It suggests the deficit is a property of how distributed systems interact under stress.

Key Results

The simulated "patients" (lesioned models) showed a pattern of errors that mirrored human clinical data:

Task error rates for the lesioned model

As shown in the results, the model achieved near-perfect performance on auditory naming (0.5% error) and remained highly functional for visual gesturing (8.7% error). However, visual naming suffered a severe deficit with a 36.8% error rate.

This error rate for visual naming was nearly four times higher than the sum of the errors of its component parts, proving the superadditive nature of the impairment. Additionally, the model produced high rates of semantic errors and perseverations (repeating a previous answer), consistent with real-world observations of optic aphasia.

Limitations and Future Work

  • Equating Difficulty: The authors note a specific prediction: visual gesturing should be slightly harder than auditory naming in these patients. They suggest future experimental work should test this by equating the difficulty of these tasks in human subjects.
  • Architecture Specifics: The model relies on a "localist" attractor network for simplicity. The authors suggest that using fully distributed attractor networks might yield even more nuanced results.
  • Scope: While the model explains the "home in" effect (where patients eventually find the right word if given time), the details of this were omitted due to space constraints in the original report.

Summary updated

Abstract

Accounts of neurological disorders often posit damage to a specific functional pathway of the brain. Farah (1990) has proposed an alterna(cid:173) tive class of explanations involving partial damage to multiple path(cid:173) ways. We explore this explanation for optic aphasia, a disorder in which severe perfonnance deficits are observed when patients are asked to name visually presented objects, but surprisingly, performance is rela(cid:173) tively nonnal on naming objects from auditory cues and on gesturing the appropriate use of visually presented objects. We model this highly specific deficit through partial damage to two pathways-one that maps visual input to semantics, and the other that maps semantics to naming responses. The effect of this damage is superadditive, meaning that tasks which require one pathway or the other show little or no perfor(cid:173) mance deficit, but the damage is manifested when a task requires both pathways (i.e., naming visually presented objects). Our model explains other phenomena associated with optic aphasia, and makes testable experimental predictions. Neuropsychology is the study of disrupted cognition resulting from damage to functional systems in the brain. Generally, accounts of neuropsychological disorders posit damage to a particular functional system or a disconnection between systems. Farah (1990) sug(cid:173) gested an alternative class of explanations for neuropsychological disorders: partial dam(cid:173) age to multiple systems, which is manifested through interactions among the loci of damage. We explore this explanation for the neuropsychological disorder of optic aphasia. Optic aphasia, arising from unilateral left posterior lesions, including occipital cortex and the splenium of the corpus callosum (Schnider, Benson, & Scharre, 1994), is marked by a deficit in naming visually presented objects, hereafter referred to as visual naming (Farah, 1990). However, patients can demonstrate recognition of visually presented objects nonverbally, for example, by gesturing the appropriate use of an object or sorting visual items into their proper superordinate categories (hereafter, visual gesturing). Patients can also name objects by nonvisual cues such as a verbal definition or typical sounds made by the objects (hereafter, auditory naming). The highly specific nature of the deficit rules out an explanation in terms of damage to a single pathway in a standard model of visual naming (Figure 1), suggesting that a more complex model is required, involving A Superadditive-Impainnent Theory of Optic Aphasia 67 FIGURE 1. A standard box-and-arrow model of visual naming. The boxes denote levels of representation, and the arrows denote pathways mapping from one level of representation to another. Although optic aphasia cannot be explained by damage to the vision-to-semantics pathway or the semantics-ta-naming Farah (1990) proposed an explanation in terms of partial damage to both pathways (the X's).
BibTeX
@inproceedings{mozer1997superadditive,
  author = {Michael Mozer and Mark Sitton and Martha J. Farah},
  title = {{A Superadditive-Impairment Theory of Optic Aphasia}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {1997},
  url = {https://openreview.net/forum?id=B1V4fOZO-B},
}

Loading related content...

Figure