Perceptual phenotypes: Perceptual gains and losses in synesthesia and schizophrenia

Tessa M. van Leeuwen, Andreas Sauer, Anna-Maria Jurjut, Michael Wibral, Peter J. Uhlhaas, Wolf Singer, Lucía MellonibioRxiv 2018 · DOI

TL;DR

This study proposes that differences in how our brains weigh sensory evidence against prior knowledge explain distinct perceptual experiences in synesthesia and schizophrenia. By using a visual task, researchers found that schizophrenia patients over-rely on sensory input, while synesthetes leverage strong internal "priors" for specific stimuli, offering a unified framework for understanding perceptual variability.

What Problem Does This Paper Address?

Perception isn't a passive reception of the world; it's an active, inferential process. We constantly integrate incoming sensory data with our existing knowledge and expectations (priors) to construct our experience. This paper tackles the question of why individuals can have such dramatically different perceptual experiences, even when presented with the same sensory input. Specifically, it focuses on two conditions with altered perception: synesthesia, where stimuli automatically trigger additional sensory experiences (e.g., seeing colors when hearing sounds), and schizophrenia, often characterized by perceptual deficits like impaired organization and hallucinations. The authors hypothesize that the core difference lies in how these individuals "weight" the precision of sensory evidence versus their internal priors.

Methods

The researchers employed a perceptual hysteresis task, a clever experimental design that manipulates the balance between sensory evidence and prior knowledge. Participants viewed letters, numbers, and symbols embedded in noise. The "sensory evidence" was varied by changing the noise level, making the stimuli easier or harder to discern.

The experiment had two main phases:

  1. Sensory Evidence Increase: Starting with very noisy (low evidence) stimuli, the clarity of the stimuli was gradually increased over four trials. In this phase, perception is thought to be heavily influenced by both incoming sensory data and stable, long-term prior knowledge.
  2. Sensory Evidence Decrease: After reaching a point where stimuli were clearly visible, the clarity was then gradually decreased over three trials. Here, explicit, short-term priors (expectations formed during the experiment) are hypothesized to play a larger role.

A key manipulation involved using stimuli that either induced synesthetic experiences (e.g., letters with associated colors for synesthetes) or were neutral (symbols). This allowed them to investigate how synesthetes' specific long-term priors influenced their perception.

Datasets

Not discussed in the paper.

Key Insights and Ideas

  • A Unified Framework for Perceptual Differences: The paper proposes that the "precision weighting" of sensory evidence versus prior knowledge is a fundamental mechanism underlying diverse perceptual phenotypes like those seen in synesthesia and schizophrenia. This offers a parsimonious explanation for seemingly disparate perceptual alterations.
  • Schizophrenia: Sensory Overload: Schizophrenia patients appear to over-rely on sensory evidence, meaning their perception is less influenced by prior expectations. This aligns with the idea of high-precision prediction errors, where the brain is overly sensitive to new, incoming information.
  • Synesthesia: Prior Knowledge Powerhouse: Synesthetes show enhanced perception specifically for stimuli that trigger their synesthetic experiences. This suggests they possess highly precise and influential long-term priors for these specific stimuli, which can boost perception even when sensory evidence is weak.
  • Short-Term Priors are Universal Boosters: Both schizophrenia patients and synesthetes benefit from explicit, short-term priors introduced during the experiment. However, these short-term cues don't fully normalize perception, indicating that the underlying imbalance in long-term precision weighting remains.
  • Subjective vs. Objective Perception: The study focuses on subjective visibility ratings, acknowledging that this might differ from objective performance. This highlights the importance of understanding how individuals experience perception, not just how accurately they can perform a task.

Key Results

  • Schizophrenia Patients: Showed increased visibility thresholds, meaning they needed more sensory evidence to perceive stimuli. This is consistent with an overreliance on sensory evidence.
  • Synesthetes: Exhibited lowered visibility thresholds specifically for synesthesia-inducing stimuli. This suggests their strong, high-precision long-term priors for these stimuli enhance perception. For neutral stimuli, their performance was similar to controls.
  • Explicit Short-Term Priors: In both groups, explicit short-term priors (introduced during the experiment) lowered perceptual thresholds, boosting perception across the board. However, this effect was similar across all groups and did not normalize the distinct perceptual phenotypes observed earlier.

Limitations and Future Work

  • Medication Effects: The schizophrenia patients were medicated, and the authors acknowledge that anti-dopaminergic medication might influence precision weighting. Future work could explore this effect more directly.
  • Sample Size: The schizophrenia sample size (N=18) was noted as a limitation, though the study used a sensitive design to detect medium-to-weak effect sizes.
  • Subjective Visibility: The reliance on subjective visibility ratings, while insightful for understanding perceptual experience, doesn't directly measure objective performance. Future studies could integrate both.
  • Neural Mechanisms: The paper speculates on potential neural mechanisms (e.g., NMDA receptor dysfunction in schizophrenia, predictive processing in synesthesia) and suggests that this behavioral profile could inform computational modeling and neurophysiological investigations to better understand the underlying brain processes.

Summary updated

Abstract

Abstract Individual differences in perception are widespread. Considering inter-individual variability, synesthetes experience stable additional sensations; schizophrenia patients suffer perceptual deficits in e.g. perceptual organization (alongside hallucinations and delusions). Is there a unifying principle explaining inter-individual variability in perception? There is good reason to believe perceptual experience results from inferential processes whereby sensory evidence is weighted by prior knowledge about the world. Different perceptual phenotypes may result from different precision weighting of sensory evidence and prior knowledge. We tested this hypothesis by comparing visibility thresholds in a perceptual hysteresis task across medicated schizophrenia patients, synesthetes, and controls. Participants rated the subjective visibility of stimuli embedded in noise while we parametrically manipulated the availability of sensory evidence. Additionally, precise long-term priors in synesthetes were leveraged by presenting either synesthesia-inducing or neutral stimuli. Schizophrenia patients showed increased visibility thresholds, consistent with overreliance on sensory evidence. In contrast, synesthetes exhibited lowered thresholds exclusively for synesthesia-inducing stimuli suggesting high-precision long-term priors. Additionally, in both synesthetes and schizophrenia patients explicit, short-term priors – introduced during the hysteresis experiment – lowered thresholds but did not normalize perception. Our results imply that distinct perceptual phenotypes might result from differences in the precision afforded to prior beliefs and sensory evidence, respectively.
BibTeX
@misc{leeuwen2018perceptual,
  author = {Tessa M. van Leeuwen and Andreas Sauer and Anna-Maria Jurjut and Michael Wibral and Peter J. Uhlhaas and Wolf Singer and Lucía Melloni},
  title = {{Perceptual phenotypes: Perceptual gains and losses in synesthesia and schizophrenia}},
  year = {2018},
  doi = {10.1101/443846},
  howpublished = {bioRxiv},
}
Figure