The continuity illusion adapts to the auditory scene

Lars Riecke, Daniel Mendelsohn, Claudia S. Schreiner, Elia FormisanoHearing 2008 · DOI

TL;DR

Our auditory system can create the illusion that a sound continues through a brief interruption, especially if it's masked by noise. This paper shows that this "continuity illusion" isn't fixed; it adapts based on recent auditory experiences, becoming stronger or weaker depending on whether we've recently heard continuous or discontinuous sounds, and even the loudness of intervening noise. This suggests our auditory perception dynamically recalibrates to make sense of our acoustic environment.

What Problem Does This Paper Address?

The human auditory system is remarkably adept at making sense of complex soundscapes, even in the presence of noise. One fascinating phenomenon is the "continuity illusion," where a brief gap in a sound, especially if masked by noise, can be perceived as if the sound continued uninterrupted. This is crucial for maintaining the intelligibility of speech or music in noisy environments. However, the auditory system also needs to be sensitive to sudden, important events that might be signaled by interruptions in quiet environments. This raises a question: how does the auditory system balance these competing needs? Does the continuity illusion remain constant, or does it adapt to the prevailing acoustic conditions? This paper investigates whether the auditory system dynamically adjusts its tendency to create continuity illusions based on recent auditory experiences, specifically the perceived continuity of target sounds and the loudness of masking noise.

Methods

The researchers employed a psychophysical approach using carefully controlled auditory stimuli. They designed "schematic auditory scenes" that included tone sweeps (the target sounds) and white noise. The core of their method involved an "adaptation paradigm." Participants were first exposed to "adaptor" stimuli, which were designed to evoke either strong continuity illusions, true continuity, or discontinuity, and also varied in noise loudness. Following this adaptation period, participants were presented with an "ambiguous probe" stimulus – a tone sweep with a gap that could be perceived as either continuous or discontinuous. Participants rated the continuity of this probe on a four-point scale.

Two experiments were conducted:

  • Experiment 1: Focused on how the perceived continuity of the target sweep and the loudness of the masking noise influenced subsequent continuity ratings. The noise and sweep spectra overlapped.
  • Experiment 2: Investigated whether these adaptation effects were dependent on the specific spectral content of the adapting sounds. In this experiment, the spectra of the sweeps and noise were modified to be spectrally incongruent with the probe stimulus.

A key methodological innovation was the creation of a "bistable" probe stimulus, designed to be perceived differently depending on the preceding adaptation. Individual thresholds for the continuity illusion were also measured to tailor the probe stimulus to each listener.

Datasets

Not discussed in the paper. The stimuli were synthesized by the researchers.

Key Insights and Ideas

  • Auditory Restoration is Dynamic, Not Static: The most significant finding is that the continuity illusion is not a fixed perceptual phenomenon. It actively adapts to recent auditory input, demonstrating the auditory system's flexibility.
  • Continuity Begets Continuity (and Discontinuity Begets Discontinuity): Hearing continuous sounds (whether truly continuous or illusorily so) makes subsequent ambiguous sounds seem more continuous. Conversely, hearing discontinuous sounds biases perception towards discontinuity. This suggests a form of "perceptual learning" or recalibration.
  • Loudness Matters, Masking Potential Less So: The loudness of the masking noise plays a significant role. Louder noise leads to less perceived continuity in subsequent stimuli, while softer noise can enhance it. Interestingly, the masking potential of the noise (its ability to obscure the gap) seemed less influential than its overall loudness.
  • Abstract Adaptation: Crucially, the adaptation effects persisted even when the spectral content of the adapting sounds did not overlap with the probe stimulus. This strongly suggests that the adaptation is not happening at a low-level sensory processing stage but rather at a more abstract, non-sensory representation of the auditory scene.
  • Two Independent Adaptation Mechanisms: The results suggest that adaptation to sweep continuity and adaptation to noise loudness are largely independent processes.

Key Results

  • Adaptation to Continuity: Listeners who were adapted to continuous sweeps rated the ambiguous probe as more continuous, while those adapted to discontinuous sweeps rated it as more discontinuous. This effect was observed for both true and illusory continuity.
  • Adaptation to Noise Loudness: Louder noise adaptors led to lower continuity ratings of the probe, while softer noise adaptors led to higher continuity ratings.
  • Spectral Incongruence: Adaptation effects for sweep continuity remained significant even when the adapting sweep and the probe sweep had different frequency content, highlighting the abstract nature of this adaptation.
  • Noise Adaptation: While noise loudness influenced perception, the specific masking potential of the noise had a less pronounced effect, especially when the noise and sweep spectra were incongruent.
  • Time Scales: The adaptation effects were observed after relatively short exposure periods (two presentations of adaptors) and influenced perception for at least the following few seconds.

Limitations and Future Work

  • Disentangling Mechanisms: The authors acknowledge that it's difficult to fully disentangle whether the adaptation affects the sensory input to restoration mechanisms or the perceptual interpretation (e.g., a shift in the "continuity criterion"). Further experiments with signal detection analysis are suggested.
  • Neural Correlates: The study provides a strong behavioral basis for investigating the neural mechanisms underlying this adaptive continuity perception. Future work could explore the role of specific brain regions, such as the auditory cortex, in these adaptive processes.
  • Ecological Validity: While the study uses simplified stimuli, the findings suggest that auditory restoration is a flexible system that recalibrates to optimize perception in different acoustic environments, which has clear ecological implications for how we navigate and understand the world through sound.

Summary updated

BibTeX
@inproceedings{riecke2008continuity,
  author = {Lars Riecke and Daniel Mendelsohn and Claudia S. Schreiner and Elia Formisano},
  title = {{The continuity illusion adapts to the auditory scene}},
  booktitle = {Hearing},
  year = {2008},
  doi = {10.1016/j.heares.2008.10.006},
}
Figure