Auditory motion perception emerges from successive sound localizations integrated over time

Vincent Roggerone, Jonathan Vacher, Cynthia Tarlao, Catherine GuastavinoScientific 2019 · DOI

TL;DR

This paper proposes a novel model for auditory motion perception that explains how we track moving sounds by integrating successive static sound localizations over time. The model successfully predicts experimental results, suggesting that specialized motion-sensitive auditory mechanisms are not necessary, and that temporal integration (akin to motion blur in vision) is the key factor.

What Problem Does This Paper Address?

While humans are adept at using auditory cues to track moving sound sources, the underlying mechanisms are less understood compared to visual motion perception. Existing psychophysical models suggest auditory motion perception arises from successive sound localizations, but they often fail to accurately predict experimental outcomes. A key challenge is understanding the "upper limit" (UL) of circular auditory motion perception – the speed at which we can no longer reliably determine the direction of a spinning sound. This paper aims to bridge this gap by proposing a new model that incorporates temporal integration, a factor previously overlooked, to explain the UL and the overall phenomenon of auditory motion perception.

Methods

The researchers developed a computational model based on the concept of "temporal integration" and "static localization snapshots." The core idea is that the auditory system takes snapshots of sound locations at discrete points in time. These snapshots are then integrated over a "minimum integration time" (MIT), which is hypothesized to be around 300 ms. This temporal integration process is likened to motion blur in vision, where rapid movement can smear out details.

The model focuses on front-back confusions, a common issue in static sound localization where sounds from the front and back can be misidentified. The researchers hypothesize that as a sound source moves, the temporal integration blurs the spectral cues used for front-back discrimination, making it unreliable at higher speeds, thus leading to the observed upper limit (UL).

To validate their model, they conducted three psychophysical experiments. These experiments involved participants identifying the direction of circular auditory motion using various filtered noise stimuli with different spectral content (center frequency and bandwidth). The upper limit (UL) for each stimulus was measured using an adaptive two-alternative-forced-choice paradigm. The model's predictions were then compared against these experimental results.

Datasets

Not discussed in the paper. The study relies on psychophysical experiments with human participants and computational modeling.

Key Insights and Ideas

  • Auditory motion perception doesn't require specialized motion detectors: The study strongly suggests that our ability to perceive auditory motion can be explained by integrating static localization cues over time, rather than relying on dedicated motion-sensitive neurons.
  • Temporal integration as "auditory motion blur": The concept of a Minimum Integration Time (MIT) is crucial. It leads to a blurring of localization cues at higher speeds, analogous to visual motion blur, which degrades the ability to accurately perceive direction.
  • Front-back confusions are key to the upper limit: The model highlights that the upper limit of auditory motion perception is primarily governed by the difficulty in resolving front-back confusions at higher speeds, due to the temporal integration effect.
  • Spectral content matters for motion perception: The experiments revealed that the upper limit is influenced by the spectral characteristics of the sound, with certain bandwidths and frequencies leading to higher or lower limits, which the model successfully predicts.
  • A unified model for static and motion perception: The proposed model bridges the gap between static sound localization and auditory motion perception by incorporating temporal integration into a framework based on static localization cues.

Key Results

  • The proposed model accurately predicts the measured upper limits (ULs) for circular auditory motion across various stimuli with high correlation coefficients (R1=0.95, R2=0.97, R3=0.97).
  • Experiments showed that the UL generally increases with the bandwidth and center frequency of the sound stimuli.
  • The study found that the upper limit is strongly linked to front-back confusions, with stimuli that induce more front-back confusion also having lower ULs.
  • The model's predictions were optimized with a Minimum Integration Time (MIT) of approximately 300 ms, consistent with previous research on auditory sluggishness.
  • The model successfully explained why certain stimuli, particularly those with low-frequency content or narrow bandwidths, lead to lower ULs, as they provide less robust spectral cues for front-back discrimination.

Limitations and Future Work

  • Model's limitations with specific stimuli: The model had difficulty predicting ULs for stimuli with very low cut-off frequencies (e.g., 250 Hz) or specific band-stop configurations where spectral cues are inherently weak. The authors suggest that Interaural Level Differences (ILDs) and head/torso effects, not fully incorporated, might play a role in these cases.
  • Averaging of energy levels: The model assumes energy levels are averaged around the sound's actual position. While this works for the front-back cue, the authors acknowledge that a more general sound tracking model would need to address how the brain processes input from previous locations.
  • Future directions: The authors propose extending the model to handle other sound trajectories beyond circular motion and developing probabilistic models, similar to those used in vision, to integrate multiple cues and prior knowledge for a more comprehensive auditory motion perception system.

Summary updated

Abstract

Humans rely on auditory information to estimate the path of moving sound sources. But unlike in vision, the existence of motion-sensitive mechanisms in audition is still open to debate. Psychophysical studies indicate that auditory motion perception emerges from successive localization, but existing models fail to predict experimental results. However, these models do not account for any temporal integration. We propose a new model tracking motion using successive localization snapshots but integrated over time. This model is derived from psychophysical experiments on the upper limit for circular auditory motion perception (UL), defined as the speed above which humans no longer identify the direction of sounds spinning around them. Our model predicts ULs measured with different stimuli using solely static localization cues. The temporal integration blurs these localization cues rendering them unreliable at high speeds, which results in the UL. Our findings indicate that auditory motion perception does not require motion-sensitive mechanisms.
BibTeX
@inproceedings{roggerone2019auditory,
  author = {Vincent Roggerone and Jonathan Vacher and Cynthia Tarlao and Catherine Guastavino},
  title = {{Auditory motion perception emerges from successive sound localizations integrated over time}},
  booktitle = {Scientific},
  year = {2019},
  doi = {10.1038/s41598-019-52742-0},
}
Figure