Music-selective cortex is sensitive to structure in both pitch and time

Dana Boebinger, Sam Norman-Haignere, Josh H. McDermott, Nancy KanwisherbioRxiv 2021 · DOI

TL;DR

Neuroscientists have identified specialized brain regions in the auditory cortex that are uniquely tuned to music. This study reveals that these "music-selective" areas are sensitive not just to individual musical notes, but crucially to how those notes are patterned in both pitch and time, suggesting a sophisticated neural representation of musical structure.

What Problem Does This Paper Address?

Music is a complex auditory experience, built from discrete notes organized into melodies, harmonies, and rhythms. While we know that certain areas of the human auditory cortex respond more strongly to music than other sounds, it's been unclear what aspects of music drive this selectivity. Does it come from processing individual notes, or from recognizing the patterns these notes form over time? This paper aims to disentangle these possibilities by investigating whether music-selective neural populations are sensitive to the structure of notes themselves, or to the intricate patterns of pitch and timing that define musicality.

Methods

The researchers employed functional Magnetic Resonance Imaging (fMRI) combined with a technique called "voxel decomposition." This method allows them to identify and isolate distinct neural populations within the auditory cortex based on their response profiles to various sounds. They created synthetic music stimuli where either the pitch, the timing, or both were systematically "scrambled," disrupting the musical patterns while largely preserving the acoustic properties of individual notes. They also used drum stimuli (which lack pitch) to isolate temporal pattern processing. By comparing the fMRI responses to intact music, scrambled music, and non-music sounds in both music-selective and non-selective auditory regions, they could pinpoint which aspects of music drive activity in these specialized areas.

Datasets

The study used a set of 120 synthetic MIDI-generated music clips and 20 MIDI drum stimuli. These stimuli were manipulated to create intact and scrambled versions (pitch-scrambled, time-scrambled, and pitch-and-time-scrambled). Additionally, 16 non-music control stimuli (speech, animal sounds, environmental sounds) were used. The fMRI data was collected from 15 participants.

Key Insights and Ideas

  • Music is more than just notes: The findings strongly suggest that our brains don't just process individual musical notes; they actively seek out and respond to the patterns formed by these notes in pitch and time.
  • Specialized neural circuits: The "music-selective" areas identified are not just generally good at processing sound; they are specifically tuned to the complex structural elements of music.
  • Pitch and time are equally important: Both pitch patterns and temporal patterns contribute significantly to the neural representation of music. Disrupting either one leads to a reduced response in music-selective areas.
  • Distributed but focused: While sensitivity to musical structure is found across both anterior and posterior auditory cortex, and in both hemispheres, it's concentrated in small, specialized clusters of neurons.

Key Results

  • Music-selective neural populations showed significantly stronger responses to intact music compared to music with scrambled pitch and/or time. This effect was about a 22% reduction in response for fully scrambled music.
  • Even when music was scrambled, the response in music-selective areas was still significantly higher than for non-music control sounds, indicating sensitivity to note-level structure as well.
  • Drum stimuli, which lack pitch, still elicited a strong response when intact compared to scrambled versions, highlighting the importance of temporal patterns.
  • Both anterior and posterior auditory regions, as well as both left and right hemispheres, showed sensitivity to pitch and temporal patterns, suggesting a widespread but focal representation.

Limitations and Future Work

The authors acknowledge that their scrambling methods, while carefully designed, might not perfectly preserve all lower-level acoustic properties, and that component methods may not perfectly isolate music selectivity. Future work could explore the temporal dynamics of these representations using methods with higher temporal resolution (like intracranial EEG) to better understand how pitch and time structure are processed over time. They also suggest that further research could investigate how these neural representations interact with other brain systems (like motor or limbic regions) to contribute to the full experience of music perception.

Summary updated

Abstract

ABSTRACT Music is distinguished from other natural sounds by the presence of relatively discrete notes, which are then organized across pitch and time to convey melody, harmony, and rhythm. Growing evidence suggests that small clusters of neural populations within anterior and posterior human non-primary auditory cortex respond selectively to musical structure. However, it is unclear whether this selectivity reflects short-term musical structure at the level of individual notes, and/or the patterning of notes in pitch and time. We used fMRI voxel decomposition to measure the response of music-selective and non-selective auditory neural populations to synthetic music and drum stimuli whose notes were scrambled in pitch and/or time, disrupting musical pattern structure while largely preserving note-level structure. We observed reliably stronger responses to music with intact pitch and temporal pattern structure in both anterior and posterior music-selective regions bilaterally, but little difference between intact and scrambled music in non-selective populations. Further, only music-selective populations showed reliably stronger responses to note-scrambled music compared with non-music sounds. These results suggest that musical structure involving both individual notes and their patterning over time is specifically represented in localized music-selective neural populations of human non-primary auditory cortex.
BibTeX
@misc{boebinger2021music,
  author = {Dana Boebinger and Sam Norman-Haignere and Josh H. McDermott and Nancy Kanwisher},
  title = {{Music-selective cortex is sensitive to structure in both pitch and time}},
  year = {2021},
  doi = {10.1101/2021.12.17.473232},
  howpublished = {bioRxiv},
}
Figure