The Science of Harmony: A Psychophysical Basis for Perceptual Tensions and Resolutions in Music

Paul Chan, Minghui Dong, Haizhou LiResearch 2019 · DOI

TL;DR

This paper proposes a unified psychophysical theory of musical harmony, explaining both stationary chord tension and transitional chord progression using interharmonic and subharmonic modulations. By quantifying these modulations, the authors provide a scientific basis for why certain musical combinations sound pleasing or dissonant, and how progressions create tension and resolution.

What Problem Does This Paper Address?

Musical harmony, the pleasing effect of combining notes, has long been a puzzle, blending aesthetics with complex physics and mathematics. Existing theories fall into two main camps: those based on rational frequency ratios (like Pythagoras) and those focusing on acoustic phenomena like beating frequencies (Helmholtz). While these explain some aspects of consonance and dissonance, they struggle with transitional harmony (chord progressions) and have discrepancies with empirical observations. This paper aims to bridge these gaps by developing a single, unified theory that can explain both stationary harmony (chord sonorities) and transitional harmony (chord progressions) from a psychophysical perspective.

Methods

The authors introduce a novel framework based on interharmonic and subharmonic modulations.

  • Interharmonic modulations describe the interplay of adjacent sinusoidal components within and across notes in a chord, relating to Helmholtz's beating frequencies and contributing to perceived consonance and dissonance based on their frequency difference ($\Delta f$).
  • Subharmonic modulations are proposed to explain phenomena not covered by interharmonic modulations, particularly those involving more distant sinusoidal components. This involves "subharmonic wave formation" and "subharmonic wave deformation," which are analyzed in the temporal domain.
  • Stationary subharmonic tension ($\Delta t$) is quantified by the difference between the largest and smallest subharmonic periods within a chord, reflecting perceived tension.
  • Transitional subharmonic tension ($\Delta \Delta t$) quantifies the degree of convergence or divergence of subharmonic trajectories between successive chords, explaining tension release (resolution) and tension buildup (complication).

The theory mathematically bridges the Pythagorean and Helmholtz schools by showing how they can be derived from a single framework.

Datasets

The paper utilizes existing datasets for validation:

  • Chord-use statistics from Palestrina's corpus: Collected by Tymoczko, this dataset of 11,000 chord transitions is used to correlate the proposed theory's predictions with historical musical practice.
  • Consonance rankings from previous studies: Data from Stolzenburg and Schwartz et al. are used to compare the theory's predictions for dyads and triads against established perceptual rankings.

Key Insights and Ideas

  • Unified Theory: The core insight is that both interharmonic and subharmonic modulations are crucial for understanding harmony, offering a unified psychophysical basis that reconciles seemingly disparate historical theories.
  • Subharmonics as the Key: Subharmonic modulations are presented as the primary mechanism for explaining both stationary tension and transitional resolution, offering a novel way to quantify these abstract musical concepts.
  • Quantifying Tension and Resolution: The paper introduces concrete mathematical measures ($\Delta t$ for stationary tension, $\Delta \Delta t$ for transitional tension release/buildup) that directly map to perceptual experiences.
  • Explaining Musical Phenomena: The theory provides explanations for why a chord might sound good in one context but not another, and how a dissonant chord can lead to a satisfying resolution.
  • Bridging Theory and Practice: The framework successfully links acoustic phenomena to music theory concepts and empirical perception data.

Key Results

  • Strong Correlations: The proposed model shows strong positive correlations with existing consonance rankings for dyads (r=0.922) and triads (r=0.907) in stationary harmony.
  • Transitional Harmony Validation: For transitional harmony, the model achieves very high correlations with Palestrina's chord use statistics, particularly for resolutions (r=0.996) and general transitions (r=0.970).
  • Explaining Fundamental Questions: The theory successfully addresses five fundamental questions of psychoacoustic harmony, including why harmony's effect is greater than the sum of its parts and the nature of tension and resolution.
  • Visualizing Harmony: The paper introduces "subharmonic plots" that visually represent harmonic processes, making abstract concepts like tension and resolution tangible.

Limitations and Future Work

  • Computational Complexity: While the theory is comprehensive, programmatic analysis for large datasets can be computationally intensive, requiring careful selection of parameters (e.g., N, c).
  • Subjectivity in Perception: While the theory provides a framework, individual perception of harmony can vary, and the paper acknowledges this by presenting example responses rather than universal ones.
  • Future Work: The authors suggest further exploration of the theory's application to more complex musical structures, different tuning systems, and a deeper investigation into the role of melody in conjunction with harmony. The paper also hints at the potential for this framework to inform music composition and analysis tools.

Summary updated

Abstract

This paper attempts to establish a psychophysical basis for both stationary (tension in chord sonorities) and transitional (resolution in chord progressions) harmony. Harmony studies the phenomenon of combining notes in music to produce a pleasing effect greater than the sum of its parts. Being both aesthetic and mathematical in nature, it has baffled some of the brightest minds in physics and mathematics for centuries. With stationary harmony acoustics, traditional theories explaining consonances and dissonances that have been widely accepted are centred around two schools: rational relationships (commonly credited to Pythagoras) and Helmholtz's beating frequencies. The first is more of an attribution than a psychoacoustic explanation while electrophysiological (amongst other) discrepancies with the second still remain disputed. Transitional harmony, on the other hand, is a more complex problem that has remained largely elusive to acoustic science even today. In order to address both stationary and transitional harmony, we first propose the notion of interharmonic and subharmonic modulations to address the summation of adjacent and distant sinusoids in a chord. Based on this, earlier parts of this paper then bridges the two schools and shows how they stem from a single equation. Later parts of the paper focuses on subharmonic modulations to explain aspects of harmony that interharmonic modulations cannot. Introducing the concept of stationary and transitional subharmonic tensions, we show how it can explain perceptual concepts such as tension in stationary harmony and resolution in transitional harmony, by which we also address the five fundamental questions of psychoacoustic harmony such as why the pleasing effect of harmony is greater than that of the sum of its parts. Finally, strong correlations with traditional music theory and perception statistics affirm our theory with stationary and transitional harmony.
BibTeX
@inproceedings{chan2019science,
  author = {Paul Chan and Minghui Dong and Haizhou Li},
  title = {{The Science of Harmony: A Psychophysical Basis for Perceptual Tensions and Resolutions in Music}},
  booktitle = {Research},
  year = {2019},
  doi = {10.34133/2019/2369041},
}
Figure