Personal Audiovisual Aptitude Influences the Interaction Between Landscape and Soundscape Appraisal

kang ki sun, Gemma Sánchez, Bert De Coensel, Timothy Van Renterghem, Durk Talsma, Dick BotteldoorenFrontiers in Psychology 2018 · DOI

Abstract

It has been established that there is an interaction between audition and vision in the appraisal of our living environment, and that this appraisal is influenced by personal factors. Here, we test the hypothesis that audiovisual aptitude influences appraisal of our sonic and visual environment. To measure audiovisual aptitude, an auditory deviant detection experiment was conducted in an ecologically valid and complex context. This experiment allows us to distinguish between accurate and less accurate listeners and identify participants who are easily visually distracted. Two previously conducted laboratory experiments were re-analyzed: one focusing on self-reported noise annoyance in a living room context, and another on the perceived pleasantness of outdoor public spaces. Results indicate that audiovisual aptitude modifies the influence of vegetation visibility on noise annoyance and affects the overall appraisal of walking across a bridge, particularly when visually intrusive noise barriers are present. We conclude that audiovisual aptitude may affect the appraisal of the living environment.

Introduction

Environmental psychology has long recognized that visual context significantly impacts auditory perception. For instance, the presence of greenery is generally thought to mitigate the perceived annoyance of traffic noise. However, this "greenery effect" is not universal; individual responses vary widely, with some people finding the same environment significantly more distressing than others. This research addresses the gap in understanding individual differences by introducing the concept of audiovisual aptitude. This personal trait describes how effectively an individual processes auditory information and the degree to which they are distracted by competing visual stimuli.

Methods and Datasets

The study employed a two-phase methodology to categorize participants and re-evaluate existing environmental appraisal data. Initially, 68 participants (mean age 27.9) underwent a "deviant detection" task designed to measure sensory processing efficiency. The task involved identifying specific "deviant" sounds within complex auditory scenes, both with and without intentionally distracting, incongruent video footage.

The four complex audiovisual scenarios used for the deviant detection task: (a) airport runway, (b) student restaurant, (c) airport terminal, and (d) city park.

The aptitude scores derived from this phase were then applied to data from two previous experiments: a living room simulation evaluating noise annoyance relative to window views (with or without vegetation), and a Virtual Reality (VR) study where participants rated the pleasantness of bridge designs over a highway.

Key Insights and Results

The analysis identified four distinct audiovisual aptitude groups: "Hearing Specialists" (highly accurate and resistant to distraction), "Visual-Dependent" individuals (who rely on visual cues to interpret sound), and those with average or distraction-prone profiles.

The Impact of Sensory Congruence

The study revealed that audiovisual aptitude significantly modifies noise annoyance (p = 0.017). A notable finding was the "Greenery Paradox": while most participants found vegetation helpful, Group 1 (easily distracted) experienced increased annoyance when viewing a quiet green scene paired with loud traffic noise. The sensory mismatch appeared to create additional cognitive stress.

A representative highway scene used in the VR study to evaluate the impact of noise barriers on perceived pleasantness.

Conversely, Group 4 (visual-dependent) preferred seeing the highway. For these individuals, blocking the view of cars with a noise barrier reduced pleasantness because they could no longer visually confirm the source of the noise they were hearing. Head-tracking data further supported these differences, showing that audio-focused individuals spent significantly more time gazing at traffic (p = 0.045) to resolve auditory-visual relationships.

Discussion and Future Directions

The findings suggest that urban planning and architectural design must account for individual sensory processing differences. While noise barriers or greenery are often seen as universal solutions, their effectiveness depends on the "sensory wiring" of the observer. Future research should focus on developing a validated "audiovisual aptitude questionnaire" for easier deployment in planning contexts and investigating the neurological basis of these aptitude groups through brain activity monitoring.

Summary updated

Abstract

It has been established that there is an interaction between audition and vision in the appraisal of our living environment, and that this appraisal is influenced by personal factors. Here, we test the hypothesis that audiovisual aptitude influences appraisal of our sonic and visual environment. To measure audiovisual aptitude, an auditory deviant detection experiment was conducted in an ecologically valid and complex context. This experiment allows us to distinguish between accurate and less accurate listeners. Additionally, it allows to distinguish between participants that are easily visually distracted and those who are not. To do so, two previously conducted laboratory experiments were re-analyzed. The first experiment focuses on self-reported noise annoyance in a living room context, whereas the second experiment focuses on the perceived pleasantness of using outdoor public spaces. In the first experiment, the influence of visibility of vegetation on self-reported noise annoyance was modified by audiovisual aptitude. In the second one, it was found that the overall appraisal of walking across a bridge is influenced by audiovisual aptitude, in particular when a visually intrusive noise barrier is used to reduce highway traffic noise levels. We conclude that audiovisual aptitude may affect the appraisal of the living environment.
BibTeX
@inproceedings{sun2018personal,
  author = {kang ki sun and Gemma Sánchez and Bert De Coensel and Timothy Van Renterghem and Durk Talsma and Dick Botteldooren},
  title = {{Personal Audiovisual Aptitude Influences the Interaction Between Landscape and Soundscape Appraisal}},
  booktitle = {Frontiers in Psychology},
  year = {2018},
  doi = {10.3389/fpsyg.2018.00780},
}
Figure