Abstract
It has been established that there is an interaction between audition and vision in the appraisal of our living environment, and that this appraisal is influenced by personal factors. Here, we test the hypothesis that audiovisual aptitude influences appraisal of our sonic and visual environment. To measure audiovisual aptitude, an auditory deviant detection experiment was conducted in an ecologically valid and complex context. This experiment allows us to distinguish between accurate and less accurate listeners and identify participants who are easily visually distracted. Two previously conducted laboratory experiments were re-analyzed: one focusing on self-reported noise annoyance in a living room context, and another on the perceived pleasantness of outdoor public spaces. Results indicate that audiovisual aptitude modifies the influence of vegetation visibility on noise annoyance and affects the overall appraisal of walking across a bridge, particularly when visually intrusive noise barriers are present. We conclude that audiovisual aptitude may affect the appraisal of the living environment.
Introduction
Environmental psychology has long recognized that visual context significantly impacts auditory perception. For instance, the presence of greenery is generally thought to mitigate the perceived annoyance of traffic noise. However, this "greenery effect" is not universal; individual responses vary widely, with some people finding the same environment significantly more distressing than others. This research addresses the gap in understanding individual differences by introducing the concept of audiovisual aptitude. This personal trait describes how effectively an individual processes auditory information and the degree to which they are distracted by competing visual stimuli.
Methods and Datasets
The study employed a two-phase methodology to categorize participants and re-evaluate existing environmental appraisal data. Initially, 68 participants (mean age 27.9) underwent a "deviant detection" task designed to measure sensory processing efficiency. The task involved identifying specific "deviant" sounds within complex auditory scenes, both with and without intentionally distracting, incongruent video footage.
The aptitude scores derived from this phase were then applied to data from two previous experiments: a living room simulation evaluating noise annoyance relative to window views (with or without vegetation), and a Virtual Reality (VR) study where participants rated the pleasantness of bridge designs over a highway.
Key Insights and Results
The analysis identified four distinct audiovisual aptitude groups: "Hearing Specialists" (highly accurate and resistant to distraction), "Visual-Dependent" individuals (who rely on visual cues to interpret sound), and those with average or distraction-prone profiles.
The Impact of Sensory Congruence
The study revealed that audiovisual aptitude significantly modifies noise annoyance (p = 0.017). A notable finding was the "Greenery Paradox": while most participants found vegetation helpful, Group 1 (easily distracted) experienced increased annoyance when viewing a quiet green scene paired with loud traffic noise. The sensory mismatch appeared to create additional cognitive stress.
Conversely, Group 4 (visual-dependent) preferred seeing the highway. For these individuals, blocking the view of cars with a noise barrier reduced pleasantness because they could no longer visually confirm the source of the noise they were hearing. Head-tracking data further supported these differences, showing that audio-focused individuals spent significantly more time gazing at traffic (p = 0.045) to resolve auditory-visual relationships.
Discussion and Future Directions
The findings suggest that urban planning and architectural design must account for individual sensory processing differences. While noise barriers or greenery are often seen as universal solutions, their effectiveness depends on the "sensory wiring" of the observer. Future research should focus on developing a validated "audiovisual aptitude questionnaire" for easier deployment in planning contexts and investigating the neurological basis of these aptitude groups through brain activity monitoring.
Summary updated