Viewing garden scenes: Interaction between gaze behavior and physiological responses

Congcong Liu, Karl Herrup, Seiko Goto, Bertram E. ShiJournal of Eye Movement Research 2020 · DOI

Abstract

Previous research has shown that exposure to Japanese gardens reduces physiological measures of stress, e.g. heart rate, in both healthy subjects and dementia patients. However, the correlation between subjects' physiological responses and their visual behavior while viewing the garden has not yet been investigated. To address this, we developed a system to collect simultaneous measurements of eye gaze and three physiological indicators of autonomic nervous system activity: electrocardiogram, blood volume pulse, and galvanic skin response. We recorded healthy subjects' physiological/behavioral responses when they viewed two environments (an empty courtyard and a Japanese garden) in two ways (directly or as a projected 2D photograph). Similar to past work, we found that differences in subject's physiological responses to the two environments when viewed directly, but not as a photograph. We also found differences in their behavioral responses. We quantified subject's behavioral responses using several gaze metrics commonly considered to be measures of engagement of focus: average fixation duration, saccade amplitude, spatial entropy and gaze transition entropy. We found decrease in gaze transition entropy, the only metric that accounts for both the spatial and temporal properties of gaze, to have a weak positive correlation with decrease in heart rate. This suggests a relationship between engagement/focus and relaxation. Finally, we found gender differences: females' gaze patterns were more spatially distributed and had higher transition entropy than males.

Introduction

For decades, "healing gardens" have been recognized for their ability to reduce stress and improve clinical outcomes, particularly for patients with dementia or Alzheimer’s disease. Despite this empirical knowledge, the underlying mechanism—specifically the interplay between visual interaction and physiological state—remains poorly understood. Previous studies have often examined heart rate or eye movements in isolation, frequently relying on 2D photographs as proxies for real-world environments. This research addresses whether visual scanning patterns directly influence physiological stress markers and evaluates if 2D projections can effectively replicate the therapeutic benefits of a physical 3D garden.

Methodology

To investigate these questions, a non-intrusive multimodal system was developed to capture synchronized data from 38 healthy participants (27 male, 11 female). The system integrated visual tracking via a Tobii Pro X60 eye tracker and a scene camera with physiological sensing using a ProComp Infiniti system to record electrocardiogram (EKG), blood volume pulse (BVP), and galvanic skin response (GSR).

The multimodal system architecture for synchronized eye tracking and physiological signal acquisition.

A critical component of this setup was a TTL (transistor-transistor logic) device that used an optical sensor to detect infrared pulses from the eye tracker, enabling millisecond-accurate synchronization between gaze data and physiological signals. Participants viewed two distinct environments—a control courtyard with a single tree and a traditional Japanese garden—under two conditions: direct 3D viewing within a controlled tent and 2D projected photographs.

Data analysis moved beyond static heat maps by employing Hidden Markov Models (HMMs) to calculate Gaze Transition Entropy. Unlike standard metrics that focus solely on spatial distribution, transition entropy measures the predictability and efficiency of eye movements between regions of interest.

Results

The study identified Gaze Transition Entropy as a primary indicator of physiological relaxation. A statistically significant positive correlation was found between transition entropy and heart rate change (ΔHR) in both the courtyard (r=0.22) and the garden (r=0.27). Specifically, as gaze became more focused and deliberate (lower entropy), heart rates tended to decrease.

Comparison of gaze behavior between the control courtyard (c) and the Japanese garden (d), illustrating the more focused scanning patterns in the garden environment.

Japanese gardens appeared to act as "gaze guides." While Western gardens often lead the eye to a single focal point, the Japanese garden utilized sub-elements like rocks and pruned trees to lead the viewer indirectly, resulting in significantly lower transition entropy compared to the courtyard (p < 0.005).

Crucially, the physiological benefits—specifically heart rate stabilization—were observed during direct 3D viewing but vanished when subjects viewed 2D projections. Photograph viewing actually increased saccade amplitude and spatial entropy (p < 0.005), suggesting that depth cues are essential for the therapeutic "healing" effect.

Discussion and Conclusion

The findings also revealed significant gender differences in visual behavior. Female participants exhibited more exploratory scanning, characterized by higher spatial entropy and larger saccades compared to males.

While the study provides a novel framework for understanding the visual-physiological link, it is limited by its demographic of healthy young adults. Future research should replicate these findings with elderly populations and dementia patients. Additionally, the potential for Virtual Reality (VR) to bridge the gap between 2D convenience and 3D efficacy warrants further exploration. Ultimately, this work suggests that the deliberate, focused gaze encouraged by Japanese garden design is a key driver of its stress-reducing properties.

Summary updated

Abstract

Previous research has shown that exposure to Japanese gardens reduces physiological measures of stress, e.g. heart rate, in both healthy subjects and dementia patients. However, the correlation between subjects' physiological responses and their visual behavior while viewing the garden has not yet been investigated. To address this, we developed a system to collect simultaneous measurements of eye gaze and three physiological indicators of autonomic nervous system activity: electrocardiogram, blood volume pulse, and galvanic skin response. We recorded healthy subjects' physiological/behavioral responses when they viewed two environments (an empty courtyard and a Japanese garden) in two ways (directly or as a projected 2D photograph). Similar to past work, we found that differences in subject's physiological responses to the two environments when viewed directly, but not as a photograph. We also found differences in their behavioral responses. We quantified subject's behavioral responses using several gaze metrics commonly considered to be measures of engagement of focus: average fixation duration, saccade amplitude, spatial entropy and gaze transition entropy. We found decrease in gaze transition entropy, the only metric that accounts for both the spatial and temporal properties of gaze, to have a weak positive correlation with decrease in heart rate. This suggests a relationship between engagement/focus and relaxation. Finally, we found gender differences: females' gaze patterns were more spatially distributed and had higher transition entropy than males.
BibTeX
@article{liu2020viewing,
  author = {Congcong Liu and Karl Herrup and Seiko Goto and Bertram E. Shi},
  title = {{Viewing garden scenes: Interaction between gaze behavior and physiological responses}},
  journal = {Journal of Eye Movement Research},
  year = {2020},
  doi = {10.16910/jemr.13.1.6},
}
Figure