The linkage between the perception of neighbourhood and physical activity in Guangzhou, China: using street view imagery with deep learning techniques

Ruoyu Wang, Ye Liu, Yi Lü, Yuan Yuan, Jinbao Zhang, Penghua Liu, Yao YaoInternational Journal of Health Geographics 2019 · DOI

Abstract

People living in perceived safe, lively, and beautiful neighborhoods are more likely to engage in physical activity (PA), whereas those in perceived boring and depressing neighborhoods are less likely to do so. Furthermore, the relationship between neighborhood perception and PA varies across different intensity levels. This study demonstrates that a combination of Tencent Street View imagery and deep learning techniques provides an accurate, scalable tool to automatically assess neighborhood environment exposure in large Chinese cities.

Introduction: Beyond Objective Metrics

Public health research has established that the built environment—such as the presence of parks, sidewalks, and street connectivity—significantly influences physical activity (PA). However, objective features do not tell the whole story. Subjective perceptions, or how a neighborhood "feels," are often more predictive of whether a resident will choose to walk or exercise.

Historically, measuring these perceptions required labor-intensive door-to-door surveys or manual field audits, making city-wide analysis difficult. This study addresses this scalability gap by combining computer vision with street-level imagery to automatically "score" the psychological impact of urban environments and link those scores to health behaviors in Guangzhou, China.

Methodology: Quantifying the "Vibe"

The researchers developed a multi-stage pipeline to bridge the gap between raw pixels and human perception:

  1. Image Segmentation: Using a Fully Convolutional Network (FCN-8s), the team segmented Tencent Street View (TSV) images into over 150 object categories (e.g., trees, sky, roads, buildings) to understand the visual composition of the streets.
  2. Human-Machine Adversarial Scoring: This core innovation involved training a Random Forest model on ratings from 30 volunteers across six perceptual indicators: wealthy, safe, lively, depressing, boring, and beautiful. To refine the model, an "adversarial" approach was used where the model recommended scores and humans corrected them until the error dropped below a specific threshold.
The human-machine adversarial scoring framework used to quantify urban perception.
  1. Multilevel Modeling: AI-generated scores were combined with survey data from 808 residents across 35 neighborhoods. Multilevel linear regressions were used to control for individual factors (age, income, gender) while isolating the effect of neighborhood perception on PA.

Key Insights and Results

The study revealed that environmental perception is a significant driver of physical activity, though its impact varies by intensity:

  • Positive Drivers of Activity: Total PA time was significantly higher in neighborhoods perceived as safe (Coef. 1.495), lively (1.635), and beautiful (1.009).
  • Negative Drivers of Activity: Neighborhoods perceived as depressing (-1.232) and boring (-1.227) saw a marked decrease in resident PA.
  • The Intensity Threshold: While "safety" influenced all levels of activity, indicators like "lively" and "beautiful" were specifically associated with higher-intensity (vigorous) exercise. This suggests that high-quality aesthetics and a sense of vitality are prerequisites for elective, high-effort physical activity.
  • Wealth vs. Activity: Interestingly, the perception of a neighborhood as "wealthy" had no significant linkage to total physical activity, indicating that aesthetic and safety qualities are more important than perceived socioeconomic status.

Conclusion and Future Directions

The high correlation ($r > 0.90$) between human ratings and machine scores proves that deep learning can effectively "digitize" human intuition about urban spaces at scale. While this cross-sectional study shows correlation rather than direct causation, it provides a powerful toolkit for urban planners. Future work may involve longitudinal studies to determine if specific interventions—such as adding greenery to a "boring" street—directly lead to increased physical activity among residents.

Summary updated

Abstract

People living in perceived safe, lively and beautiful neighbourhoods were more likely to engage in PA, and people living in perceived boring and depressing neighbourhoods were less likely to engage in PA. Additionally, the relationship between neighbourhood perception and PA varies across different PA intensity levels. A combination of Tencent Street View imagery and deep learning techniques provides an accurate tool to automatically assess neighbourhood environment exposure for Chinese large cities.
BibTeX
@article{wang2019linkage,
  author = {Ruoyu Wang and Ye Liu and Yi Lü and Yuan Yuan and Jinbao Zhang and Penghua Liu and Yao Yao},
  title = {{The linkage between the perception of neighbourhood and physical activity in Guangzhou, China: using street view imagery with deep learning techniques}},
  journal = {International Journal of Health Geographics},
  year = {2019},
  doi = {10.1186/s12942-019-0182-z},
}
Figure