Detecting Neighborhood Gentrification at Scale via Street Views and POIs (Student Abstract)

Tianyuan HuangAAAI 2022 · DOI

Introduction

Gentrification—the process of urban renewal and reinvestment—is a significant driver of urban inequality, often leading to the displacement of lower-income residents. Traditional methods for detecting gentrification rely heavily on U.S. Census Bureau demographic data. However, these datasets are often infrequent ("laggy") and lack the spatial granularity required for real-time urban planning. This research introduces a scalable, data-driven framework that utilizes multi-modal digital footprints—specifically Google Street View (GSV) images and Point-of-Interest (POI) data—to detect and predict gentrification stages.

Methodology

The proposed framework represents neighborhoods as "containers" of spatial-temporal data, utilizing a multi-stage pipeline to extract meaningful features.

Street View Segmentation and Change Detection

The researchers employed a pretrained semantic segmentation model to categorize street view images into 65 distinct classes, such as buildings, roads, and vegetation. By comparing the average pixel counts of these classes between 2007 and 2021, the model generates a "change vector" that quantifies the physical evolution of the built environment.

Self-supervised Representation Learning

To overcome the bottleneck of manual labeling, the study adopts a self-supervised contrastive learning approach. Grounded in Tobler’s First Law of Geography—which posits that near things are more related than distant things—the model is trained to ensure that geographically proximal images share similar embeddings, while distant ones diverge.

The Neighborhood Representation Vector u captures multi-modal spatial-temporal data.

POI Integration and Classification

The physical data from GSV is augmented with textual POI data (e.g., "Starbucks," "local grocery") via word embeddings. A second contrastive learning layer aligns these POI embeddings with the neighborhood embeddings. These combined multi-modal vectors are then processed by a Random Forest classifier to determine the neighborhood's gentrification stage.

Visualizing temporal changes in neighborhood street views from 2008 to 2016, showing physical indicators of reinvestment.

Data Sources

The study utilized two primary datasets:

  • Google Static Street View API: Approximately 3 million images were sampled across 1,198 census tracts in the San Francisco Bay Area, covering the period from 2007 to 2021.
  • Data Axle’s ReferenceUSA: This historical business dataset provided the POI information necessary to characterize the commercial "vibe" and functional shifts within neighborhoods.

Results and Insights

The core finding of this research is that gentrification possesses a distinct visual and functional signature that can be quantified. Physical changes, such as new building materials or increased greenery, serve as reliable proxies for socio-economic shifts.

The model was evaluated against a six-level gentrification scale (ranging from "intense" to "no gentrification"). Using 5-fold cross-validation, the framework achieved 60% accuracy. Crucially, because the pipeline relies on automated processing and globally available APIs, it is highly scalable compared to previous manual labeling efforts.

Conclusion and Future Work

While the initial results in the San Francisco Bay Area are promising, the researchers acknowledge that urban morphology varies significantly across different regions (e.g., New York vs. Houston). Future work will focus on testing the model's generalizability across diverse metropolitan areas. Additionally, moving toward an end-to-end deep learning architecture could further refine feature extraction and improve predictive performance. Finally, increasing the interpretability of the "black box" model will be essential for providing actionable insights to urban planners and policymakers.

Summary updated

BibTeX
@inproceedings{huang2022detecting,
  author = {Tianyuan Huang},
  title = {{Detecting Neighborhood Gentrification at Scale via Street Views and POIs (Student Abstract)}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2022},
  doi = {10.1609/aaai.v36i11.21621},
}
Figure