Social media knows what road it is: quantifying road characteristics with geo-tagged posts

Takuya Nishimura, Kyosuke Nishida, Hiroyuki Toda, Hiroshi Sawada

Introduction

Standard navigation services like Google Maps are excellent at finding the fastest route or avoiding traffic, but they struggle with subjective user desires. If a user wants to walk home via a "scenic" route or find a "fashionable" street for window shopping, current tools offer little help. The challenge lies in scale: manually annotating millions of road segments with subjective labels is impossible. This research proposes a way to turn social media into a distributed sensor network to quantify these "vibes."

The Challenge: Mapping Subjectivity

While people often post about Points of Interest (POIs) like cafes or museums, they rarely post specifically about the "characteristics of the asphalt" between them. This paper bridges the gap between what people say about places (POIs) and the nature of the roads that connect them.

Conceptual diagram of inferring road characteristics from social media posts near POIs.

Methodology

The authors developed a novel two-stage framework to estimate road characteristics:

  1. User-Weight-Oriented LDA (Latent Dirichlet Allocation): Standard topic modeling treats all posts equally. This system introduces a weighting system that prioritizes "active" users—those who post from many different POIs. These "explorers" are more likely to share useful, comparative geographical impressions, helping filter out the noise of home-based social media chatter.
  2. Markov Random Field (MRF) Estimation: To move from POI data to road data, the authors used an MRF model based on two key assumptions:
  3. The Mirror Effect: A road’s characteristics tend to mirror the POIs located along it (e.g., a street with many art galleries is likely "artistic").
  4. Network Consistency: Connected roads of similar size (sourced from OpenStreetMap) are likely to share similar characteristics.

By treating the road network as a graph, the MRF "smooths" the topic data from POIs across the roads, allowing the system to estimate scores for roads that have zero associated social media posts.

Key Results and Data Sparsity

The proposed method significantly outperformed baseline information retrieval methods like BM25. It achieved a statistically significant improvement in nDCG (normalized Discounted Cumulated Gain), improving scores by approximately 0.5 over the baseline. Precision@5 also improved by 0.2.

However, the model faces challenges with data sparsity. As shown in the distribution of responses across different transport modes, there is a significant "long tail" where many subjective descriptors appear very infrequently.

Distribution of response types for pedestrian, bike, and car-related queries, illustrating the long-tail nature of the data.

If a keyword like "moon viewing" isn't present in the "textual sensor" of social media, the model cannot find it. The model was most effective in high-density areas like Shinjuku for popular keywords like "fashionable," where clear POI clusters provided strong signals.

Limitations and Future Work

Beyond data sparsity for niche interests, the authors found that the MRF smoothing can sometimes "bleed" characteristics into the wrong streets in areas where high-end zones abruptly transition into quiet residential zones. Future directions include incorporating geo-tagged photographs and human mobility data to capture non-textual "vibes" and further refine the road scores.

Summary updated

Abstract

Determining traveling routes that provide opportunities to satisfy the various requirements of users in urban areas is still an open problem. This is because it is virtually impossible to manually quantify the characteristics of each street or road and there are few web-based or semantic resources of subjective requirements that describe streets and roads directly. Thus, it is difficult to satisfy all the needs and desires of users that may arise, such as for finding boulevards that are “fashionable” or “beautiful.” The goal of this study is to automatically quantify the characteristics of streets and roads in relation to requirements that can be described using keywords such as “fashionable.” To achieve this goal, we propose a two-stage method that analyzes social media and road networks. First, in estimating the topic distribution (i.e., the characteristics) of each point of interest (POI), our method uses the latent Dirichlet allocation model to analyze geo-tagged texts while considering which users posted useful information for estimating road characteristics. Next, it uses a Markov random field model to estimate the characteristics of each street or road on the basis of those of the POIs and the road networks associated with the POIs. Experiments on real datasets demonstrate that our method achieves statistically significant improvements over baseline methods in terms of ranking quality in information retrieval for 300 roads in three urban areas in Tokyo when given 25 keywords.
BibTeX
@article{nishimura2017social,
  author = {Takuya Nishimura and Kyosuke Nishida and Hiroyuki Toda and Hiroshi Sawada},
  title = {{Social media knows what road it is: quantifying road characteristics with geo-tagged posts}},
  journal = {Soc. Netw. Anal. Min.},
  year = {2017},
  doi = {10.1007/s13278-017-0473-y},
}
Figure