Predicting Evacuation Decisions using Representations of Individuals' Pre-Disaster Web Search Behavior

Takahiro Yabe, Kota Tsubouchi, Toru Shimizu, Yoshihide Sekimoto, Satish V. Ukkusuri

TL;DR

Researchers have developed a way to predict whether individuals will evacuate during a disaster by analyzing their anonymous web search behavior in the hours leading up to the event. By using a hierarchical LSTM model to encode search intent, the team achieved 84% accuracy in predicting evacuation decisions during the 2018 Japan Floods, providing a privacy-preserving alternative to tracking sensitive real-time GPS location data.

What Problem Does This Paper Address?

Effective disaster response—like allocating emergency supplies or opening shelters—depends on knowing who will actually evacuate. Traditionally, researchers used post-disaster surveys or real-time mobile phone GPS data to model this behavior.

However, GPS data presents a major hurdle: privacy. Real-time location tracking is increasingly restricted and controversial. Furthermore, location data tells us where someone is, but not necessarily their intent. This paper explores whether web search queries, which are less privacy-sensitive and reflect a user's information-seeking process, can serve as a viable proxy for predicting high-stakes mobility decisions before a disaster alert is even issued.

Methods

The authors propose a framework that transforms raw search queries into "user representations" (mathematical vectors) that capture search intent.

  1. Session-based Query Encoding (SQE): The core of the approach is a character-based 3-layer LSTM (Long Short-Term Memory) network. The model is trained on a massive dataset of search sessions to predict the "next query" in a sequence. This forces the model to learn the latent semantics of search behavior (e.g., understanding that "sandbags" and "river level" are related to flood prep).
  2. Hierarchical Architecture (SMQE): To handle multiple queries from a single user, they used a "Session-based Multiple Query Encoder." This feeds the output of individual query encodings into a second LSTM layer to capture the context of an entire search session.
  3. Feature Selection: They compared different ways to pick which queries to analyze, such as the most "recent" queries versus "high-importance" queries identified via tf-idf (a statistical measure of how unique a word is to a specific context).
  4. Classification: These learned representations were fed into a Random Forest classifier to make the final binary prediction: Will this person evacuate or stay?

Datasets

The study utilized a unique, large-scale dataset from Yahoo Japan Corporation:

  • Web Search Data: 301 million search sessions containing 804 million queries collected between 2015 and 2018.
  • Mobile Phone Location Data (GPS): Used strictly as ground truth for validation. The researchers used anomaly detection on GPS logs to determine if a user actually evacuated (moved to an unusual location like a shelter) during the 2018 Japan Floods.
  • Case Study: The model was tested on users in the Okayama and Hiroshima prefectures during the devastating floods of July 2018.

Key Insights and Ideas

  • Search as a Leading Indicator: People begin searching for disaster-related information (traffic, flood levels, local landmarks) well before official evacuation alerts are issued.
  • The Power of Latent Semantics: Simple "one-hot encoding" (treating words as isolated IDs) fails to capture the nuance of search. The SQE model could distinguish between "Ringo" the fruit and "Ringo Sheena" the singer, and more importantly, it recognized that searches for "manga cafes" or "all-night restaurants" were often proxies for seeking temporary shelter.
  • Granularity Matters: The model was able to pick up on very specific, sparsely searched local place names (like "Suna-gawa" river) that traditional keyword-matching methods would likely ignore, but which are critical for local disaster context.

Key Results

  • High Predictive Accuracy: The best-performing model (using multiple queries selected by tf-idf and the SMQE encoder) achieved 84% accuracy and an AUC of 0.837.
  • Superiority over Baselines: Using the learned SQE representations improved accuracy by over 10% compared to standard one-hot encoding methods.
  • Robustness: Even when post-disaster mobility patterns were "noisy" or unclear (making the ground truth harder to establish), the search-based model remained a strong predictor of intent.

Limitations and Future Work

  • Generalizability: The study focused on a single type of disaster (flooding) in a single country (Japan). The authors acknowledge that search behavior might differ significantly for earthquakes (which have no warning) or in different cultural contexts.
  • Input Constraints: The current model only uses search data. The authors suggest that a hybrid model combining pre-disaster physical mobility patterns with search behavior could be even more accurate.
  • Destination Prediction: While the model predicts if someone will leave, it doesn't yet predict where they will go. Future work aims to use search queries to forecast specific evacuation destinations, which would be a "holy grail" for urban planners.

Summary updated

Abstract

Predicting the evacuation decisions of individuals before the disaster strikes is crucial for planning first response strategies. In addition to the studies on post-disaster analysis of evacuation behavior, there are various works that attempt to predict the evacuation decisions beforehand. Most of these predictive methods, however, require real time location data for calibration, which are becoming much harder to obtain due to the rising privacy concerns. Meanwhile, web search queries of anonymous users have been collected by web companies. Although such data raise less privacy concerns, they have been under-utilized for various applications. In this study, we investigate whether web search data observed prior to the disaster can be used to predict the evacuation decisions. More specifically, we utilize a "session-based query encoder" that learns the representations of each user's web search behavior prior to evacuation. Our proposed approach is empirically tested using web search data collected from users affected by a major flood in Japan. Results are validated using location data collected from mobile phones of the same set of users as ground truth. We show that evacuation decisions can be accurately predicted (84%) using only the users' pre-disaster web search data as input. This study proposes an alternative method for evacuation prediction that does not require highly sensitive location data, which can assist local governments to prepare effective first response strategies.
BibTeX
@inproceedings{yabe2019predicting,
  author = {Takahiro Yabe and Kota Tsubouchi and Toru Shimizu and Yoshihide Sekimoto and Satish V. Ukkusuri},
  title = {{Predicting Evacuation Decisions using Representations of Individuals' Pre-Disaster Web Search Behavior}},
  booktitle = {ACM SIGKDD Conference on Knowledge Discovery and Data Mining},
  year = {2019},
  doi = {10.1145/3292500.3330697},
}

Loading related content...

Figure