A Twitter Tale of Three Hurricanes: Harvey, Irma, and Maria

Firoj Alam, Ferda Ofli, Muhammad Imran, Michael AupetitarXiv 2018 · arXiv

TL;DR

This paper presents a comprehensive, multidimensional AI framework for analyzing millions of tweets and images collected during Hurricanes Harvey, Irma, and Maria. By combining Natural Language Processing (NLP) and Computer Vision (CV), the researchers demonstrate how automated systems can filter noise and extract "actionable information" to support humanitarian organizations and emergency responders during large-scale disasters.

What Problem Does This Paper Address?

During natural disasters, social media becomes a vital lifeline for affected individuals to share information and for responders to gain situational awareness. However, the sheer volume and velocity of this data create an "information overload" problem. Manual analysis is impossible, and many automated tools struggle with the noisy, unstructured nature of microblogging content.

The authors tackle the challenge of transforming this chaotic data stream into structured, useful insights. They aim to distinguish between general "situational awareness" (the big picture) and "actionable information" (specific needs like rescue requests or infrastructure damage) across both textual and visual modalities.

Methods

The researchers employed a multi-stage pipeline utilizing both supervised and unsupervised machine learning:

Textual Analysis

  • Preprocessing: Standard noise reduction (removing stop words, URLs, non-ASCII characters).
  • Sentiment Analysis: Used the Stanford sentiment analysis classifier (Recursive Neural Tensor Networks) to track public emotion, collapsing five categories into Positive, Neutral, and Negative.
  • Supervised Classification: A Random Forest classifier was trained to categorize tweets into a humanitarian taxonomy (e.g., "Injured or dead people," "Infrastructure damage," "Donations").
  • Topic Modeling: Latent Dirichlet Allocation (LDA) was used to discover emerging, small-scale incidents that supervised models might miss.
  • Named-Entity Recognition (NER): The Stanford NER toolkit extracted top persons, organizations, and locations to help filter irrelevant viral content (like jokes about comedian Steve Harvey) from actual disaster reports.

Multimedia Analysis

  • Relevancy Filtering: A fine-tuned Deep CNN acted as a "junk filter" to remove irrelevant images (cartoons, ads).
  • De-duplication: Perceptual hashing identified exact or near-duplicate images to reduce redundancy.
  • Damage Assessment: A three-class CNN (severe, mild, none) categorized the remaining unique, relevant images by damage severity.

Datasets

The study utilized data collected via the Twitter streaming API during the 2017 hurricane season:

  • Hurricane Harvey: ~6.7 million tweets (Aug 25 – Sep 5).
  • Hurricane Irma: ~1.2 million tweets (Sep 6 – Sep 19).
  • Hurricane Maria: ~1.1 million tweets (Sep 20 – Oct 3).

For training the text classifier, the authors used a human-labeled dataset comprising Twitter data from over 30 past disasters, including earthquakes and floods.

Daily tweet volume for the three hurricanes, showing significant peaks during the height of the events.

Key Insights and Ideas

  • Sentiment as a Proxy for Neglect: While negative sentiment is expected, the authors noted that spikes in negativity often correlated with slow government response or specific infrastructure failures (e.g., power outages), suggesting sentiment tracking can help prioritize aid.
  • The "Other Useful Information" Catch-all: A significant portion of data falls outside standard categories. Unsupervised LDA proved crucial for identifying specific, unpredictable incidents, such as a mattress store owner opening his doors to evacuees or a paramedic's viral rescue story.
  • Images vs. Text: The study highlights that images often provide critical context that text lacks. For example, a tweet might mention a hurricane generally, while the attached image reveals specific, severe infrastructure damage that requires immediate engineering attention.
  • Noise Filtering via NER: NER is essential for disaster data. During Harvey, "Steve Harvey" was the most mentioned person due to a viral meme. NER allows responders to programmatically ignore thousands of such irrelevant tweets.
Figure 2. Sentiment analysis results: distribution of daily sentiment for Harvey (left), Irma (center), and Maria (right).

Key Results

  • Text Classification: The Random Forest model achieved an overall accuracy of 0.66 and an F1-measure of 0.64. Performance varied by class, with "Injured or dead people" reaching an F1 of 0.86, while "Missing and found people" was much lower (0.31) due to data scarcity.
  • Image Pipeline:
    • The relevancy filter achieved 99% precision and 97% recall.
  • De-duplication reached ~90% precision and recall.
  • Damage assessment accuracy ranged from 76% to 90% depending on the specific disaster.
  • Data Utility: The analysis showed that only about 40% of images shared were actually relevant to the disaster, and only a small fraction (~2.5% to 6.2%) depicted actual damage, underscoring the need for automated filtering.
Temporal distribution of humanitarian categories, illustrating how needs like "Donations" emerge later in the disaster cycle.

Limitations and Future Work

The authors acknowledge that while these AI techniques are powerful, making sense of data in real-time remains a significant hurdle. Scalability is a major concern for processing high-velocity streams during the peak of a crisis.

Future work will focus on developing more efficient computational methods and exploring "human-in-the-loop" systems, where AI handles the heavy lifting of filtering while humans provide high-level verification and training updates to maintain high throughput and accuracy.

Summary updated

Abstract

People increasingly use microblogging platforms such as Twitter during natural disasters and emergencies. Research studies have revealed the usefulness of the data available on Twitter for several disaster response tasks. However, making sense of social media data is a challenging task due to several reasons such as limitations of available tools to analyze high-volume and high-velocity data streams. This work presents an extensive multidimensional analysis of textual and multimedia content from millions of tweets shared on Twitter during the three disaster events. Specifically, we employ various Artificial Intelligence techniques from Natural Language Processing and Computer Vision fields, which exploit different machine learning algorithms to process the data generated during the disaster events. Our study reveals the distributions of various types of useful information that can inform crisis managers and responders as well as facilitate the development of future automated systems for disaster management.
BibTeX
@misc{alam2018twitter,
  author = {Firoj Alam and Ferda Ofli and Muhammad Imran and Michael Aupetit},
  title = {{A Twitter Tale of Three Hurricanes: Harvey, Irma, and Maria}},
  year = {2018},
  eprint = {1805.05144},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1805.05144},
}

Loading related content...

Figure