Introduction
In the wake of global crises such as the COVID-19 pandemic, monitoring public sentiment has become a critical task for policymakers and mental health professionals. However, identifying that a population is experiencing "fear" or "anger" is only the first step; understanding the why—the specific events or appraisals known as emotion triggers—is essential for effective intervention.
While current state-of-the-art approaches utilize abstractive summarization to generate these explanations, such models require massive amounts of expert-annotated data. This paper introduces Emotion-Aware PageRank (EAP), a fully unsupervised extractive summarization method. By selecting the most relevant existing sentences from a post rather than generating new ones, EAP provides a scalable and immediate solution for identifying triggers in new domains without the need for expensive human labeling.
Methodology: Emotion-Aware PageRank (EAP)
The EAP algorithm builds upon the classic PageRank framework, traditionally used to rank web pages, and adapts it for the nuances of emotional text through two primary mechanisms:
- Emotion Decomposition (Relevance Weighting): To ensure the model prioritizes emotional context, EAP incorporates the NRC Emotion Intensity Lexicon. The graph is biased so that sentences containing high-intensity words related to a specific target emotion (e.g., "scared" for fear or "threat" for anger) receive higher weights. The model runs a separate biased PageRank for each of the seven target emotions.
- Semantic Encoding (Meaning Score): Traditional graph-based methods often rely on simple word overlaps, which can miss the deeper meaning of a sentence. EAP integrates Sentence-BERT (S-BERT) to calculate semantic similarity between candidate sentences. This ensures that the extracted sentences are not just keyword-heavy, but are contextually central to the post's emotional narrative.
The final importance score for any given sentence is the product of its graph-based relevance and its semantic meaning score. Sentences exceeding a specific threshold are extracted as the final triggers.
The COVIDET-EXT Dataset
To evaluate the model, the researchers developed COVIDET-EXT, a new benchmark for extractive emotion trigger detection. The dataset consists of 1,883 Reddit posts from the r/COVID19_support community. It augments the original COVIDET dataset by adding 6,741 manually highlighted extractive trigger sentences across seven fine-grained emotions: anger, anticipation, joy, trust, fear, sadness, and disgust.
Key Insights and Results
Performance Benchmarks
EAP demonstrates significant improvements over existing unsupervised baselines such as TextRank and PacSum. It achieved an average ROUGE-L score of 0.325, representing a 2.7% improvement over the strongest baseline. Perhaps most significantly, this unsupervised method performed nearly as well as a supervised BERT classifier, trailing by less than 1% in ROUGE-L despite having no access to labeled training data.
Linguistic and Structural Patterns
The research revealed several fascinating patterns in how people express emotion on social media:
- Trigger Location: Unlike news reporting, where the most important information is usually at the beginning (the "lead"), emotional triggers in social media posts tend to cluster toward the end of the text as the author builds toward their primary concern.
- Pronoun Correlation: There is a distinct divide in pronoun usage. Negative emotions (sadness, fear) are strongly correlated with first-person singular pronouns (I, me, my), suggesting a focus on personal suffering. Positive emotions (joy, trust) correlate more with second-person pronouns (you, your), indicating higher levels of social engagement.
- Explicitness vs. Implicitness: The researchers found that sadness is often the most "explicit" emotion, utilizing clear, high-intensity keywords. In contrast, anger is frequently the most "implicit," often expressed through context and situational descriptions rather than specific angry lexemes.
Conclusion and Future Directions
Emotion-Aware PageRank offers a robust, unsupervised alternative to data-heavy summarization models. By combining graph-based ranking with deep semantic embeddings and emotion lexicons, it successfully identifies the "why" behind public sentiment. While currently limited by its dependency on English-language lexicons and standard transformer token limits, EAP sets the stage for future hybrid models that may bridge the gap between extractive and abstractive summarization in an unsupervised manner.
Summary updated