An ensemble approach for emotion cause detection with event extraction and multi-kernel SVMs

Ruifeng Xu, Jiannan Hu, Qin Lu, Dongyin Wu, Lin GuiTsinghua 2017 · DOI

Abstract

In this paper, we present a new challenging task for emotion analysis: emotion cause extraction (ECE). Rather than simple sentiment classification, we focus on detecting the stimulant or reason behind an emotion. We propose an emotion cause detection method using an event extraction framework, where events are represented via a tree structure. To address the inherent class imbalance in training data, we employ an under-sampling-based bagging algorithm with multi-kernel SVMs. Our approach achieves an F-measure 7.04% higher than state-of-the-art methods.

Introduction: The "Why" Behind Emotions

While traditional sentiment analysis identifies what an emotion is (e.g., happiness, anger), identifying the why—the emotion cause—is crucial for deeper understanding in fields like customer service and social science. Emotion Cause Extraction (ECE) is difficult due to two primary factors: data scarcity and extreme class imbalance, as most clauses in a text do not contain an emotion cause.

Methodology

The proposed framework treats ECE as an event extraction task, moving beyond keyword matching to structural analysis.

Event Tree Representation

Sentences are first parsed into 7-tuple events (Subject, Object, Adverb, Verb, etc.). These are then converted into Event Trees (ET) that capture the hierarchical grammatical structure of the clause. This structural representation allows the model to differentiate between similar word sets used in different syntactic contexts.

Event Tree representation of a clause

Multi-Kernel SVM and Ensemble Learning

To process these trees, we utilize a Support Vector Machine (SVM) with a multiplicative multi-kernel. This kernel combines a Tree Kernel (for syntactic structure) and a Polynomial Kernel (for lexical features). The multiplicative approach captures the interaction between vocabulary and grammar more effectively than simple addition.

To combat the "needle in a haystack" problem where neutral clauses far outnumber cause clauses, we implement an under-sampling-based bagging algorithm.

The under-sampling-based bagging framework for handling imbalanced data

As shown in the framework above, the system repeatedly pairs the limited positive samples with different random subsets of negative samples. Multiple classifiers are trained on these balanced subsets, and their outputs are combined in an ensemble to produce the final result.

Dataset and Observations

Due to the lack of existing resources, we developed a new dataset from 20,000 Chinese news articles, resulting in 2,105 emotional instances. A key observation from this data was that 78% of causes are adjacent to the emotion keyword, and over 93% of causes are centered around verbs, justifying the event-based approach.

Results

The multiplicative multi-kernel bagging approach ($B_{*multi}$) achieved a benchmark F-measure of 0.7456, representing a 7.04% improvement over previous methods. The ensemble strategy proved particularly effective at maintaining high recall without sacrificing precision, demonstrating robustness even with limited training data.

Conclusion

By representing emotion causes as structured events and utilizing an ensemble of multi-kernel SVMs, we significantly improved the state-of-the-art in ECE. Future work will focus on identifying implicit (noun-based) causes and extending the framework to handle long-distance relationships between emotions and their triggers.

Summary updated

Abstract

In this paper, we present a new challenging task for emotion analysis, namely emotion cause extraction. In this task, we focus on the detection of emotion cause a.k.a the reason or the stimulant of an emotion, rather than the regular emotion classification or emotion component extraction. Since there is no open dataset for this task available, we first designed and annotated an emotion cause dataset which follows the scheme of W3C Emotion Markup Language. We then present an emotion cause detection method by using event extraction framework, where a tree structure-based representation method is used to represent the events. Since the distribution of events is imbalanced in the training data, we propose an under-sampling-based bagging algorithm to solve this problem. Even with a limited training set, the proposed approach may still extract sufficient features for analysis by a bagging of multi-kernel based SVMs method. Evaluations show that our approach achieves an F-measure 7.04% higher than the state-of-the-art methods.
BibTeX
@inproceedings{xu2017ensemble,
  author = {Ruifeng Xu and Jiannan Hu and Qin Lu and Dongyin Wu and Lin Gui},
  title = {{An ensemble approach for emotion cause detection with event extraction and multi-kernel SVMs}},
  booktitle = {Tsinghua},
  year = {2017},
  doi = {10.23919/tst.2017.8195347},
}
Figure