TL;DR
This paper introduces DeSK, a novel multi-task learning framework that leverages sentiment knowledge to improve depression detection from social media text. By jointly training depression detection and sentiment analysis tasks, DeSK effectively captures the strong correlation between negative emotions and depression, outperforming existing methods.
What Problem Does This Paper Address?
Mental health, particularly depression, has become a growing concern, exacerbated by events like the COVID-19 pandemic. Social media platforms offer a rich source of data for identifying early signs of depression, as individuals often express their emotions and thoughts online. However, existing depression detection methods primarily rely on analyzing textual content alone, neglecting the crucial role of sentiment. This oversight can lead to suboptimal performance. The paper aims to bridge this gap by incorporating external sentiment knowledge into depression detection models.
Methods
The core of DeSK is a multi-task learning framework designed to leverage the synergy between depression detection and sentiment analysis. The framework consists of three main components:
- Input Layer: This layer captures sentiment features by using a "depressed words dictionary" (derived from the NRC Emotion Lexicon) to identify words with a strong negative connotation. These words are then used to create "sentiment marker bits," which are appended to the word embeddings. This enriches the representation of words with their emotional valence.
- Multi-task Learning Framework: This component utilizes multiple feature extraction units, each comprising a multi-head attention layer and a feed-forward neural network. These units share input from the previous layer and are designed to learn task-specific features while benefiting from shared sentiment knowledge. The multi-head attention mechanism helps capture long-range dependencies within the text.
- Gated Attention Layer: This mechanism dynamically selects and weights the outputs from the different feature extraction units. Each task has its own gate, allowing the model to learn how to best combine information from various sources for optimal performance on each task. This helps in capturing complex inter-task relationships.
Datasets
The paper utilizes several datasets for training and evaluation:
- Reddit Depression Dataset (RDD): Collected from subreddits like "r/MentalHealth" and "r/depression," annotated with "Not depressed," "Moderate," and "Severe" labels.
- Tweet Depression Dataset 60k (TDD-60k): A Twitter dataset with four depression labels.
- Tweet Depression Dataset 10k (TDD-7k): Another Twitter dataset with a balanced distribution of positive and negative examples.
- Sentiment Analysis (SA): A general sentiment analysis dataset from Kaggle.
- Weibo Sentiment 100k (WS): A large dataset of Sina Weibo comments tagged with emotion labels.
- Chinese Weibo Depression Dataset (CWDD): A newly compiled dataset from Weibo communities, specifically for depression detection in Chinese social media, with "depressed" and "non-depressed" labels.
The paper also highlights the creation of separate English and Chinese depression word dictionaries, leveraging the NRC Emotion Lexicon and the Dalian University of Technology Chinese Emotion Vocabulary Ontology Database, respectively.
Key Insights and Ideas
- Sentiment as a Direct Clue: The paper strongly posits that negative emotional states are highly correlated with depression, making sentiment analysis a valuable external knowledge source for improving depression detection.
- Multi-task Learning Synergy: By jointly learning depression detection and sentiment analysis, the model can leverage shared representations and improve performance on both tasks, especially when sentiment is a strong indicator of depression.
- Cross-lingual Effectiveness: The DeSK framework demonstrates its ability to perform well on both English and Chinese datasets, suggesting its potential for broader application across different languages.
- Gated Attention for Task Interaction: The gated attention mechanism is crucial for dynamically weighing the contributions of different feature extraction units, allowing the model to better understand and exploit the complex relationships between the depression and sentiment tasks.
Key Results
- DeSK outperforms baseline models like Doc2Vec, BERT, and RoBERTa on the RDD dataset, achieving an accuracy of 62.7% and a Macro F1 score of 60.8%.
- The model shows strong performance across various datasets, including CWDD (96.3% accuracy and Macro F1) and TDD-60k (81.9% accuracy and 80.9% Macro F1).
- Ablation studies confirm the effectiveness of sentiment knowledge sharing and sentiment marker bits, with DeSK achieving higher scores than models that omit these components. For instance, on TDD-60k, DeSK achieved 81.9% accuracy compared to 80.3% when sentiment data was not used as input.
- The gated attention mechanism also contributes to performance gains, with DeSK showing improvements over a model without gating.
Limitations and Future Work
- Dataset Quality: A significant limitation identified is the reliance on self-diagnosis for labeling depression datasets, which can introduce biases and uncertainties.
- Privacy Concerns: The paper notes that privacy concerns prevent the direct correlation of professional psychological insights with social network data, limiting the creation of more comprehensive datasets.
For future work, the authors plan to explore privacy-preserving computing techniques to align social network data with individual entities without compromising privacy. This aims to create more robust and reliable depression detection datasets. They also suggest further research into refining modeling techniques, data selection, and exploring diverse types of social network depression information and sentiment data.
Summary updated