Confusion Effects of Facial Expression Recognition in Patients With Major Depressive Disorder and Healthy Controls

Fan Mo, Jingjin Gu, Ke Zhao, Xiaolan FuFrontiers in Psychology 2021 · DOI

TL;DR

This study investigates how individuals with Major Depressive Disorder (MDD) confuse different facial expressions compared to healthy controls. They found that MDD patients struggle more to distinguish negative emotions like anger and disgust from other expressions, suggesting a specific deficit in processing these social cues. This highlights a potential biomarker for depression and a target for therapeutic interventions.

What Problem Does This Paper Address?

Accurate facial expression recognition is fundamental for effective social interaction. Previous research has consistently shown that individuals with Major Depressive Disorder (MDD) have difficulties in this area. However, much of this research has focused on overall accuracy. This paper delves deeper, exploring how MDD patients misinterpret facial expressions by examining "confusion effects" – specifically, which emotions they tend to confuse with each other. Understanding these specific confusion patterns could reveal more about the underlying cognitive and emotional processing deficits in depression, going beyond a general impairment.

Methods

The researchers employed a two-alternative forced choice (2AFC) task to investigate confusion effects. In each trial, participants were presented with a facial expression and had to choose between two emotion labels. This pairwise comparison approach is crucial for directly measuring the difficulty in distinguishing between specific emotion pairs.

The study examined six basic emotions: happiness, fear, sadness, anger, surprise, and disgust, creating 15 unique emotion pairs for comparison.

To quantify the ability to discriminate between emotions, they used the discrimination sensitivity index (d'), a measure derived from signal detection theory. This metric assesses how well participants can differentiate between two stimuli (in this case, facial expressions). They also analyzed recognition accuracy and reaction time.

Datasets

The study utilized a dataset of 60 images of six basic emotional facial expressions from the Ekman database. These images were posed by 10 human models (4 male, 6 female). This is a standard and widely used dataset in facial expression recognition research. No new datasets were introduced.

Key Insights and Ideas

  • Happiness is the "safe zone": Both MDD patients and healthy controls were generally good at distinguishing happiness from other emotions. This suggests that the unique visual configuration of a happy face makes it relatively easy to identify.
  • Negative emotions are the confusion hotspots for MDD: The most striking finding is that MDD patients showed significantly greater confusion effects for emotion pairs involving negative emotions, particularly anger and disgust, when compared to healthy controls.
  • Anger and disgust are particularly problematic: MDD patients were more prone to confusing anger with other emotions (including positive ones) and also showed greater difficulty distinguishing disgust from other negative emotions like sadness, surprise, and fear.
  • Shared patterns, amplified deficits: While both groups showed similar patterns of confusion (e.g., fear with surprise, anger with disgust), these confusions were more pronounced in the MDD group. This suggests that MDD amplifies existing perceptual or attentional limitations.
  • Beyond accuracy: The role of processing time: MDD patients consistently took longer to recognize all facial expressions, indicating a general slowing of cognitive processing, which may contribute to their increased confusion.

Key Results

  • Recognition Accuracy: Patients with MDD showed significantly lower recognition accuracy for all basic facial expressions except happiness.
  • Discrimination Sensitivity (d'): MDD patients had significantly lower discrimination sensitivity (i.e., greater confusion) in several emotion pairs, including disgust-anger, sadness-anger, fear-anger, sadness-disgust, fear-disgust, surprise-anger, surprise-disgust, surprise-happiness, and happiness-anger.
  • Confusion Matrix: The confusion matrices revealed that fear was more likely to be confused with surprise, and disgust with anger, in both groups, but to a greater extent in the MDD group.
  • Reaction Time: Patients with MDD exhibited significantly longer reaction times for recognizing all facial expressions compared to healthy controls.

Limitations and Future Work

  • Behavioral vs. Neural: The study relied solely on behavioral measures. Future research should explore the neural mechanisms underlying these confusion effects using neuroimaging techniques.
  • Demographic Variables: Some demographic variables, like education level, were not strictly controlled. The small sample size of adolescent patients also limits subgroup comparisons.
  • Neutral Expressions: The study focused only on basic emotional expressions and omitted neutral faces. Future work should include neutral expressions to provide a more comprehensive understanding.
  • Therapeutic Implications: The authors suggest that the strong confusion effect, particularly with negative emotions, could serve as an indicator for depression detection and a target for therapeutic interventions aimed at improving emotion recognition skills.

Summary updated

Abstract

Facial expression recognition plays a crucial role in understanding the emotion of people, as well as in social interaction. Patients with major depressive disorder (MDD) have been repeatedly reported to be impaired in recognizing facial expressions. This study aimed to investigate the confusion effects between two facial expressions that presented different emotions and to compare the difference of confusion effect for each emotion pair between patients with MDD and healthy controls. Participants were asked to judge the emotion category of each facial expression in a two-alternative forced choice paradigm. Six basic emotions (i.e., happiness, fear, sadness, anger, surprise, and disgust) were examined in pairs, resulting in 15 emotion combinations. Results showed that patients with MDD were impaired in the recognition of all basic facial expressions except for the happy expression. Moreover, patients with MDD were more inclined to confuse a negative emotion (i.e., anger and disgust) with another emotion as compared to healthy controls. These findings highlight the importance that patients with MDD show a deficit of sensitivity in distinguishing specific two facial expressions.
BibTeX
@inproceedings{mo2021confusion,
  author = {Fan Mo and Jingjin Gu and Ke Zhao and Xiaolan Fu},
  title = {{Confusion Effects of Facial Expression Recognition in Patients With Major Depressive Disorder and Healthy Controls}},
  booktitle = {Frontiers in Psychology},
  year = {2021},
  doi = {10.3389/fpsyg.2021.703888},
}
Figure