fNIRS Evidence for Recognizably Different Positive Emotions

Xin Hu, Chu Zhuang, Fei Wang, Yong‐Jin Liu, Chang‐Hwan Im, Dan ZhangFrontiers in Human Neuroscience 2019 · DOI

TL;DR

This study uses fNIRS to show that different positive emotions, like joy, gratitude, and serenity, elicit distinct hemodynamic responses in the brain's frontal cortex. By classifying these brain signals, they achieved above-chance accuracy in distinguishing between groups of positive emotions, paving the way for more nuanced emotion recognition systems.

What Problem Does This Paper Address?

While we intuitively know there are many flavors of happiness, scientific research has often treated "positive emotions" as a monolithic block. This oversimplification hinders our understanding of their distinct adaptive functions and neural underpinnings. Previous neuroimaging studies have hinted at differences using EEG or autonomic measures, but the brain's hemodynamic responses (blood flow changes) to specific positive emotions remained largely unexplored. This paper aims to fill that gap by investigating whether distinct positive emotions can be identified through fNIRS signals, a more portable and less intrusive neuroimaging technique.

Methods

The researchers employed functional near-infrared spectroscopy (fNIRS) to measure hemodynamic responses in the frontal cortex of 13 participants. Participants watched video clips designed to elicit 10 specific positive emotions (joy, gratitude, serenity, interest, hope, pride, amusement, inspiration, awe, and love).

Key methodological aspects include:

  • fNIRS System: A 24-channel fNIRS system was used to record changes in oxy-hemoglobin (HbO) and deoxy-hemoglobin (HbR) concentrations.
  • Stimuli: 30 positive emotion-eliciting video clips, along with neutral and negative control clips, were used.
  • Behavioral Data: After each clip, participants rated their emotional experience on various scales. Multidimensional scaling (MDS) was used to analyze these ratings and identify clusters of similar positive emotions.
  • fNIRS Signal Processing: Standard preprocessing steps were applied, including bandpass filtering and conversion to relative concentration changes using the modified Beer-Lambert law.
  • Classification Analysis: A machine learning approach, specifically Support Vector Machines (SVMs) with a linear kernel, was used for classification. This was performed at the individual participant level. Binary classifications were conducted between:
  • Each positive emotion cluster and negative emotions.
  • Pairs of the three identified positive emotion clusters.
  • Chance levels were determined through permutation tests.

Datasets

The study utilized a custom dataset of 30 positive emotion-eliciting video clips, along with 6 negative and 1 neutral control clip. These clips were selected to evoke 10 specific positive emotions as proposed by Fredrickson (2013). The same stimuli were used as in a previous EEG study by the authors (Hu et al., 2017), with one clip replaced.

Key Insights and Ideas

  • Subjective Grouping of Emotions: Participants' subjective ratings of the elicited emotions naturally clustered into three groups: "playfulness" (amusement, joy, interest), "encouragement" (awe, gratitude, hope, inspiration, pride), and "harmony" (love, serenity). This suggests that even within positive emotions, there are meaningful subjective distinctions.
  • Distinct Hemodynamic Signatures: The study found that these three positive emotion clusters exhibited different patterns of hemodynamic responses in the frontal cortex. This is a crucial finding, indicating that the brain's blood flow patterns are not uniform across all positive emotional states.
  • fNIRS for Emotion Differentiation: The research demonstrates that fNIRS, a portable and cost-effective neuroimaging technique, can be used to differentiate between these distinct positive emotion clusters. This opens doors for real-world applications where portability is key.
  • Above-Chance Classification: The ability to classify brain signals into these emotion clusters with accuracies significantly above chance level provides strong evidence for the neural separability of these emotions.

Key Results

  • Subjective Clusters: Multidimensional scaling of subjective ratings revealed three distinct clusters of positive emotions: "playfulness," "encouragement," and "harmony."
  • Classification Accuracy (HbO):
    • Individual-level binary classification between the three positive emotion clusters achieved an average accuracy of 73.79 ± 11.49%.
  • Specific pairwise accuracies were:
  • Encouragement vs. Playfulness: 77.56 ± 7.39% * Playfulness vs. Harmony: 73.29 ± 11.87% * Encouragement vs. Harmony: 70.51 ± 13.96%
  • Classification Accuracy (HbR):
    • Individual-level binary classification between the three positive emotion clusters achieved an average accuracy of 66.74 ± 13.04%.
  • Positive vs. Negative Classification: For comparison, HbO-based classifications between positive emotion clusters and negative emotions achieved a higher average accuracy of 83.69 ± 9.19%, suggesting positive emotions are more distinct from negative ones than from each other.

Limitations and Future Work

  • Limited Sample Size: The study involved 13 participants, which is a limitation for generalizability and for robust statistical analyses. The authors acknowledge that machine learning approaches are limited in explanatory capacity with small samples.
  • Limited fNIRS Coverage: The 24-channel fNIRS system provided coverage of the frontal cortex. Future work could explore broader brain coverage.
  • Stimulus Set: The 10 positive emotions were chosen based on existing literature, but the authors suggest future studies should include more diverse stimuli (images, sounds) and potentially more standardized databases for emotion elicitation.
  • Feature Extraction: The current analysis focused on basic HbO and HbR changes. More advanced feature extraction methods (e.g., slope, kurtosis) and machine learning techniques could be explored.
  • Mechanism Interpretation: While classification demonstrates separability, understanding the precise neural mechanisms requires further investigation, potentially with larger sample sizes and more detailed analyses.
  • Future Directions: The authors suggest exploring more specific kinds of emotions (e.g., different types of love), conducting comparisons with more specific stimuli, and developing more fine-grained emotion recognition systems for applications like affective computing and brain-computer interfaces.

Summary updated

Abstract

The behavioral differentiation of positive emotions has recently been studied in terms of their discrete adaptive functions or appraising profiles. Some preliminary neurophysiological evidences have been found with electroencephalography (EEG) or autonomic nervous system (ANS) measurements such as heart rate, skin conductance, etc. However, the brain’s hemodynamic responses to different positive emotions remain largely unknown. In the present study, the functional near-infrared spectroscopy (fNIRS) technique was employed. With this tool, we for the first time reported recognizable discrete positive emotions using fNIRS signals. Thirteen participants watched 30 emotional video clips to elicit ten typical kinds of positive emotions (joy, gratitude, serenity, interest, hope, pride, amusement, inspiration, awe, and love), and their frontal neural activities were simultaneously recorded with a 24-channel fNIRS system. The multidimensional scaling analysis of participants’ subjective ratings on these ten positive emotions revealed three distinct clusters, which could be interpreted as “playfulness” for amusement, joy, interest, “encouragement” for awe, gratitude, hope, inspiration, pride, and “harmony” for love, serenity. Hemodynamic responses to these three positive emotion clusters showed distinct patterns, and HbO-based individual-level binary classifications between them achieved an averaged accuracy of 73.79±11.49% (77.56±7.39% for encouragement vs. harmony, 73.29±11.87% for playfulness vs. harmony, 70.51±13.96% for encouragement vs. harmony). Benefited from fNIRS’s high portability, low running cost and the relative robustness against motion and electrical artifacts, our findings provided support for implementing a more fine-grained emotion recognition system with subdivided positive emotion categories.
BibTeX
@inproceedings{hu2019fnirs,
  author = {Xin Hu and Chu Zhuang and Fei Wang and Yong‐Jin Liu and Chang‐Hwan Im and Dan Zhang},
  title = {{fNIRS Evidence for Recognizably Different Positive Emotions}},
  booktitle = {Frontiers in Human Neuroscience},
  year = {2019},
  doi = {10.3389/fnhum.2019.00120},
}
Figure