Children Facial Expression Production: Influence of Age, Gender, Emotion Subtype, Elicitation Condition and Culture

Charline Grossard, Laurence Chaby, Stéphanie Hun, Hugues Pellerin, Jérémy Bourgeois, Arnaud Dapogny, Huaxiong Ding, Sylvie Serret, Pierre Foulon, Mohamed Chétouani, Liming Chen, Kévin Bailly, Ouriel Grynszpan, David CohenFrontiers in Psychology 2018 · DOI

TL;DR

This study investigated how children aged 6-11 produce facial expressions (FEs), finding that performance improves with age, positive emotions are easier to express than negative ones, and producing FEs "on request" is more effective than imitating an avatar. These insights are crucial for understanding typical FE development and for creating tools to help children with conditions like Autism Spectrum Disorder (ASD).

What Problem Does This Paper Address?

While recognizing facial expressions is well-studied, the production of these expressions in children, especially typical development, remains less understood. This is a critical gap because the ability to express emotions is fundamental for social interaction and emotional regulation. Furthermore, difficulties in FE production are a hallmark of conditions like ASD, making it essential to establish a baseline for typical development to inform interventions. The paper aims to clarify how factors like age, gender, emotion type, how the expression is elicited (imitation vs. on request), and even geographical location influence children's ability to produce recognizable and credible facial expressions.

Methods

The researchers collected video data of 157 children (aged 6-11) producing four emotions: joy, anger, sadness, and neutral. They employed two primary elicitation tasks:

  1. Imitation Task: Children imitated facial and vocal expressions of a virtual avatar presented on screen. This was done in both visual-only and audiovisual modalities.
  2. On Request Task: Children were verbally asked to produce specific emotions (visual or audiovisual).

The collected videos were then meticulously annotated by three trained judges. They used a rating scale from 0 to 10, assessing both the recognition and credibility of the produced FE. A score of 5 indicated recognition without credibility, while 10 represented a recognized and credible expression. Statistical analysis, primarily using Generalized Linear Mixed Models (GLMM), was employed to determine the influence of various factors on FE production quality.

Datasets

The study generated a novel dataset of 3875 short video clips of children's facial expressions. This dataset, collected from children in Nice and Paris, France, is intended to be used for training algorithms to recognize FEs in real-time, particularly for applications like serious games designed to help children with ASD. The paper does not explicitly compare its dataset to existing ones but highlights the scarcity of such child-focused FE production datasets.

Key Insights and Ideas

  • Developmental Trajectory: FE production isn't static; it's a skill that clearly improves with age, suggesting a continuous learning process throughout childhood.
  • Emotional Valence Matters: Children find it easier to produce positive emotions (like joy) and neutral expressions compared to negative ones (anger, sadness). This aligns with the idea that positive expressions might be more socially reinforced or less cognitively demanding.
  • "Show, Don't Tell" is Better: Producing FEs "on request" yielded better results than imitating an avatar. This suggests that actively recalling and generating an emotion internally, rather than just mimicking a visual cue, leads to more authentic and recognizable expressions.
  • Regional Nuances: Children from the French Riviera (Nice) performed better than those from Paris. This hints at subtle cultural or environmental influences on emotional expression, even within the same country.
  • Imitation Pitfalls: While imitation seems intuitive, it might lead children to focus on superficial mimicry rather than genuine emotional expression, potentially hindering the production of credible FEs.

Key Results

  • Age: FE production quality significantly increased with age, with each additional year of age improving the score by a factor of 1.14.
  • Elicitation Task: Producing FEs "on request" resulted in significantly higher scores (factor of 1.71) compared to imitation.
  • Emotion Subtype: Neutral expressions were the easiest to produce (factor of 5.39 compared to sadness), followed by happiness (factor of 4.20) and anger (factor of 2.48), with sadness being the most challenging.
  • Location: Children from Nice scored higher than those from Paris (factor of 1.33).
  • Gender: While overall gender didn't show a significant main effect, interactions were found. Boys were better at producing anger than girls (factor of 1.68). Interactions between age, gender, and emotion also revealed that girls' ability to produce joy increased with age more than boys', while boys' production of neutral expressions decreased with age more than girls'.

Limitations and Future Work

The authors acknowledge several limitations:

  • Avatar vs. Real Models: The use of avatars for imitation might have influenced results, as children might have focused on mimicking the avatar's features rather than the emotion itself. Future work could explore using real human models.
  • Modality: The study found no significant effect of adding sound (audiovisual modality) to facial expressions. This might be because judges prioritized facial cues for recognition and algorithm training, potentially overlooking the contribution of sound.
  • Coding Subjectivity: While inter-rater reliability was high, the coding of "credibility" is inherently subjective.
  • Cultural Specificity: The study was conducted in France, and future research should explore these factors across more diverse cultures.

The researchers plan to use this dataset to train algorithms for FE recognition, particularly for a serious game aimed at children with ASD. They also intend to compare the FE production of children with ASD to the typical development data collected in this study.

Summary updated

Abstract

The production of facial expressions (FEs) is an important skill that allows children to share and adapt emotions with their relatives and peers during social interactions. These skills are impaired in children with Autism Spectrum Disorder. However, the way in which typical children develop and master their production of FEs has still not been clearly assessed. This study aimed to explore factors that could influence the production of FEs in childhood such as age, gender, emotion subtype (sadness, anger, joy, and neutral), elicitation task (on request, imitation), area of recruitment (French Riviera and Parisian) and emotion multimodality. A total of one hundred fifty-seven children aged 6-11 years were enrolled in Nice and Paris, France. We asked them to produce FEs in two different tasks: imitation with an avatar model and production on request without a model. Results from a multivariate analysis revealed that: (1) children performed better with age. (2) Positive emotions were easier to produce than negative emotions. (3) Children produced better FE on request (as opposed to imitation); and (4) Riviera children performed better than Parisian children suggesting regional influences on emotion production. We conclude that facial emotion production is a complex developmental process influenced by several factors that needs to be acknowledged in future research.
BibTeX
@inproceedings{grossard2018children,
  author = {Charline Grossard and Laurence Chaby and Stéphanie Hun and Hugues Pellerin and Jérémy Bourgeois and Arnaud Dapogny and Huaxiong Ding and Sylvie Serret and Pierre Foulon and Mohamed Chétouani and Liming Chen and Kévin Bailly and Ouriel Grynszpan and David Cohen},
  title = {{Children Facial Expression Production: Influence of Age, Gender, Emotion Subtype, Elicitation Condition and Culture}},
  booktitle = {Frontiers in Psychology},
  year = {2018},
  doi = {10.3389/fpsyg.2018.00446},
}
Figure