On the assessment of audiovisual cues to speaker confidence by preteens with typical development (TD) and a-typical development (AD)

Marc Swerts, Cees de BieInterspeech 2012

TL;DR

This study investigates how preteen children with typical development (TD) and autism spectrum disorder (ASD) interpret audiovisual cues to a speaker's confidence. The findings suggest that while both groups can assess confidence, children with PDD-NOS (a subtype of ASD) perform significantly worse, indicating potential challenges in integrating subtle social cues.

What Problem Does This Paper Address?

Understanding social cues is fundamental to effective communication. Previous research has highlighted that individuals with autism spectrum disorder (ASD) often experience difficulties in social functioning, including interpreting facial expressions and integrating nonverbal cues with spoken content. However, the extent and nature of these difficulties are debated, with some studies suggesting they are more nuanced than a general deficit in emotion recognition. A key challenge in this field is the ecological validity of the stimuli used. Much prior research relied on static images or acted emotions, which may not accurately reflect real-world interactions where dynamic, naturalistic audiovisual cues are crucial. This paper addresses this gap by examining how preteens with typical development (TD) and ASD interpret audiovisual cues to speaker confidence, a form of social emotion, using ecologically valid stimuli.

Methods

The study employed a perception experiment where preteen participants watched video clips of speakers responding to quiz questions. These responses were designed to vary in difficulty, eliciting either confident (high-FOK) or uncertain (low-FOK) answers. Participants were asked to rate the speaker's confidence level using a "Feeling-of-Another's-Knowing" (FOAK) score. The experiment utilized a repeated-measures ANOVA to analyze the data, considering factors such as answer type (high-FOK vs. low-FOK), speaker type (adult vs. child), and judge type (TD, Asperger, PDD-NOS).

Datasets

The stimuli used in this study were derived from a previous "feeling-of-knowing" study. These consisted of 60 video responses from adult and 8-year-old child speakers, half of which were categorized as certain (high-FOK) and half as uncertain (low-FOK) based on the speakers' self-reported confidence. No new datasets were introduced.

Key Insights and Ideas

  • Subtle Social Cues and ASD: The study highlights that interpreting subtle social cues, like a speaker's confidence level, can be challenging for individuals with certain forms of ASD, specifically PDD-NOS.
  • Heterogeneity within ASD: The findings underscore the importance of considering the heterogeneity within ASD. Children diagnosed with Asperger showed no significant difference from TD controls, suggesting that deficits are not uniform across all ASD subtypes.
  • Ecological Validity Matters: The use of naturalistic audiovisual stimuli, as opposed to static images or acted emotions, is crucial for understanding real-world social perception, especially for individuals with ASD who may struggle with integrating multimodal information.
  • Developmental Aspect of Confidence Cues: The results align with previous research suggesting that the ability to produce and perceive confidence cues is a social skill that develops over time.

Key Results

  • All groups of preteens were able to estimate a speaker's confidence level based on audiovisual cues.
  • Preteens diagnosed with PDD-NOS performed significantly worse than TD preteens in assessing speaker confidence.
  • Children diagnosed with Asperger did not perform significantly worse than healthy controls.
  • Participants found it harder to judge confidence levels in data from child speakers compared to adult speakers.
  • Preteens with Asperger and PDD-NOS tended to give comparatively higher FOAK scores for low-confidence answers, suggesting they may have a harder time interpreting uncertainty cues.

Limitations and Future Work

The authors acknowledge that the study focused on high-functioning preteens attending specialized schools. Future work is planned to extend this research to other forms of autism and to analyze other pragmatically relevant usages of nonverbal communication. They also suggest exploring the impact of audio-only and video-only formats to understand if simultaneous presentation is particularly confusing for preteens with autism. Investigating whether preteens with more severe forms of autism show different patterns is also a future direction. Finally, the paper suggests exploring the productive skills of preteens with ASD in expressing confidence, not just their perceptive skills.

Summary updated

BibTeX
@inproceedings{swerts2012assessment,
  author = {Marc Swerts and Cees de Bie},
  title = {{On the assessment of audiovisual cues to speaker confidence by preteens with typical development (TD) and a-typical development (AD)}},
  booktitle = {Interspeech},
  year = {2012},
}
Figure