TL;DR
This paper explores how families interact with and perceive voice user interfaces (VUIs) with varying levels of social embodiment. Through a "speed dating" methodology, the study reveals that VUIs with higher social embodiment, like social robots, lead to significantly more engagement, trust, and perceived companionship. This work highlights the critical role of social embodiment in designing effective and engaging VUIs for group settings.
What Problem Does This Paper Address?
As voice user interfaces (VUIs) like smart speakers and social robots become increasingly integrated into our homes, understanding how they function within multi-user environments, particularly families, is crucial. While VUIs leverage social cues to engage users, the impact of their "social embodiment" – the degree to which they appear human-like and socially interactive – on group dynamics and individual perceptions remains an open question. Existing research often focuses on individual interactions or specific VUI features, leaving a gap in understanding how families as a unit perceive and interact with VUIs that vary in their social presence and expressiveness. This paper aims to fill this gap by systematically investigating family interactions with different types of VUIs.
Methods
The researchers employed a novel "speed dating" elicitation study format, adapted from previous work, to simulate first encounters between families and various VUIs. This approach allowed for direct comparison of multiple VUIs within a single session. Three distinct studies were conducted, each involving families interacting with a set of commercially available VUIs with differing levels of social embodiment.
- Study 1: Families interacted with Jibo (highly embodied social robot), Amazon Echo, and Google Home (less embodied smart speakers).
- Study 2: The same VUIs were used, but the Amazon Echo's wake word was changed to "Amazon" to emphasize branding, exploring the impact of manufacturer affiliation.
- Study 3: Jibo was compared with Amazon Echo Show and Amazon Echo Spot, which were modified to create a spectrum of social embodiment, including a rotating flag on the Echo Spot to simulate mechanical movement.
For each study, families participated in three activities:
- Agent Exploration Activity: Families completed a directive sheet with information, entertainment, and interpersonal tasks for each VUI, followed by free play.
- Perceived Personality Activity: Participants used stickers to rate agents on personality traits adapted from the Big Five personality test.
- User Experience Ranking Activity: Participants used chips to rank agents on dimensions like trust, companionship, competence, and emotional engagement.
Data collection involved video recording interactions, and behavioral analysis was conducted using a coding scheme for reciprocal behaviors.
Datasets
The paper does not describe the use of pre-existing datasets for training or evaluation. Instead, it introduces a novel experimental setup and data collection methodology through its three elicitation studies. The data generated from these studies, involving 34 families (92 participants), forms the basis for the findings.
Key Insights and Ideas
- Social Embodiment is Key: The most striking and consistent finding across all three studies is that VUIs with higher social embodiment (like the Jibo robot) are interacted with significantly more and are perceived more positively across various metrics.
- Beyond Functionality: While all VUIs provided sufficient transactional information, the social robot was perceived as more competent, suggesting that social embodiment enhances perceived capability.
- Personality Matters: The personality of the VUI significantly influences user perception and engagement. More complex, outgoing, and "warm" personalities were associated with higher engagement and positive perceptions.
- Branding and Naming Influence: Study 2 showed that even subtle changes like emphasizing branding through wake words can influence perceptions, though the impact of social embodiment remained dominant.
- Family Dynamics Emerge: The study observed that interactions with more embodied VUIs not only increased engagement with the VUI but also stimulated more interaction between family members around the VUI.
Key Results
- Interaction Frequency: Participants interacted significantly more with Jibo (the social robot) than with smart speakers like Amazon Echo or Google Home across all studies (p < 0.001).
- Perceived Trust, Companionship, Competence, and Emotional Engagement: Jibo consistently received higher ratings for trust, companionship, competence, and emotional engagement compared to the smart speakers in all studies. For example, in Study 1, Jibo was perceived as significantly more trustworthy (p < 0.0001) and a better companion (p < 0.0001) than Alexa or Google Home.
- Personality Traits: Jibo was perceived as more "outgoing and engages me lots," "sympathetic and warm," and "anxiously wanting to engage me" compared to the smart speakers.
- Behavioral Analysis: Participants exhibited more reciprocal behaviors (smiling, laughing, complimenting) with Jibo, and these interactions also fostered more human-human behaviors like private conversations and glancing at others among family members.
Limitations and Future Work
- Limited Exposure: The studies focused on initial encounters ("speed dating"), and the long-term effects of VUI embodiment and interaction patterns remain to be explored. Future work should investigate how these perceptions and interactions persist over time.
- Cultural Generalizability: The studies were conducted in the United States, and findings may not directly apply to other cultural contexts.
- Lab Setting: The research was conducted in a lab environment. Future studies could explore these interactions in real-world settings.
- Group Effect: The statistical analysis did not fully account for the "group effect" where participants' behaviors might influence each other. Future work could employ mixed-effects models to address this.
- Ethical Considerations: The persuasive nature of highly embodied and personable VUIs raises ethical concerns that warrant further investigation, particularly regarding transparency and potential manipulation.
- Design Implications: The authors suggest that future VUI designs should leverage social embodiment, personality, and non-verbal cues to foster deeper engagement and more natural interactions, especially in family settings. They also emphasize the importance of considering how branding and naming conventions impact user perception.
Summary updated