Robots Have Been Seen and Not Heard: Effects of Consequential Sounds on Human-Perception of Robots

Aimee Allen, Tom Drummond, Dana Kulic

Introduction

While engineers often focus on a robot’s visual design or functional AI, the unintentional "consequential sounds" of its motors and joints are a major hurdle for human acceptance. This study demonstrates that these whirrs and clicks significantly increase human anxiety and distraction while decreasing the willingness to share a workspace, even if the robot’s physical appearance is well-liked.

Problem Statement

As robots transition from isolated factory floors to shared public and domestic spaces, Human-Robot Interaction (HRI) research has primarily focused on visual aesthetics, social cues, and intentional speech. However, robots are inherently noisy. These "consequential sounds"—the byproduct of actuators and mechanical movement—are often overlooked during design but are omnipresent during operation.

The authors address a critical gap: the lack of a quantitative understanding of how these unintentional noises affect human perception. If a robot sounds "scary," "annoying," or "distracting," it creates a significant barrier to the long-term cohabitation and adoption of robotic technology.

Methods

The researchers conducted a between-participants study with 182 participants (totaling 858 trials). Participants were split into two groups: a "Sound" condition (viewing videos of robots with their natural operating noise) and a "Control" condition (viewing the same videos, but silent).

The five robotic platforms used in the study: Quadrotor, Unitree Go1, SoftBank Pepper, ClearPath Jackal, and UBTECH Yanshee.

The study utilized a custom-built set of 20-second video stimuli featuring five diverse robotic platforms to ensure broad coverage of form factors and sound profiles, such as rotary buzzing and gear whirring. Participants rated the robots on 11 Likert-scale questions across four thematic dimensions:

  1. Associated-Affect: Feelings of anxiety, agitation, or safety.
  2. Distracted: The robot's perceived ability to interrupt focus.
  3. Colocate: Willingness to share a home, workplace, or public space.
  4. Like: General likability of the robot’s appearance and movement.

The team used least-squares linear regression with deviation coding to isolate the specific effect of sound by comparing it against the visual-only baseline provided by the control group.

Key Insights and Ideas

  • The "Likeability" Paradox: Interestingly, the presence of sound did not significantly impact how much people "liked" the robot's physical appearance or movement. However, it did significantly impact how the robot made them feel. This suggests that a robot can be aesthetically pleasing but still psychologically taxing to be around.
  • Sound as a Stressor: Consequential sounds correlated with higher negative "associated affects." Qualitative feedback revealed that loud or "clanky" noises made participants feel anxious and less able to appreciate the technology.
  • The Quadrotor Outlier: While most robots followed a similar trend, the Quadrotor (drone) showed a borderline interaction effect, suggesting its high-pitched, consistent buzzing might be uniquely detrimental to human comfort compared to ground-based robots.
  • Universal Distraction: Participants found all robots somewhat distracting, but the addition of sound made the "distraction" scores significantly worse across the board.

Key Results

The study confirmed that consequential sounds have a significant negative effect on human perception ($p < .001$ across multiple metrics):

  • Associated Affect: Sound caused a statistically significant drop in positive affect.
  • Distraction: Sound significantly increased the perceived level of distraction.
  • Willingness to Colocate: Participants were significantly less willing to share space with a robot when they could hear it.
  • Regression Coefficients: The "Condition: Consequential Sounds" variable showed negative coefficients across all scales (e.g., $\beta = -0.525$ for Colocation), indicating a consistent downward trend in perception when audio was present.

Limitations and Future Work

The study was conducted via online videos, and the authors acknowledge that in-person interactions—where sound has spatial properties and physical presence—might result in even stronger negative reactions. Future work could explore how ambient office noise or "sound augmentation" (adding pleasant sounds like birdsong to mask motor noise) might mitigate these effects.

Furthermore, the authors suggest that future research should account for individual differences in sound sensitivity, such as misophonia or sensory processing differences associated with neurodiversity. Ultimately, the paper concludes that "quiet" isn't the only goal; engineers should consider the quality of the sound, aiming for lower frequencies or more "organic" acoustic profiles to improve human acceptance.

Summary updated

BibTeX
@article{allen2025robots,
  author = {Aimee Allen and Tom Drummond and Dana Kulic},
  title = {{Robots Have Been Seen and Not Heard: Effects of Consequential Sounds on Human-Perception of Robots}},
  journal = {IEEE Robotics Autom. Lett.},
  year = {2025},
  doi = {10.1109/lra.2025.3546097},
}
Figure