Abstract
Although the number of smart Internet of Things (IoT) devices has grown in recent years, the public's perception of how effectively these devices secure IoT data has been questioned. Many IoT users do not have a good level of confidence in the security or privacy procedures implemented within IoT smart devices for protecting personal IoT data. Moreover, determining the level of confidence end users have in their smart devices is becoming a major challenge. In this paper, we present a study that focuses on identifying privacy concerns IoT end users have when using IoT smart devices. We investigated multiple smart devices and conducted a survey to identify users’ privacy concerns. Furthermore, we identify five IoT privacy-preserving (IoTPP) control policies that we define and employ in comparing the privacy measures implemented by various popular smart devices. Results from our study show that over 86% of participants are very or extremely concerned about the security and privacy of their personal data when using smart IoT devices such as Google Nest Hub or Amazon Alexa. In addition, our study shows that a significant number of IoT users may not be aware that their personal data is collected, stored or shared by IoT devices.
Introduction
As the Internet of Things (IoT) market scales toward an estimated 41.6 billion devices by 2025, a significant "privacy paradox" has emerged. While adoption rates continue to climb, approximately 98% of IoT traffic remains unencrypted, leaving personal data vulnerable. This research addresses the lack of a standardized framework for evaluating user confidence in IoT security. We aim to understand the specific privacy features users value, their perceptions of popular devices like Amazon Alexa and Google Nest, and their general awareness regarding data collection practices within the home.
Methodology
The study employed a multi-pronged approach to evaluate both technical implementations and user perceptions:
The IoTPP Framework
We defined five fundamental IoT Privacy-Preserving (IoTPP) controls to serve as a benchmark for evaluation:
- Authentication: Identity verification mechanisms.
- Authorization: Control over network connections and permissions.
- Anonymization: The removal of Personally Identifiable Information (PII).
- Denaturation: Modifying data to protect privacy (e.g., blurring faces in video).
- Digital Forgetting: Ensuring the permanent deletion of user data.
Ranking and Analysis
To rank devices, we utilized the Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS), a multi-criteria decision-making method. This was supported by web scraping and manual analysis of official technical documentation for 18 popular IoT devices. Finally, a user survey of 52 participants (ages 18-65) captured perceptions of five specific devices: Amazon Alexa, Google Nest Hub, Ring Doorbell Pro, Sleep Number Smart Bed, and Qardio SmartScale.
Differential Privacy Simulation
To demonstrate a technical solution, the researchers used Markov Processes to simulate 24 hours of sensor data and applied Differential Privacy (DP), showing how noise can protect individual patterns while maintaining data utility.
Results
The analysis revealed a significant gap between user expectations and device performance. No device examined received an average trust score higher than 3 out of 5, with the overall average across all IoTPP categories sitting at a meager 2.70/5 (54%).
Based on the TOPSIS ranking, which synthesizes these metrics into a final score, the Google Nest Hub was perceived as the most trustworthy device among the cohort, while Amazon Alexa was rated the least.
Key findings from the survey include:
- High Concern: 86% of participants reported being "very or extremely concerned" about the security and privacy of their personal data.
- Passive Collection Fears: Over 94% of respondents expressed discomfort with indoor devices collecting video or audio while in "silent mode" or not actively in use.
Discussion
The Awareness Penalty
One of the most striking findings was that educating users increased their anxiety. After learning about the five IoTPP control policies, participants' level of concern rose by 10.2% (from 75.6% to 85.8%). This suggests that as users become more informed about potential protections, they become more aware of the current lack thereof.
Spatial Privacy and Data Hierarchy
Users maintain a clear "indoor/outdoor" privacy boundary. Participants were nearly twice as comfortable with the Ring Doorbell (outdoor) collecting audio/video compared to indoor devices. Furthermore, there is a massive disparity in comfort levels based on data type: while ~71% are comfortable with environmental data (temperature/humidity), only ~19% accept passive video recording.
Conclusion
The study highlights a profound lack of trust in the IoT ecosystem. While vendors often mention "Deletion" in manuals, advanced techniques like Differential Privacy are notably absent from consumer-facing documentation. Future work will involve expanding the sample size and investigating whether demonstrating the efficacy of Differential Privacy can help restore user confidence in these ubiquitous devices.
Summary updated