Research on Real-time Data Transmission between IoT Gateway and Cloud Platform based on Two-way Communication Technology

David Taniar, Johan Barthélemy, Lin ChengInternational Journal of Smartcare Home 2021 · DOI

TL;DR

This paper presents an IoT system architecture that leverages Socket.IO for real-time, two-way communication between IoT gateways and a cloud platform. By using Node.js and Redis, the system aims to improve data transmission efficiency and system stability compared to traditional protocols like HTTP.

What Problem Does This Paper Address?

The Internet of Things (IoT) relies on seamless data flow between devices, gateways, and cloud platforms. Traditional communication protocols like HTTP, while easy to implement, suffer from a "request-response" limitation that hinders real-time, two-way data transmission. Other protocols like MQTT, though lightweight, can be power-intensive and lack robust encryption. This paper addresses the challenge of achieving efficient, real-time, and reliable two-way communication in IoT systems, particularly for data synchronization between gateways and cloud platforms, while minimizing resource consumption.

Methods

The proposed system utilizes a modular architecture for both the IoT gateway and the cloud platform. Key components include:

  • Node.js: Used as the operating platform for the cloud server, leveraging its event-driven, high-concurrency processing capabilities.
  • Socket.IO: This real-time, two-way communication library, built on WebSockets, is central to the system. It establishes a persistent connection with a single handshake, enabling efficient data exchange and reducing broadband resource usage compared to HTTP.
  • Redis: Employed as a fast-access, in-memory NoSQL database for caching data. This helps manage high concurrency, store authentication details, and improve system efficiency by reducing memory usage.
  • Modular Design: Both the gateway and the cloud platform are broken down into functional modules (e.g., authentication, data processing, synchronization, heartbeat management) to enhance maintainability and scalability.
  • Hierarchical Gateway Architecture: The gateway is structured into an internal module (platform communication, data model synchronization) and a device access module (protocol adaptation, sensing interface) to manage device interaction and data conversion.

Datasets

Not discussed in the paper. The paper focuses on system design and performance testing using simulated data and a controlled environment.

Key Insights and Ideas

  • Socket.IO as a Game Changer for IoT: The paper strongly advocates for Socket.IO's suitability for IoT due to its efficient handshake and persistent connection, which are crucial for real-time data streams and reducing network overhead.
  • Modularization for Scalability and Maintainability: Breaking down the gateway and cloud platform into distinct modules simplifies development, testing, and future upgrades.
  • Redis for High Concurrency: The use of Redis is highlighted as a critical component for handling the high volume and velocity of data typical in IoT environments, preventing bottlenecks.
  • Two-Way Synchronization is Key: The system emphasizes the importance of real-time synchronization of data models between the gateway and the cloud platform, ensuring consistency and enabling prompt updates.
  • Authentication is Paramount: Robust authentication mechanisms are integrated to ensure secure access of devices to the IoT platform.

Key Results

The paper presents performance test results comparing Socket.IO with the HTTP protocol using Jmeter.

  • Improved Data Transmission Efficiency: Socket.IO demonstrated a significantly improved data transmission efficiency.
  • Reduced Packet Loss: The packet loss rate was significantly reduced with Socket.IO (0.015%) compared to HTTP (0.03%).
  • Faster Response Times: While HTTP had a slightly lower average response time (212ms vs. 273ms), the 90% user response time for Socket.IO (544ms) was better than HTTP (603ms), suggesting better performance under load.
  • Enhanced System Stability and Security: The authors claim that the Socket.IO-based system improves overall system stability and security.
  • Simultaneous Updates: The system successfully achieved simultaneous updates of the physical model on the IoT gateway and the virtual model on the IoT cloud platform.

Limitations and Future Work

  • Limited Hardware/Software Scope: The performance tests were conducted with specific hardware (temperature/humidity sensor, camera, Sugon server, PC) and software configurations. The generalizability to other hardware or more complex IoT scenarios might require further validation.
  • No Mention of Real-World Deployment: The paper focuses on system design and testing, with no discussion of deployment in a large-scale, real-world IoT environment.
  • Future Work: The paper implicitly suggests that further optimization of the modular design and exploration of advanced security features could be future directions. The focus on real-time data transmission and synchronization is a continuous area for improvement in IoT systems.

Summary updated

Abstract

protocol, the advantage of Socket.IO is that only a handshake between the client and the server is needed to quickly establish a Socket two-way channel, which can realize the real-time twoway transmission of data and effectively save broadband resources. Thereby improving the system's real-time update efficiency of the data model, and ensuring the stability and reliability of the system. For the system function and performance test, the experimental results show that the use of Socket.IO two-way communication technology can realize the simultaneous update of the physical model of the IoT gateway and the virtual model of the IoT cloud platform, and effectively improve the data transmission efficiency of the system.
BibTeX
@article{taniar2021research,
  author = {David Taniar and Johan Barthélemy and Lin Cheng},
  title = {{Research on Real-time Data Transmission between IoT Gateway and Cloud Platform based on Two-way Communication Technology}},
  journal = {International Journal of Smartcare Home},
  year = {2021},
  doi = {10.21742/26531941.1.1.06},
}
Figure