DeepRIoT: Continuous Integration and Deployment of Robotic-IoT Applications

Meixun Qu, Jie He, Zlatan Tucakovic, Ezio Bartocci, Dejan Nickovic, Haris Isakovic, Radu Grosu

Abstract

We present DeepRIoT, a continuous integration and continuous deployment (CI/CD) based architecture that accelerates the learning and deployment of a Robotic-IoT system trained from deep reinforcement learning (RL). We adopted a multi-stage approach that agilely trains a multi-objective RL controller in the simulator. We then collected traces from the real robot to optimize its plant model, and used transfer learning to adapt the controller to the updated model. We automated our framework through CI/CD pipelines, and finally, with low cost, succeeded in deploying our controller in a real F1tenth car that is able to reach the goal and avoid collision from a virtual car through mixed reality.
BibTeX
@inproceedings{qu2024deepriot,
  author = {Meixun Qu and Jie He and Zlatan Tucakovic and Ezio Bartocci and Dejan Nickovic and Haris Isakovic and Radu Grosu},
  title = {{DeepRIoT: Continuous Integration and Deployment of Robotic-IoT Applications}},
  booktitle = {DAC},
  year = {2024},
  doi = {10.1145/3649329.3658250},
}

Loading related content...

Figure