MARVEL: Enabling Mobile Augmented Reality with Low Energy and Low Latency

Kaifei Chen, Tong Li, Hyung-Sin Kim, David E. Culler, Randy H. Katz

Abstract

This paper presents MARVEL, a mobile augmented reality (MAR) system which provides a notation display service with imperceptible latency (<100 ms) and low energy consumption on regular mobile devices. In contrast to conventional MAR systems, which recognize objects using image-based computations performed in the cloud, MARVEL mainly utilizes a mobile device's local inertial sensors for recognizing and tracking multiple objects, while computing local optical flow and offloading images only when necessary. We propose a system architecture which uses local inertial tracking, local optical flow, and visual tracking in the cloud synergistically. On top of that, we investigate how to minimize the overhead for image computation and offloading. We have implemented and deployed a holistic prototype system in a commercial building and evaluate MARVEL's performance. The efficient use of a mobile device's capabilities lowers latency and energy consumption without sacrificing accuracy.
BibTeX
@inproceedings{chen2018marvel,
  author = {Kaifei Chen and Tong Li and Hyung-Sin Kim and David E. Culler and Randy H. Katz},
  title = {{MARVEL: Enabling Mobile Augmented Reality with Low Energy and Low Latency}},
  booktitle = {SenSys},
  year = {2018},
  doi = {10.1145/3274783.3274834},
}

Loading related content...

Figure