Optimal sensing policies for smartphones in hybrid networks: A POMDP approach

Mohammed Raiss El-Fenni, Rachid El Azouzi, Daniel Sadoc Menasché, Yuedong Xu

Introduction

Modern smartphones face a persistent "always-on" dilemma: maintaining real-time updates for social media and notifications while managing limited battery life and data costs. In hybrid network environments, devices can choose between low-cost, patchy WiFi and expensive, ubiquitous 3G. However, determining WiFi availability requires "sensing"—powering up the radio—which itself consumes energy. This paper addresses this trade-off by modeling the decision-making process as a Partially Observed Markov Decision Process (POMDP) to derive optimal sensing policies.

Methodology: The POMDP Framework

The authors model the system state using two primary variables: the age of information (time since the last update) and the hidden availability of WiFi. Because WiFi status is unobserved until sensed, the device maintains a belief state ($\lambda$), representing the probability that an access point (AP) is currently available.

At each time slot, the device selects one of three actions:

  1. Wait: Remain idle to conserve power, allowing information age to increase.
  2. Sense & WiFi: Activate the radio; use WiFi if detected, otherwise continue waiting.
  3. Sense & Hybrid: Attempt to use WiFi; if unavailable, immediately utilize 3G to ensure a fresh update.

The authors mathematically prove the monotonicity of the value function, enabling the derivation of a simple, threshold-based optimal policy.

Empirical Foundation: DieselNet Trace Analysis

To validate the Markovian assumption of WiFi availability, the authors analyzed the UMass Amherst DieselNet dataset, which tracks WiFi contact opportunities for mobile buses.

CDFs of contact probabilities from DieselNet traces, demonstrating temporal correlation in WiFi availability.

The analysis revealed that WiFi availability is significantly temporally correlated. If a contact was recently established, the probability of a subsequent contact is higher than average. This correlation justifies the use of a belief state to predict future availability and optimize sensing intervals.

Key Results and Policy Insights

The derived optimal policy is characterized by a belief threshold $\lambda^*$. If the probability of finding WiFi falls below this threshold, the device should remain idle. As the information age increases, the utility of a fresh update grows, eventually outweighing the high cost of 3G.

Optimal sensing policy for Scenario 3, illustrating the transition between waiting (Action 0), sensing for WiFi (Action 1), and using hybrid 3G (Action 2) based on belief and age.

In Scenario 3 (shown above), where 3G costs are relatively lower, the policy shifts toward 3G usage earlier (at a message age of 7 slots) compared to high-cost scenarios (where it may wait until age 11). The simplicity of this threshold-based approach allows it to be implemented as a lightweight lookup table on standard mobile hardware.

Limitations and Future Outlook

While providing a robust framework for single-user optimization, the model does not currently account for network-wide effects like congestion or competitive bandwidth allocation. Additionally, the assumption of static pricing for data plans could be expanded to include dynamic, real-time pricing models. Future research may explore how service providers might strategically adjust costs in response to users adopting these optimized sensing behaviors.

Summary updated

BibTeX
@inproceedings{elfenni2012optimal,
  author = {Mohammed Raiss El-Fenni and Rachid El Azouzi and Daniel Sadoc Menasché and Yuedong Xu},
  title = {{Optimal sensing policies for smartphones in hybrid networks: A POMDP approach}},
  booktitle = {VALUETOOLS},
  year = {2012},
  doi = {10.4108/valuetools.2012.250332},
}
Figure