Freshness on Demand: Optimizing Age of Information for the Query Process

Josefine Holm, Anders E. Kalør, Federico Chiariotti, Beatriz Soret, Søren Kejser Jensen, Torben Bach Pedersen, Petar Popovski

Abstract

Age of Information (AoI) has become an important concept in communications, as it allows system designers to measure the freshness of the information available to remote monitoring or control processes. However, its definition tacitly assumed that new information is used at any time, which is not always the case and the instants at which information is collected and used are dependent on a certain query process. We propose a model that accounts for the discrete time nature of many monitoring processes, considering a pull-based communication model in which the freshness of information is only important when the receiver generates a query. We then define the Age of Information at Query (QAoI), a more general metric that fits the pull-based scenario, and show how its optimization can lead to very different choices from traditional push-based AoI optimization when using a Packet Erasure Channel (PEC).

Introduction: The Pull-Based Freshness Problem

In the Internet of Things (IoT) and networked control systems, data "freshness" is typically quantified by the Age of Information (AoI)—the time elapsed since the generation of the most recently received update. Standard AoI metrics assume a "push-based" model, where the receiver continuously monitors the data stream. However, many industrial systems operate on a "pull-based" basis, where a server polls a sensor at specific query intervals.

Comparison of Permanent Query (PQ) and Query-Aware (QAPA) transmission policies and their impact on AoI.

In such scenarios, the freshness of data during the idle periods between queries is irrelevant. Optimizing for standard average AoI in these systems leads to inefficient energy usage, as the sensor attempts to maintain freshness when it is not required. This paper introduces Age of Information at Query (QAoI), a metric that specifically measures freshness at the moments a query is triggered, allowing for more targeted communication strategies.

Methodology: Markov Decision Process for QAoI

The authors formulate the optimization problem as a Markov Decision Process (MDP) to determine the optimal transmission policy for a wireless sensor under energy constraints.

  • System Model: The system is time-slotted. A sensor transmits updates over a Packet Erasure Channel (PEC), where packets are subject to random loss.
  • Energy Constraints: A "Leaky Bucket" model is employed for energy management. The sensor accumulates energy "tokens" over time and must expend a token to transmit a packet, preventing continuous high-frequency updates.
  • Optimization Policies:
    • Permanent Query (PQ): A baseline policy optimizing for traditional AoI, effectively assuming queries occur in every time slot.
  • Query Arrival Process Aware (QAPA): The proposed policy that leverages knowledge of the query schedule to minimize QAoI.

The MDP state space incorporates the current age of information, available energy tokens, and the time remaining until the next scheduled query.

Key Insights and Results

The core finding is that when a query schedule is known, the optimal strategy is not a steady transmission rate. Instead, the sensor should "save" its energy tokens and execute a burst of transmissions immediately preceding a query. This "freshness on demand" approach creates a significant trade-off: while the average AoI over all time may increase, the age specifically at the query instant (QAoI) is minimized.

Cumulative Distribution Function (CDF) of AoI and QAoI for PQ and QAPA policies, highlighting the 'staircase' behavior of QAPA.

Quantitative evaluations using Monte Carlo simulations reveal that:

  1. Superior QAoI Performance: The QAPA policy consistently outperforms the PQ baseline at query instants. For a query period of $T_q = 40$, the average QAoI for QAPA can be nearly half that of PQ under identical energy constraints.
  2. Staircase Distribution: As shown in the CDF, the QAPA policy exhibits a distinct "staircase" behavior. This indicates that the policy successfully maintains very low age for a high percentage of queries, even in the presence of packet erasures.
  3. Resilience to Interference: In high-loss environments, the QAPA policy's strategy of bursting transmissions near query times is significantly more effective at ensuring a fresh update arrives when needed.

Conclusion and Future Directions

This work demonstrates that aligning sensor transmissions with query schedules can drastically improve information freshness for pull-based systems while managing limited energy resources. Current limitations include the assumption of deterministic query schedules. Future research will explore stochastic query processes and the application of Reinforcement Learning (RL) to enable sensors to learn unknown query patterns autonomously.

Summary updated

Abstract

Age of Information (AoI) has become an important concept in communications, as it allows system designers to measure the freshness of the information available to remote monitoring or control processes. However, its definition tacitly assumed that new information is used at any time, which is not always the case and the instants at which information is collected and used are dependent on a certain query process. We propose a model that accounts for the discrete time nature of many monitoring processes, considering a pull-based communication model in which the freshness of information is only important when the receiver generates a query. We then define the Age of Information at Query (QAoI), a more general metric that fits the pull-based scenario, and show how its optimization can lead to very different choices from traditional push-based AoI optimization when using a Packet Erasure Channel (PEC).
BibTeX
@inproceedings{holm2021freshness,
  author = {Josefine Holm and Anders E. Kalør and Federico Chiariotti and Beatriz Soret and Søren Kejser Jensen and Torben Bach Pedersen and Petar Popovski},
  title = {{Freshness on Demand: Optimizing Age of Information for the Query Process}},
  booktitle = {ICC},
  year = {2021},
  url = {https://openreview.net/forum?id=3VdYSZdkcl},
}
Figure