Planning Ahead with RSA: Efficient Signalling in Dynamic Environments by Projecting User Awareness across Future Timesteps

Anwesha Das, John Duff, Jörg Hoffmann, Vera DembergarXiv 2025 · DOI · arXiv

Introduction

In high-pressure environments such as air traffic control, emergency response, or drone swarm management, human attention is a critical, finite resource. AI assistants designed to support operators in these scenarios often face a communication dilemma: providing too much information can overwhelm the user, while providing too little can lead to missed critical events. Current systems frequently rely on static heuristics that fail to account for the "opportunity cost" of communication—the time a user spends processing one message is time lost for perceiving other environmental changes.

This paper introduces a framework that extends the Rational Speech Act (RSA) model into dynamic, multi-step environments. By combining recursive Bayesian reasoning with finite-horizon planning, the authors developed an AI assistant that optimizes not just the content of a message, but its specificity and timing, ensuring human operators maintain optimal situational awareness.

The d-RSA Framework

The core of the proposed approach is an extension of the vanilla RSA framework, which typically models a single turn of conversation in a static context. The authors introduce three key components to create their Full Model (d-RSA + Priors + Planning):

Conceptual overview of the d-RSA framework tracking user awareness over time.
  1. Dynamic Belief Tracking (d-RSA): The model treats the user's posterior belief at one timestep as the prior for the next. This allows the agent to track how a user’s understanding evolves as the environment changes and alerts are received.
  2. User-Specific Priors: Rather than assuming a generic operator, the model incorporates specific initial belief states and biases, allowing it to tailor communication to what a specific user already knows or is likely to ignore.
  3. Finite-Horizon Planning: Using breadth-first search, the agent evaluates sequences of future messages (up to 7 timesteps). Crucially, it models the temporal cost of messages: a long, detailed alert "locks" the user's attention, preventing them from processing other information during that interval.

Experimental Evaluation

The researchers evaluated the framework using a simulated "Drone World" environment. The setup involved 800 unique trials featuring 4 drones with 24 total properties (e.g., battery level, wind speed). These properties evolved over 7 timesteps, with 2–4 properties becoming "critical" (entering a risk zone) at various intervals. The AI assistant could choose from a lexicon ranging from generic alerts ("Beep") to highly specific status updates.

Experimental Results

The full model consistently outperformed all baselines, including greedy models and those lacking user-specific priors.

Performance comparison across varying task complexities.

As shown in the experimental data, the full model (green diamond) achieved significantly higher Average Total Reward—a metric for global situational awareness—across varying numbers of critical properties and temporal dispersions. Key findings include:

  • Strategic Brevity: The model learns to use shorter messages when it knows the user has a strong prior, saving attentional budget for unexpected issues.
  • Anticipatory Alerting: In complex scenarios, the planning model sometimes sends alerts before a property becomes critical, "priming" the user to react more efficiently when the crisis occurs.
  • Adaptive Specificity: The model's use of detailed versus ambiguous messages drops as user awareness increases, whereas baseline models remain inflexibly verbose.

Discussion and Future Work

The synergy of planning and user-modeling allows the agent to manage the user's "mental real estate" effectively. However, the authors note several areas for future development. The current model relies on hand-crafted lexicons and assumes perfect knowledge of the environment and the user's mental state. Future iterations could integrate Large Language Models (LLMs) for more flexible communication and employ Monte Carlo Tree Search to handle real-world uncertainty. Additionally, incorporating real-time behavioral data, such as eye-tracking, could allow the agent to adapt to shifting human attention dynamically.

Summary updated

Abstract

Adaptive agent design offers a way to improve human-AI collaboration on time-sensitive tasks in rapidly changing environments. In such cases, to ensure the human maintains an accurate understanding of critical task elements, an assistive agent must not only identify the highest priority information but also estimate how and when this information can be communicated most effectively, given that human attention represents a zero-sum cognitive resource where focus on one message diminishes awareness of other or upcoming information. We introduce a theoretical framework for adaptive signalling which meets these challenges by using principles of rational communication, formalised as Bayesian reference resolution using the Rational Speech Act (RSA) modelling framework, to plan a sequence of messages which optimise timely alignment between user belief and a dynamic environment. The agent adapts message specificity and timing to the particulars of a user and scenario based on projections of how prior-guided interpretation of messages will influence attention to the interface and subsequent belief update, across several timesteps out to a fixed horizon. In a comparison to baseline methods, we show that this effectiveness depends crucially on combining multi-step planning with a realistic model of user awareness. As the first application of RSA for communication in a dynamic environment, and for human-AI interaction in general, we establish theoretical foundations for pragmatic communication in human-agent teams, highlighting how insights from cognitive science can be capitalised to inform the design of assistive agents.
BibTeX
@misc{das2025planning,
  author = {Anwesha Das and John Duff and Jörg Hoffmann and Vera Demberg},
  title = {{Planning Ahead with RSA: Efficient Signalling in Dynamic Environments by Projecting User Awareness across Future Timesteps}},
  year = {2025},
  eprint = {2510.23340},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2510.23340},
}
Figure