Advice Provision for Choice Selection Processes with Ranked Options

Amos Azaria, Ya'akov Gal, Claudia V. Goldman, Sarit Kraus

Abstract

In human-agent interactions where goals conflict, providing effective advice is a significant challenge. This paper explores "choice selection processes" with ranked options, exemplified by an "AC Game" where an agent aims for energy efficiency while a human seeks comfort. We propose a Social Utility Approach (SAP) that models human behavior using hyperbolic discounting and logit quantal response. Experimental results from a study with 272 participants demonstrate that the SAP method significantly outperforms traditional Markov Decision Process (MDP) models and baseline strategies in balancing energy savings with user acceptance.

Introduction

Traditional advice-giving agents often operate in environments with unordered choices. However, many real-world scenarios involve ranked options (e.g., setting a thermostat or volume level). This study addresses the "AC Game," characterized by ordered actions, partial acceptance (users "meeting the agent halfway"), partial observability of the environment, and conflicting costs between the agent (energy) and the human (comfort). The core challenge is providing advice over multiple rounds that minimizes energy consumption without eroding user trust.

Methodology

The study compares several advising strategies:

  • Social Utility Approach (SAP): This model optimizes a weighted combination of agent and human costs. It incorporates a sophisticated human model featuring hyperbolic discounting—accounting for the human tendency to prioritize immediate comfort—and logit quantal response to model noisy, "mostly rational" decision-making.
  • Markov Decision Process (MDP): A standard sequential decision-making framework. To maintain computational feasibility, the human model was simplified using exponential smoothing, assuming users eventually learn their exact preferences.
  • Baselines: These include Silent (no advice), Receiver-focused (maximizing human comfort), and Sender-focused (maximizing energy savings).

The researchers evaluated these methods through an empirical study on Amazon Mechanical Turk (AMT) involving 272 participants who played the AC Game, receiving advice on power levels while attempting to maximize their personal score.

Key Results

The empirical results highlight the superiority of the SAP method across multiple metrics.

Table 1: Performance comparison of advising methods across energy, comfort, and acceptance metrics.

As shown in Table 1, the SAP method achieved the lowest energy consumption (3.952), outperforming both the MDP (4.361) and the Sender-focused baseline (4.437). Notably, SAP maintained a high user acceptance rate of 34.5%, nearly matching the 36.7% rate of the Receiver-focused strategy, which prioritizes user comfort exclusively. Statistical analysis confirmed that SAP significantly outperformed all other methods (p < 0.001) in overall utility for the agent.

Discussion

The findings reveal an "optimality trap": while MDPs are theoretically optimal, their performance suffered because the human behavior model had to be oversimplified for mathematical solvability. In contrast, SAP’s robust modeling of complex human behavior proved more effective in practice.

Furthermore, the ranked nature of the options allowed the agent to use advice as a "nudge." Even when users did not follow advice perfectly, the agent could influence them toward more efficient settings. By balancing goals, the SAP agent preserves "trust" as a resource, maintaining enough influence to guide users toward energy efficiency over the long term.

Conclusion and Future Work

While the SAP approach shows great promise, its effectiveness depends on correctly weighting social utility components. Future research should explore how these weights can be determined in non-experimental settings and how models can account for even noisier human behavior in more complex, real-world environments.

Summary updated

Abstract

Choice selection processes are a family of bilateral games of incomplete information in which a computer agent generates advice for a human user while considering the effect of the advice on the user's behavior in future interactions. The human and the agent may share certain goals, but are essentially self-interested. This paper extends selection processes to settings in which the actions available to the human are ordered and thus the user may be influenced by the advice even though he doesn't necessarily follow it exactly. In this work we also consider the case in which the user obtains some observation on the sate of the world. We propose several approaches to model human decision making in such settings. We incorporate these models into two optimization techniques for the agent advice provision strategy. In the first one the agent used a social utility approach which considered the benefits and costs for both agent and person when making suggestions. In the second approach we simplified the human model in order to allow modeling and solving the agent strategy as an MDP. In an empirical evaluation involving human users on AMT, we showed that the social utility approach significantly outperformed the MDP approach.
BibTeX
@inproceedings{azaria2014advice,
  author = {Amos Azaria and Ya'akov Gal and Claudia V. Goldman and Sarit Kraus},
  title = {{Advice Provision for Choice Selection Processes with Ranked Options}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2014},
  doi = {10.1609/aaai.v28i1.9077},
}
Figure