On Trustworthy Decision-Making Process of Human Drivers From the View of Perceptual Uncertainty Reduction

Huanjie Wang, Haibin Liu, Wenshuo Wang, Lijun Sun

TL;DR

This paper proposes a novel framework to understand how human drivers reduce perceptual uncertainty during complex driving tasks, like highway merging. By combining explainable AI (SHAP) with entropy-based measures, they empirically show that drivers actively seek information to lower their uncertainty, leading to more trustworthy decisions.

What Problem Does This Paper Address?

Driving, especially in interactive and uncertain environments like highway merging, requires drivers to make complex decisions based on incomplete information. While many models predict driver behavior, few explain how drivers actively manage their own uncertainty to make reliable choices. This paper aims to bridge this gap by investigating the hypothesis that human drivers intentionally reduce their perceptual uncertainty about the environment to achieve trustworthy decision-making. This understanding is crucial for developing safer and more human-like autonomous driving systems.

Methods

The core of the paper's methodology lies in a two-pronged approach:

  • Explainable AI (XAI) for Feature Saliency: The authors employ the SHapley Additive exPlanations (SHAP) technique. SHAP is a powerful model-agnostic method that attributes the contribution of each input feature to a model's prediction. In this context, it's used to identify which driving-related features (e.g., speed differences, distances to other vehicles) are most influential for a human driver's decision at different stages of a merge.
  • Entropy-Based Uncertainty Quantification: To quantify perceptual uncertainty, the paper utilizes Kullback-Leibler (KL) divergence and mutual information. KL divergence measures the difference between probability distributions, here used to track how the distribution of salient features changes over time. Mutual information quantifies the dependency between feature saliency at different decision-making moments. These entropy-based measures help assess how much a driver's perception of the environment is changing and how uncertain they are.

The framework integrates these with a Long Short-Term Memory (LSTM) network for predicting driver trajectories, which serves as the underlying model to be explained by SHAP.

Datasets

The study utilizes the INTERACTION dataset. Specifically, it focuses on highway on-ramp merge scenarios in congested traffic. This dataset is noted for its diversity in scenarios and behaviors, and its well-defined physical variables. The authors extracted 796 demonstrations from this dataset, dividing them into 80% for training and 20% for testing.

Key Insights and Ideas

  • Active Uncertainty Reduction: The central idea is that human drivers aren't passive recipients of information; they actively seek it out to reduce their uncertainty. This is a key driver for making "trustworthy" decisions.
  • Feature Saliency Evolves: The importance (saliency) of different driving features changes dynamically throughout the decision-making process. Early in a merge, broad features like ego-vehicle speed might dominate, while later, more specific interactions with other vehicles become critical.
  • Uncertainty Decreases Over Time: Both KL divergence and mutual information analyses suggest that as the decision-making process progresses, the driver's perceptual uncertainty about the environment decreases. This implies a move from a broad, uncertain understanding to a more focused, confident one.
  • Trustworthy Decisions = Low Uncertainty: The paper posits that a low level of perceptual uncertainty is a prerequisite for making trustworthy decisions. Drivers will continue to seek information until this threshold is met.

Key Results

  • Prediction Performance: The developed LSTM model achieved improved prediction stability and accuracy compared to traditional GMM-GMR and HMM-GMR models, with a 29.7% improvement in prediction stability (β¯MSE) and a 15.3% improvement in accuracy (¯RMSE).
  • Feature Saliency Trends:
    • At the start of the merge (α=0%), ego vehicle speed (longitudinal and lateral) are the most salient features.
  • In the middle (α=50%), ego vehicle speed and the speed difference with the lead vehicle become dominant.
  • At the end (α=100%), speed and speed difference with the lead vehicle remain important, influencing the distance to the ramp endpoint.
  • KL Divergence: The KL divergence between adjacent decision-making moments generally decreases over time, indicating a reduction in perceptual uncertainty. This decrease is more pronounced as the driver approaches the end of the merge.
  • Mutual Information: Mutual information also shows an increasing trend over the merge process, suggesting a stronger dependency between feature saliency at consecutive moments, which aligns with the idea of narrowing down focus and reducing uncertainty.

Limitations and Future Work

  • Focus on a Specific Scenario: The study is validated on highway on-ramp merging. While this is a critical scenario, its findings might not generalize directly to all driving situations.
  • Discretized Moments: While SHAP can analyze continuous time, the analysis in the paper focuses on three discrete moments (start, middle, end). The paper mentions that a continuous analysis is possible and could offer finer-grained insights.
  • Future Work: The authors suggest that this framework has potential for comprehending the exploration-exploitation trade-off in reinforcement learning and could be applied to understand human-like decision-making in autonomous systems. Further research could explore more diverse scenarios and more complex interactions.

Summary updated

Abstract

Humans are experts at making decisions for challenging driving tasks with uncertainties. Many efforts have been made to model the decision-making process of human drivers at the behavior level. However, limited studies explain how human drivers actively make trustworthy sequential decisions to complete interactive driving tasks in an uncertain environment. This paper argues that human drivers intently search for actions to reduce the uncertainty of their perception of the environment, i.e., perceptual uncertainty, to a low level that allows them to make a trustworthy decision easily. This paper provides a proof-of-concept framework to empirically reveal that human drivers’ perceptual uncertainty decreases when executing interactive tasks with uncertainties. We first introduce an explainable-artificial intelligence approach (i.e., SHapley Additive exPlanation, SHAP) to determine the salient features on which human drivers base decisions. Then, we use entropy-based measures to quantify the drivers’ perceptual changes in these ranked salient features across the decision-making process, reflecting the changes in uncertainties. The validation and verification of our proposed method are conducted in the highway on-ramp merging scenario with congested traffic using the INTERACTION dataset. Experimental results support that human drivers intentionally seek information to reduce their perceptual uncertainties in the number and rank of salient features of their perception of environments to make a trustworthy decision.
BibTeX
@article{wang2024trustworthy,
  author = {Huanjie Wang and Haibin Liu and Wenshuo Wang and Lijun Sun},
  title = {{On Trustworthy Decision-Making Process of Human Drivers From the View of Perceptual Uncertainty Reduction}},
  journal = {IEEE Trans. Intell. Transp. Syst.},
  year = {2024},
  url = {https://openreview.net/forum?id=04lcG3O1Ua},
}

Loading related content...

Figure