Learning to Complement Humans

Bryan Wilder, Eric Horvitz, Ece Kamar

Introduction

Standard machine learning typically follows a "lone wolf" philosophy, where models are trained to minimize error on a dataset under the assumption that they will be the sole decision-makers. However, in real-world applications—ranging from scientific discovery to medical diagnosis—AI systems often operate alongside human experts. When human involvement is treated as an afterthought, typically by applying a fixed decision rule (e.g., a confidence threshold) to a pre-trained model, the resulting human-machine team often performs suboptimally.

This research introduces a framework for jointly training a machine learning model and its "query policy"—the logic that determines when to defer a decision to a human expert. By optimizing for the performance of the team as a whole, the model learns to specialize in areas where it outperforms humans while identifying instances where human intervention is most valuable. This shift from individual accuracy to team utility represents a significant departure from traditional ML paradigms.

Methodology: Joint Training Frameworks

The authors propose two primary families of approaches to achieve this joint optimization, moving beyond "fixed" models that are trained in isolation.

1. Discriminative Approaches

In discriminative models, the system learns a direct mapping from inputs to both a prediction ($m$) and a query decision ($q$). To enable training via standard backpropagation, the researchers utilize a soft relaxation (a differentiable surrogate) of the query policy. This allows the gradient to flow through the decision-making process during training. Consequently, the predictive model is incentivized to focus its "attention" and parameters on instances where the human is likely to struggle, effectively learning to "complement" the human's known weaknesses.

2. Decision-Theoretic Approaches

These approaches are rooted in the Value of Information (VOI) principle. Traditionally, VOI calculates whether the expected improvement in accuracy from a human's input justifies the associated "cost" (such as time, effort, or financial expense). The core innovation here, Joint VOI, introduces a differentiable surrogate for the VOI calculation. This allows the underlying probabilistic models to be fine-tuned specifically to maximize the team's total utility, rather than just the machine's individual predictive confidence.

Overview of discriminative and decision-theoretic approaches for joint training of predictive models and query policies.

Experimental Evaluation

The proposed methods were evaluated on two high-stakes, real-world domains that represent different types of human-AI collaboration:

  • Galaxy Zoo (Scientific Discovery): This task involves classifying galaxy images based on consensus labels from citizen scientists. The machine must decide when to consult a potentially fallible human volunteer to reach the correct classification.
  • CAMELYON16 (Medical Diagnosis): This task focuses on detecting breast cancer metastasis in lymph node images. Here, the machine can choose to consult a panel of pathologists. Crucially, these experts work under realistic time pressure, which introduces a human error rate that the machine must learn to account for.

Key Insights and Results

The experiments consistently demonstrated that joint training significantly outperforms sequential "fixed" baselines across various metrics and scenarios.

Capacity and Complementarity

A critical finding of the study is that joint training is most beneficial when the ML model has limited capacity (e.g., fewer layers or neurons). In a "fixed" setup, a small model might waste its limited parameters trying to learn complex patterns that a human expert could easily identify. In contrast, joint training teaches the model to "give up" on regions where human experts are strong, allowing it to focus its limited capacity on the specific regions where it can provide the most added value to the team.

Error rates and fraction of cases queried per class, illustrating how joint training leverages human expertise in specific areas.

Performance Gains

  • Galaxy Zoo: The Joint VOI approach reduced total loss by 21-73% compared to the fixed baseline for simpler models.
  • CAMELYON16: Joint training improved the discriminative model's performance by up to 20%. The system successfully identified regions where human errors were concentrated (approximately 10% of the data space) and learned to prioritize machine accuracy in those specific areas.

Handling Asymmetric Costs and Structured Errors

In medical settings, the cost of a false negative (missing a diagnosis) is often much higher than a false positive. The authors found that joint training is significantly better at managing these trade-offs, as the model learns to defer high-risk cases to humans more effectively than a "fixed" model would. Furthermore, the research highlights that humans and machines make different kinds of errors. Joint training discovers these structured error patterns and allocates tasks accordingly, creating a more resilient team.

Limitations and Future Directions

While the results are promising, several challenges remain for future research:

  • Data Requirements: The method requires "logged" human responses during the training phase to simulate human behavior accurately. In many industries, collecting this data can be prohibitively expensive.
  • Static Collaboration: The current study focuses on a specific workflow where the machine acts as the initial filter. It does not yet explore more complex, interleaved collaborations where multiple rounds of interaction occur.
  • Human Dynamics: The model assumes human performance is static. In practice, factors like automation bias (over-reliance on AI) or human learning over time could shift the optimal query policy, necessitating more dynamic modeling approaches.

Summary updated

Abstract

A rising vision for AI in the open world centers on the development of systems that can complement humans for perceptual, diagnostic, and reasoning tasks. To date, systems aimed at complementing the skills of people have employed models trained to be as accurate as possible in isolation. We demonstrate how an end-to-end learning strategy can be harnessed to optimize the combined performance of human-machine teams by considering the distinct abilities of people and machines. The goal is to focus machine learning on problem instances that are difficult for humans, while recognizing instances that are difficult for the machine and seeking human input on them. We demonstrate in two real-world domains (scientific discovery and medical diagnosis) that human-machine teams built via these methods outperform the individual performance of machines and people. We then analyze conditions under which this complementarity is strongest, and which training methods amplify it. Taken together, our work provides the first systematic investigation of how machine learning systems can be trained to complement human reasoning.
BibTeX
@inproceedings{wilder2020learning,
  author = {Bryan Wilder and Eric Horvitz and Ece Kamar},
  title = {{Learning to Complement Humans}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2020},
  doi = {10.24963/ijcai.2020/212},
}
Figure