JAWS-X: Addressing Efficiency Bottlenecks of Conformal Prediction Under Standard and Feedback Covariate Shift

Drew Prinster, Suchi Saria, Anqi LiuICML 2023 · OpenReview

In high-stakes fields like drug discovery or autonomous systems, a raw prediction isn't enough—we need to know how much to trust it. Conformal Prediction (CP) is a popular framework for this, providing "distribution-free" guarantees that work regardless of the underlying black-box model. However, standard CP relies on the assumption of data exchangeability (e.g., that training and test data are drawn from the same distribution).

In real-world applications, this assumption often fails due to Feedback Covariate Shift (FCS). JAWS-X introduces a new family of Conformal Prediction methods that provide rigorous uncertainty intervals even when your test data is influenced by your training process.

The Challenge of Feedback Loops

Imagine a protein engineer using a machine learning model to design new sequences. They use the model's own predictions to select the most promising candidates for the next round of testing. This creates a feedback loop: the test data is explicitly dependent on the training data, breaking the mathematical foundation of standard uncertainty tools.

Illustration of the feedback loop in protein design, showing how the design distribution shifts away from the training distribution based on model predictions.

Existing solutions for FCS force a difficult choice. They are either computationally prohibitive (requiring thousands of model retrains) or statistically inefficient (requiring you to throw away half your data for a holdout set, resulting in overly cautious, wide intervals).

The JAWS-X Solution

To address this, the authors propose JAWS-X, which builds upon the Jackknife+ (a leave-one-out resampling technique). By extending this framework, JAWS-X achieves a "Goldilocks" balance: it is significantly faster than exhaustive methods and much more data-efficient than simple data-splitting, all while maintaining mathematical guarantees on reliability.

The core contributions include:

  1. JAW-FCS: A method that uses likelihood-ratio weights to adjust the Jackknife+ framework for feedback loops. It ensures that the model's errors (residuals) are compared fairly across shifted distributions, leveraging a property called "pseudo-exchangeability."
  2. Computational Relaxations (The "X"): Because leave-one-out retraining for large datasets is slow, the authors introduce two tunable, efficient versions:
  3. JAW-KLOO: Uses only the $K$ most important leave-one-out models.
  4. WCV+ (Weighted Cross-Validation+): A weighted version of $K$-fold cross-validation. This allows users to train only a handful of models (e.g., $K=10$ or $20$) instead of hundreds, drastically reducing compute time.

Crucially, the authors provide new proofs showing that these methods maintain a finite-sample coverage guarantee under feedback shift. For example, a 90% confidence interval will actually contain the true value at least 90% of the time.

Key Results and Insights

The methods were evaluated across three distinct scenarios: biomolecular design (protein fluorescence), active learning (NASA Airfoil dataset), and standard covariate shift (various UCI regression benchmarks).

The paper demonstrates that you don't have to choose between speed and accuracy. Because JAWS-X doesn't require "sample splitting," the predictive model is trained on all available data. This leads to better predictions and tighter, more useful confidence intervals.

Performance of JAWS-X methods compared to baselines across varying shift magnitudes. JAWS-X maintains target coverage while producing narrower intervals than weighted split methods.
  • Reliability: In protein design tasks, JAW-FCS and WCV+ consistently hit the target coverage (e.g., 90%) across varying magnitudes of data shift. In contrast, standard Jackknife+ and CV+ failed as the shift increased.
  • Informativeness: JAW-FCS produced significantly narrower intervals than "Weighted Split CP." Narrower intervals are more informative because they give a more precise range of possible outcomes without sacrificing safety.
  • Performance: In active learning, JAWS-X methods achieved lower Mean Squared Error (MSE) than baselines because they allowed the model to learn from the entire dataset while still providing valid uncertainty bounds.

Limitations and Future Work

While powerful, the framework has a few limitations. The theoretical guarantees assume access to "oracle weights"—the exact likelihood ratio of how the test distribution differs from the training. While this is often known in "design" problems where a human or algorithm explicitly defines the shift, in other cases, these weights must be estimated, which can introduce errors. Additionally, the coverage guarantee for the $K$-fold version (WCV+) is theoretically slightly weaker than the full JAW-FCS, though empirically it performs nearly identically.

Future directions include exploring how to improve the selection of models in the JAW-KLOO method and extending the framework to handle even more complex types of distribution shifts beyond covariate shift.

Summary updated

Abstract

We study the efficient estimation of predictive confidence intervals for black-box predictors when the common data exchangeability (e.g., i.i.d.) assumption is violated due to potentially feedback-induced shifts in the input data distribution. That is, we focus on standard and feedback covariate shift (FCS), where the latter allows for feedback dependencies between train and test data that occur in many decision-making scenarios like experimental design. Whereas prior conformal prediction methods for this problem are in general either extremely computationally demanding or make inefficient use of labeled data, we propose a collection of methods based on the jackknife+ that achieve a practical balance of computational and statistical efficiency. Theoretically, our proposed JAW-FCS method extends the rigorous, finite-sample coverage guarantee of the jackknife+ to FCS. We moreover propose two tunable relaxations to JAW-FCS's computation that maintain finite-sample guarantees: one using only $K$ leave-one-out models (JAW-$K$LOO) and a second building on $K$-fold cross validation+ (WCV+). Practically, we demonstrate that JAW-FCS and its computational relaxations outperform state-of-the-art baselines on a variety of real-world datasets under standard and feedback covariate shift, including for biomolecular design and active learning tasks.
BibTeX
@inproceedings{prinster2023jaws,
  author = {Drew Prinster and Suchi Saria and Anqi Liu},
  title = {{JAWS-X: Addressing Efficiency Bottlenecks of Conformal Prediction Under Standard and Feedback Covariate Shift}},
  booktitle = {International Conference on Machine Learning},
  year = {2023},
  url = {https://openreview.net/forum?id=ORxBEWMPAJ},
}
Figure