Adaptive Conformal Prediction for Heteroscedastic Uncertainty

You are reading version 1 of this direction, frozen 2026-10-04. The latest version is version 2.

Version 1 of 285 papers105 conceptsfrozen 2026-10-04

Standard machine learning models often provide a single "best guess" for a prediction, but in high-stakes fields like weather forecasting or medical diagnosis, a point estimate is rarely enough. We need a "safety net"—a range of values that is mathematically guaranteed to contain the truth.

Conformal Prediction (CP) provides this guarantee. However, traditional CP often suffers from a "one-size-fits-all" problem: it produces fixed-width intervals that are the same for every input. If a model is predicting house prices, it might give a $\pm \$50k$ range for both a simple suburban home and a complex luxury estate. This is inefficient. Ideally, we want narrow intervals where the model is confident and wide intervals where the data is noisy or scarce. This shift toward adaptive, instance-specific uncertainty is the core focus of recent research.

The Problem with Global Safety Nets

The mathematical magic of Conformal Prediction lies in its "marginal coverage" guarantee. If you ask for 90% confidence, the true value will fall inside the predicted interval at least 90% of the time, on average, across the entire dataset.

As Henrik Boström, Henrik Linusson, and colleagues point out in Accelerating difficulty estimation for conformal regression forests, these uniform intervals are often "inefficient." They ignore heteroscedasticity—the reality that some parts of the data are inherently more volatile than others. A global margin is often too conservative for easy cases and dangerously overconfident for difficult ones.

The Mechanism of Local Normalization

To make intervals adaptive, researchers use a technique called normalization. Instead of calculating a single global error threshold, the system scales the error bound by a "difficulty estimate" $\sigma(x)$ for each specific input $x$.

The intuition is simple:

  1. Estimate Difficulty: Train a secondary model to predict how much error the primary model is likely to make on a specific input.
  2. Scale the Score: Instead of measuring the raw residual ($|y - \hat{y}|$), measure the normalized residual ($|y - \hat{y}| / \sigma(x)$).
  3. Calibrate: Find the quantile of these normalized residuals on a calibration set.
  4. Predict: For a new input, the prediction interval becomes $\hat{y} \pm \hat{q} \cdot \sigma(x)$.

This multiplicative approach, as explored by Abhineet Agarwal and Bin Yu in PCS-UQ: Uncertainty Quantification via the Predictability-Computability-Stability Framework, allows the interval to expand and contract dynamically. In Conformalized Adaptive Forecasting of Heterogeneous Trajectories, Yanfei Zhou and Matteo Sesia demonstrate this for pathfinding: a distracted pedestrian gets a wide "caution band," while a predictable one gets a narrow, confident one.

Learning Difficulty with Quantile Regression

How do we actually learn the difficulty $\sigma(x)$? One of the most successful approaches is Conformalized Quantile Regression (CQR).

Instead of predicting the mean, Danijel Kivaranovic and Hannes Leeb in Adaptive, Distribution-Free Prediction Intervals for Deep Networks suggest training a model to predict specific quantiles (e.g., the 5th and 95th percentiles) directly. The distance between these predicted quantiles serves as a natural proxy for local difficulty.

Salim I. Amoukou and Nicolas J-B. Brunel further refine this in Adaptive Conformal Prediction by Reweighting Nonconformity Score by using Quantile Regression Forests. By looking at the distribution of samples in the leaves of a Random Forest, the model can "reweight" errors locally, ensuring that the intervals are tighter where the forest is dense and wider where it is sparse.

Disentangling Aleatoric and Epistemic Risk

A key frontier in this research is distinguishing why a prediction is uncertain. Is it because the data is inherently noisy (aleatoric uncertainty), or because the model hasn't seen enough similar examples (epistemic uncertainty)?

Standard adaptive methods often lump these together. However, Raphael Rossellini and Rebecca Willett introduced Uncertainty-Aware CQR (UACQR) in Integrating Uncertainty Awareness into Conformalized Quantile Regression to separate them. By using an ensemble of models, they expand intervals specifically in regions where the models disagree (epistemic) or where the data variance is high (aleatoric).

Similarly, Ilia Azizi and Yu Bin proposed CLEAR in CLEAR: Calibrated Learning for Epistemic and Aleatoric Risk, which tunes two distinct parameters to balance these risks. This dual-tuning approach can reduce interval widths by nearly 30% while maintaining the same rigorous coverage.

Efficiency and Real-World Impact

The ultimate goal of these adaptive methods is efficiency: producing the smallest possible interval that still contains the truth. Shayan Kiyani and George J. Pappas formalize this in Length Optimization in Conformal Prediction, showing that we can learn a threshold function that minimizes interval size across different sub-populations.

These theoretical gains translate to practical performance in diverse domains:

By moving from rigid global bounds to flexible, local estimates, adaptive conformal prediction ensures that machine learning models aren't just accurate, but also "self-aware" enough to know when to be cautious.

Papers in this version

Showing 60 of 85 papers.

History & citationVersion 2 · 2026-10-04

Current · Permanent link

  1. Version 2 (latest) · 2026-10-04 · 89 papers
  2. Version 1 · 2026-10-04 · 85 papers
Cite this direction

Latest version (a living page):

@misc{lacuna_adaptive_interval_scaling_9a4fe357,
  title = {adaptive interval scaling},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/adaptive-interval-scaling/rdr_9a4fe3574aa34d7c83375ec79444ea88},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_adaptive_conformal_prediction_for_hetero_9a4fe357_v1,
  title = {Adaptive Conformal Prediction for Heteroscedastic Uncertainty},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/adaptive-conformal-prediction-for-heteroscedastic-uncertainty/rdr_9a4fe3574aa34d7c83375ec79444ea88/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}