Quantile-Regression-Ensemble: A Deep Learning Algorithm for Downscaling Extreme Precipitation

Thomas Bailie, Yun Sing Koh, Neelesh Rampal, Peter B. GibsonAAAI 2024 · DOI

This research, presented at AAAI-24, addresses a critical bottleneck in climate science: the inability of coarse global models to accurately predict local extreme weather events. By moving away from "one-size-fits-all" models toward a specialized ensemble approach, the authors provide a more reliable tool for disaster preparedness and infrastructure planning.

The Challenge of Downscaling

Global Climate Models (GCMs) are essential for long-term projections, but their spatial resolution is typically very coarse—often around 100km per grid cell. For local decision-making, such as assessing whether a town's drainage system can withstand a specific storm, this data must be "downscaled" to a much higher resolution (e.g., 5km).

While deep learning has accelerated statistical downscaling, standard models suffer from "regression to the mean." Because extreme storms are rare compared to light rain, models prioritize reducing overall error by predicting intensities close to the average. This leads to a consistent underestimation of the most damaging events. The Quantile-Regression-Ensemble (QRE) algorithm was designed specifically to overcome this failure.

The QRE Architecture

The QRE framework consists of two primary components that work in tandem to specialize in different weather intensities:

  1. Specialized Ensemble Members: The training data is partitioned into $N$ subsets based on precipitation intensity quantiles. Each subset is used to train a dedicated Bernoulli-Gamma Network (BGNet). Unlike standard models, a BGNet predicts the parameters of a probability distribution (probability of rain, shape, and scale) rather than a single deterministic value.
  2. The Weight Network: A convolutional neural network (CNN) acts as a dynamic "router." It analyzes low-resolution atmospheric predictors—such as humidity and wind speed—to determine which intensity "bucket" the current weather pattern belongs to.
The Quantile-Regression-Ensemble (QRE) architecture, featuring specialized BG Networks for different intensity quantiles and a dynamic Weight Network.

To ensure the model understands the relationship between different intensities, the authors employed Earth Mover Distance (EMD) as the loss function for the Weight Network. This penalizes the model less for "near misses" (e.g., guessing high intensity when the truth is extreme) than for total misclassifications.

Data and Implementation

The model was trained using the ERA5 reanalysis dataset as low-resolution predictors (coarsened to ~100km) and the Virtual Climate Station Network (VCSN) for New Zealand as high-resolution ground truth (5km). Predictors included air temperature, specific humidity, and three-dimensional wind speeds. Additionally, static surface elevation data was included to account for orographic lift—the process by which mountains influence rainfall patterns.

Key Results and Regional Performance

QRE significantly outperformed standard aggregate models and traditional ensemble methods in high-intensity ranges. In the highest quantile (0.923–1.0), QRE achieved a Mean Squared Error (MSE) of 312.8, compared to 326.3 for standard models.

High-resolution precipitation downscaling results across New Zealand, highlighting performance in topographically complex regions like Mt. Cook and Milford Sound.

The model proved particularly effective in high-elevation regions like the Southern Alps and Mt. Cook. These areas are notoriously difficult to model due to frequent and intense orographic precipitation, yet QRE's specialized "extreme experts" were able to capture these signatures more accurately than generalized models.

Limitations and Future Outlook

While QRE excels at extremes, it does not show significant improvement for moderate-intensity rain, where standard models sometimes perform slightly better. Furthermore, the system's overall accuracy is highly dependent on the Weight Network; a misclassification at the routing stage can lead to poor final predictions. Future work will focus on improving classification for moderate-intensity events and extending this ensemble approach to other variables like wind gusts and temperature extremes.

Summary updated

BibTeX
@inproceedings{bailie2024quantile,
  author = {Thomas Bailie and Yun Sing Koh and Neelesh Rampal and Peter B. Gibson},
  title = {{Quantile-Regression-Ensemble: A Deep Learning Algorithm for Downscaling Extreme Precipitation}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2024},
  doi = {10.1609/aaai.v38i20.30193},
}
Figure