A Novel Daily Runoff Probability Density Prediction Model Based on Simplified Minimal Gated Memory–Non-Crossing Quantile Regression and Kernel Density Estimation

Huaiyuan Liu, Sipeng Zhu, Mo LiWater 2023 · DOI

TL;DR

This paper introduces a novel approach for predicting daily river runoff by combining a simplified recurrent neural network (SMGM) with a non-crossing quantile regression (NCQR) method and kernel density estimation (KDE). This model effectively addresses the issue of quantile crossing in traditional methods, leading to more reliable probability density predictions crucial for water resource management.

What Problem Does This Paper Address?

Accurate daily runoff prediction is vital for managing water resources. While probabilistic predictions offer valuable insights into forecast uncertainty, existing methods like quantile regression (QR) can suffer from "quantile crossing," where predicted quantiles for different probability levels incorrectly overlap. This compromises the reliability of the predictions. The paper aims to overcome this limitation by developing a model that generates non-crossing quantiles and then transforms them into a continuous probability density function (PDF) for a more comprehensive understanding of runoff uncertainty.

Methods

The core of the proposed method is a novel Non-Crossing Quantile Regression (NCQR) technique. Unlike standard QR, NCQR is designed to explicitly prevent quantile crossing by reconstructing the output into a first quantile, the difference between the last and first quantiles, and ratios of intervals between adjacent quantiles. This ensures that predicted quantiles maintain a monotonic relationship.

To handle the non-linear nature of runoff data, NCQR is integrated with a recurrent neural network (RNN). The paper proposes a Simplified Minimal Gated Memory (SMGM) model, a more efficient variant of the Minimal Gated Memory (MGM) network. SMGM simplifies the gating mechanism of MGM, reducing parameters and training time while aiming to maintain or improve predictive accuracy.

Finally, Kernel Density Estimation (KDE) is employed to convert the discrete, non-crossing quantiles predicted by the SMGM-NCQR model into a continuous probability density function (PDF). This provides a richer representation of the runoff prediction uncertainty.

Datasets

The study utilizes three daily runoff datasets from the Yangtze River Basin in China:

  • Dataset 1: Yichang Station (January 2000–December 2007)
  • Dataset 2: Zhutuo Station (January 1996–December 2003)
  • Dataset 3: Pingshan Station (January 2003–December 2010)

These datasets were split into training (75%) and testing (25%) sets. The paper does not introduce new benchmark datasets but uses these existing ones for comprehensive evaluation.

Key Insights and Ideas

  • Quantile Crossing is a Real Problem: The paper highlights how quantile crossing in traditional QR models can severely degrade the reliability of probabilistic forecasts, a critical issue for decision-making.
  • NCQR Solves the Crossing Problem: The proposed NCQR method effectively enforces monotonicity between predicted quantiles, ensuring more trustworthy probabilistic outputs.
  • Simplicity Can Be Powerful: The SMGM model, a simplified version of MGM, demonstrates that reducing model complexity can lead to faster training and competitive, even superior, predictive performance.
  • PDFs Offer Richer Information: Transforming discrete quantiles into continuous PDFs via KDE provides a more intuitive and comprehensive understanding of runoff uncertainty than interval predictions alone.

Key Results

The proposed SMGM-NCQR-KDE model demonstrated strong performance across several metrics:

  • Point Prediction: SMGM-NCQR achieved the smallest RMSE and MAPE compared to other RNN-NCQR combinations (GRU-NCQR, MGM-NCQR), indicating superior point prediction accuracy.
  • Interval Prediction: The model produced narrower prediction intervals (lower PINAW) while maintaining high coverage probability (PICP), suggesting more informative and reliable interval forecasts.
  • Probability Density Prediction: The Continuous Ranking Probability Score (CRPS) for SMGM-NCQR was consistently lower than its counterparts, indicating better probability density prediction performance.
  • Quantile Crossing: The Constraint Score (CS) for GRU-NCQR was 0 across all datasets, confirming that the NCQR component successfully eliminated quantile crossing, unlike GRU-QR.
  • Training Time: SMGM-NCQR exhibited the shortest training times among the tested RNN-NCQR models, attributed to its simplified structure.

Limitations and Future Work

The authors acknowledge two main limitations:

  • Limited Input Features: The current SMGM-NCQR model only uses historical runoff data. Future work should incorporate meteorological factors like precipitation and temperature to potentially improve predictions.
  • Lack of Physical Interpretability: The model is data-driven and does not explicitly model the physical runoff formation process, making it "physically unknown." Future research aims to improve interpretability while maintaining high accuracy.

Summary updated

Abstract

Reliable and accurate daily runoff predictions are critical to water resource management and planning. Probability density predictions of daily runoff can provide decision-makers with comprehensive information by quantifying the uncertainty of forecasting. Models based on quantile regression (QR) have been proven to achieve good probabilistic prediction performance, but the predicted quantiles may crossover with each other, seriously reducing the reliability of the prediction. This paper proposes non-crossing quantile regression (NCQR), which guarantees that the intervals between adjacent quantiles are greater than 0, which avoids the occurrence of quantile crossing. In order to apply NCQR to the prediction of nonlinear runoff series, this paper combines NCQR with recurrent neural network (RNN) models. In order to reduce the model training time and further improve the model accuracy, this paper simplifies the minimal gated memory (MGM) model and proposes a new RNN model, called the simplified minimal gated memory (SMGM) model. Kernel density estimation (KDE) is used to transform the discrete quantiles predicted using SMGM-NCQR into a continuous probability density function (PDF). This paper proposes a novel daily density prediction model that combines SMGM-NCQR and KDE. Three daily runoff datasets in the Yangtze River Basin in China are taken as examples and compared with the advanced models in current research in terms of five aspects: point prediction evaluation, interval prediction evaluation, probability density prediction evaluation, the degree of quantile crossing and training time. The experimental results show that the model can provide high-quality and highly reliable runoff probability density predictions.
BibTeX
@inproceedings{liu2023novel,
  author = {Huaiyuan Liu and Sipeng Zhu and Mo Li},
  title = {{A Novel Daily Runoff Probability Density Prediction Model Based on Simplified Minimal Gated Memory–Non-Crossing Quantile Regression and Kernel Density Estimation}},
  booktitle = {Water},
  year = {2023},
  doi = {10.3390/w15223947},
}
Figure