Runoff Prediction Model Based on Improved Convolutional Neural Network

Yichao Xu, Yi Liu, Zhiqiang Jiang, Xin YangResearch 2021 · DOI

TL;DR

Researchers have developed an improved 1D Convolutional Neural Network (CNN) specifically designed to predict reservoir runoff where human intervention breaks natural seasonal cycles. By swapping standard activation functions for Leaky ReLU, the model achieves significantly higher accuracy and avoids the "dead neuron" issues that plague traditional neural networks in hydrological forecasting.

What Problem Does This Paper Address?

Predicting how much water will flow into a reservoir (runoff) is critical for hydropower management and flood control. Historically, this was easier because nature follows cycles. However, in modern river basins, human regulation—dams, storage, and controlled releases—destroys this periodicity.

When data is "non-periodic" and highly non-linear, traditional hydrological models and standard Artificial Neural Networks (ANNs) often struggle. They either fail to capture the complex, short-term dependencies in the data or fall victim to mathematical hurdles like the "vanishing gradient" problem, where the model stops learning during training.

Methods

The authors propose an improved one-dimensional Convolutional Neural Network (1D-CNN). While CNNs are famous for image recognition (2D), 1D-CNNs are exceptionally good at finding local patterns in time-series data, like rainfall and flow rates.

The Architecture: * Two Convolutional Layers: The first has 32 channels and the second has 64. These layers act as automated feature extractors. * Batch Normalization & Max-Pooling: These standard deep learning techniques help stabilize training and reduce the "noise" in the data. * The Secret Sauce - Leaky ReLU: Most traditional networks use Sigmoid or ReLU activation functions. Sigmoid can cause gradients to vanish (learning stops), and ReLU can lead to "Dead Neurons" where parts of the network stop responding entirely. The authors used Leaky ReLU, which allows a small, non-zero gradient when the input is negative, ensuring the network keeps learning even with complex, non-periodic hydrological data.

Datasets

The model was tested using historical data from the ZheXi Reservoir in Hunan Province, China.

  • Rainfall Data: Collected from 10 rain gauging stations and processed using the Tyson polygon method to calculate area-average rainfall.
  • Runoff Data: Actual observation data from the ZheXi Reservoir.
  • Time Scales: The researchers tested the model on two scales:
  • Daily data: From January 1, 2015, to December 31, 2020.
  • Hourly data: Throughout the year 2020.
  • Split: A standard 80% training and 20% validation split was used.

Key Insights and Ideas

  • Activation Functions are Critical: The jump from a standard CNN to an "improved" one was largely driven by the activation function. In hydrology, where data can be volatile, preventing "Dead Neurons" via Leaky ReLU is more than a technicality—it’s the difference between a model that converges and one that stays "silent."
  • CNNs vs. ANNs: The paper reinforces that CNNs are superior to traditional ANNs for runoff because they account for "local connection" and "weight sharing." Essentially, the CNN "looks" at a window of time to understand how a recent rain event impacts current flow, rather than treating every data point in isolation.
  • Simplicity Wins: Interestingly, the authors argued against including too many variables (like temperature or soil moisture). They found that adding these often introduced more noise and risk of overfitting than actual predictive value, opting instead to focus on the core relationship between rainfall and runoff.

Key Results

The improved CNN (C1/C2) was compared against a traditional ANN (A1/A2) and a standard CNN (B1/B2). The results were consistently superior across all metrics:

  • Accuracy ($R^2$): On the hourly validation set, the improved CNN reached an $R^2$ of 0.9032, significantly outperforming the ANN (0.7648) and the traditional CNN (0.8612).
  • Error Reduction: The Root Mean Square Error (RMSE) and Mean Absolute Error (MAE) were the lowest among all tested models. For daily validation, the improved CNN's MAE was roughly 15% lower than the traditional ANN.
  • Physical Consistency: A major win was that the improved CNN avoided producing negative runoff values—a common "hallucination" in traditional CNNs that makes them unusable in real-world engineering.

Limitations and Future Work

While the paper demonstrates a "successful and feasible" model, a few areas remain open for exploration:

  • Generalization: The model was tuned specifically for the ZheXi basin. Its performance in basins with different climates or different types of human regulation (e.g., agricultural irrigation vs. hydropower) isn't yet established.
  • Hyperparameter Automation: The study used fixed hyperparameters (like a learning rate of 0.001 and 5 epochs). Future work could involve using optimization algorithms to "self-tune" these settings for different reservoirs.
  • Long-term vs. Short-term: While the model excels at daily and hourly scales, its performance for multi-month or seasonal forecasting in regulated basins remains a topic for future research.

Summary updated

Abstract

Abstract Due to the influence of human regulation and storage factors, the runoff series monitored at the hydropower stations often show the characteristics of non-periodicity, which makes runoff prediction simulation difficult. This paper attempts to construct an improved one-dimensional convolutional neural network (CNN) model for runoff prediction simulation. The improved CNN model consists of two convolution layers and a full connection layer and uses LeakyRelu as the activation function. Based on the historical rainfall and runoff data of the ZheXi reservoir in Hunan Province, this paper uses the improved CNN model to simulate runoff prediction and compares the results with the traditional ANN model and the traditional CNN model. The results show that the improved CNN model is superior to the traditional ANN model and the traditional CNN model. It proves that the improved CNN model is suitable for the non-periodic runoff prediction simulation, and it can avoid the data problems such as gradient disappearance that may occur in the traditional neural network model.
BibTeX
@inproceedings{xu2021runoff,
  author = {Yichao Xu and Yi Liu and Zhiqiang Jiang and Xin Yang},
  title = {{Runoff Prediction Model Based on Improved Convolutional Neural Network}},
  booktitle = {Research},
  year = {2021},
  doi = {10.21203/rs.3.rs-760130/v1},
}
Figure