Streamflow prediction using an integrated methodology based on convolutional neural network and long short-term memory networks

Sujan Ghimire, Zaher Mundher Yaseen‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬, Aitazaz A. Farooque, Ravinesh C. Deo, Ji Zhang, Xiaohui TaoScientific 2021 · DOI

TL;DR

This paper introduces a novel hybrid deep learning model, CNN-LSTM, for predicting hourly streamflow. By combining Convolutional Neural Networks (CNNs) for feature extraction and Long Short-Term Memory (LSTM) networks for temporal analysis, the CNN-LSTM model significantly outperforms existing AI and ensemble methods across various prediction horizons, offering a more accurate and reliable tool for water resource management.

What Problem Does This Paper Address?

Accurate streamflow prediction is crucial for effective water resource management, impacting everything from hydropower generation and agricultural planning to flood control. However, the inherent non-linearity and non-stationarity of streamflow time-series data make precise prediction a significant challenge in hydrology. While various Artificial Intelligence (AI) models have been applied, there's a continuous need for more robust and accurate prediction methods that can capture complex hydrological dynamics. This study aims to address this by developing and evaluating an integrated deep learning approach.

Methods

The core of this research is the CNN-LSTM model, a hybrid architecture designed to leverage the strengths of both Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) networks.

  • CNN for Feature Extraction: The CNN component is used to automatically extract relevant features from the raw hourly streamflow data. CNNs are adept at identifying spatial hierarchies and patterns, which in this context helps in capturing local dependencies and noise reduction within the time series. The paper specifies using 1D convolutions, suitable for time-series data.
  • LSTM for Temporal Prediction: The features extracted by the CNN are then fed into an LSTM network. LSTMs are a type of Recurrent Neural Network (RNN) specifically designed to handle sequential data and long-term dependencies, making them ideal for time-series forecasting where past events influence future outcomes. The LSTM learns the temporal dynamics from the CNN-extracted features to predict future streamflow values.

This integrated approach is benchmarked against several other models, including standalone CNN, LSTM, Deep Neural Network (DNN), and various conventional AI and ensemble models like Multi-Layer Perceptron (MLP), Extreme Learning Machine (ELM), Gradient Boosting Regression (GBM), Decision Tree (DT), Multivariate Adaptive Regression Splines (MARS), and Extreme Gradient Boosting (XGB).

Datasets

The study utilizes historical hourly streamflow (Q<sub>flow</sub>) data from two distinct catchments in Australia:

  • Brisbane River: Located in Queensland.
  • Teewah Creek: Also located in Queensland.

The data spans from January 1, 2014, to October 16, 2017. This dataset is used for both training and testing the developed models. The paper does not introduce a new benchmark dataset but rather uses publicly available data for validation.

Key Insights and Ideas

  • Synergy of CNN and LSTM: The most significant insight is the superior performance achieved by combining CNNs and LSTMs. This hybrid approach effectively captures both the intricate local features (via CNN) and the long-term temporal dependencies (via LSTM) in streamflow data, a combination that standalone models struggle to achieve.
  • Automated Feature Engineering: The CNN component automates the feature extraction process, eliminating the need for manual feature engineering, which is often a complex and time-consuming task in hydrological modeling.
  • Robustness Across Time Horizons: The CNN-LSTM model demonstrates consistent high performance across various prediction intervals, from short-term (1-Week) to medium-term (9-Months), highlighting its versatility.
  • Outperforming Established Models: The study provides strong evidence that the CNN-LSTM model surpasses not only individual deep learning models but also a range of conventional AI and ensemble methods, which have been widely used in hydrological forecasting.

Key Results

The CNN-LSTM model consistently outperformed all benchmarked models across different prediction intervals (1-Week, 2-Weeks, 4-Weeks, and 9-Months) and for both study sites.

  • Accuracy: The paper reports that 84% of the Q<sub>flow</sub> prediction errors for the CNN-LSTM model were below 0.05 m³ s⁻¹, compared to 80% for LSTM and 66% for DNN.
  • Performance Metrics: Across various metrics like Correlation Coefficient (r), Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Willmott's Index (WI), Nash-Sutcliffe Coefficient (ENS), and others, the CNN-LSTM model generally achieved the best scores. For instance, it achieved a correlation coefficient (r) of 1.00 for the 2-week prediction interval for both Brisbane River and Teewah Creek.
  • Error Reduction: The CNN-LSTM model showed significant reductions in MAE and RMSE compared to LSTM (e.g., 36.79% and 45.53% reduction for 1-week prediction in Brisbane River).
  • Practical Value: The authors conclude that the CNN-LSTM model has significant practical value due to its accurate predictions and reasonable training time.

Limitations and Future Work

  • Limitations:
    • The study focuses on hourly streamflow prediction and does not explicitly explore its performance on different time scales (e.g., daily, monthly).
  • While the model shows high accuracy, the paper acknowledges that ENS metric can overestimate larger values and neglect lower ones, which is why other metrics like WI and LM were also used.
  • Future Work:
    • The authors suggest integrating more causal hydro-meteorological datasets (e.g., rainfall, synoptic climate data) as input predictors for the CNN-LSTM model.
  • Exploring advanced hyperparameter tuning methods like Grid Search, Bayesian Optimization, and HyperBand could further optimize model performance.
  • Investigating the impact of data uncertainty and non-stationarity on model predictability is also proposed.
  • Applying the CNN-LSTM model as a new tool for watershed monitoring and management, potentially incorporating a wider range of climate scenarios.

Summary updated

Abstract

Streamflow (Q<sub>flow</sub>) prediction is one of the essential steps for the reliable and robust water resources planning and management. It is highly vital for hydropower operation, agricultural planning, and flood control. In this study, the convolution neural network (CNN) and Long-Short-term Memory network (LSTM) are combined to make a new integrated model called CNN-LSTM to predict the hourly Q<sub>flow</sub> (short-term) at Brisbane River and Teewah Creek, Australia. The CNN layers were used to extract the features of Q<sub>flow</sub> time-series, while the LSTM networks use these features from CNN for Q<sub>flow</sub> time series prediction. The proposed CNN-LSTM model is benchmarked against the standalone model CNN, LSTM, and Deep Neural Network models and several conventional artificial intelligence (AI) models. Q<sub>flow</sub> prediction is conducted for different time intervals with the length of 1-Week, 2-Weeks, 4-Weeks, and 9-Months, respectively. With the help of different performance metrics and graphical analysis visualization, the experimental results reveal that with small residual error between the actual and predicted Q<sub>flow</sub>, the CNN-LSTM model outperforms all the benchmarked conventional AI models as well as ensemble models for all the time intervals. With 84% of Q<sub>flow</sub> prediction error below the range of 0.05 m<sup>3</sup> s<sup>-1</sup>, CNN-LSTM demonstrates a better performance compared to 80% and 66% for LSTM and DNN, respectively. In summary, the results reveal that the proposed CNN-LSTM model based on the novel framework yields more accurate predictions. Thus, CNN-LSTM has significant practical value in Q<sub>flow</sub> prediction.
BibTeX
@inproceedings{ghimire2021streamflow,
  author = {Sujan Ghimire and Zaher Mundher Yaseen‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬‬ and Aitazaz A. Farooque and Ravinesh C. Deo and Ji Zhang and Xiaohui Tao},
  title = {{Streamflow prediction using an integrated methodology based on convolutional neural network and long short-term memory networks}},
  booktitle = {Scientific},
  year = {2021},
  doi = {10.1038/s41598-021-96751-4},
}
Figure