Towards Efficient Electricity Forecasting in Residential and Commercial Buildings: A Novel Hybrid CNN with a LSTM-AE based Framework

Zulfiqar Ahmad Khan, Tanveer Hussain, Amin Ullah, Seungmin Rho, Mi Young Lee, Sung Wook Baik

TL;DR

This paper introduces a novel hybrid deep learning model, combining Convolutional Neural Networks (CNNs) with a Long Short-Term Memory Autoencoder (LSTM-AE), for more accurate electricity consumption forecasting in residential and commercial buildings. By leveraging CNNs for spatial feature extraction and LSTM-AE for temporal sequence modeling, the proposed framework significantly reduces prediction errors compared to existing state-of-the-art methods.

What Problem Does This Paper Address?

Global energy consumption is rapidly increasing, with residential and commercial buildings accounting for a substantial portion. Efficient energy management hinges on accurate electricity consumption forecasting, but this is challenging due to noisy, irregular, and complex time-series data from smart meters. Traditional forecasting methods often struggle with these complexities, leading to significant prediction errors that can cost millions in energy savings. Existing deep learning models, while powerful, sometimes fail to effectively capture both the spatial and temporal characteristics of this data. This research aims to bridge this gap by developing a hybrid model that excels at both.

Methods

The core of this work is a novel hybrid deep learning architecture: a CNN-LSTM-AE model. The process involves several key steps:

  • Data Preprocessing: Raw data from smart meters is first cleaned to remove missing, redundant, and outlier values. This is followed by normalization, with the authors specifically selecting standard transform for its ability to center and scale features independently, which they found to be effective.
  • CNN for Feature Extraction: A Convolutional Neural Network (CNN) is employed to extract spatial features from the preprocessed input data. This is crucial because raw time-series data might not directly reveal all relevant patterns.
  • LSTM Autoencoder (LSTM-AE) for Temporal Modeling: The spatial features extracted by the CNN are then fed into an LSTM Autoencoder. The autoencoder consists of an encoder that compresses the input sequences into a latent representation (encoded features) and a decoder that reconstructs the original sequence from this representation. This part of the model is designed to learn temporal dependencies within the data.
  • Hybrid Integration: The CNN and LSTM-AE are integrated into a unified framework. The CNN acts as a feature extractor, and its output is passed to the LSTM-AE for sequence modeling.
  • Final Prediction: After the LSTM-AE processes the encoded sequences, a dense (fully connected) layer is used to generate the final energy prediction.

The authors highlight that this combination is novel, with CNNs addressing the spatial aspect and LSTM-AE handling the temporal sequences, a synergy they believe is key to improved accuracy.

Datasets

The proposed model was evaluated on two datasets:

  • UCI Residential Building Dataset: This dataset contains one-minute resolution electricity consumption data from a single residential building in France, collected between 2006 and 2010. It includes variables like date, time, global active power, global reactive power, voltage, intensity, and submetering data for different areas of the house.
  • Korean Commercial Building Dataset: This is a newly generated dataset by the authors, collected from commercial buildings. It differs from the UCI dataset in that it has a 15-minute resolution and only one electricity consumption sensor (for office electricity), whereas the UCI dataset has three submetering sensors.

For training, 75% of the data was used, with the remaining 25% reserved for testing.

Key Insights and Ideas

  • Synergy of CNN and LSTM-AE: The paper strongly emphasizes that combining CNNs for spatial feature extraction with LSTM-AE for temporal sequence modeling is more effective than using either component alone or other hybrid combinations. This addresses the dual nature of energy consumption data.
  • Importance of Preprocessing: The authors demonstrate that thorough data preprocessing, including outlier removal and appropriate normalization (specifically standard transform), is critical for achieving high prediction accuracy.
  • Autoencoders for Feature Learning: The use of an autoencoder within the LSTM framework allows the model to learn a compressed, yet informative, representation of the temporal data, which can then be used for more robust prediction.
  • Addressing Limitations of Individual Models: The paper implicitly highlights how this hybrid approach overcomes the limitations of individual models: CNNs are good at spatial features but not temporal sequences, while LSTMs can struggle with complex spatial patterns.

Key Results

The proposed CNN-LSTM-AE model demonstrated superior performance across various evaluation metrics (MSE, MAE, RMSE, MAPE) on both the UCI residential dataset and the Korean commercial building dataset.

  • UCI Dataset: The model achieved the smallest error values, with specific results for hourly data including MSE of 0.19, MAE of 0.31, and RMSE of 0.47. For daily data, it recorded even lower errors.
  • Korean Commercial Building Dataset: The model also outperformed baseline models on this dataset, showing strong results for both hourly and daily predictions. For daily data, it achieved error rates of 0.01 for MSE, 0.08 for MAE, and 0.11 for RMSE.
  • Comparison: The proposed hybrid model consistently outperformed other state-of-the-art deep learning and traditional methods, including CNN, LSTM, CNN+LSTM, and LSTM-AE, across both datasets and resolutions.

Limitations and Future Work

  • Computational Complexity: While not explicitly detailed as a limitation, the use of deep learning models, especially hybrid ones, implies a certain level of computational demand for training.
  • Generalizability: Although tested on two distinct datasets (residential and commercial), further validation on a wider variety of building types and geographical locations could strengthen the generalizability claims.
  • Future Work: The authors suggest that further improvements could be made by exploring different time resolutions and potentially incorporating additional external factors (e.g., weather data, occupancy) into the model. The paper also mentions changing the time resolution to observe further improvements, hinting at this as a potential avenue for future research.

Summary updated

Abstract

Due to industrialization and the rising demand for energy, global energy consumption has been rapidly increasing. Recent studies show that the biggest portion of energy is consumed in residential buildings, i.e., in European Union countries up to 40% of the total energy is consumed by households. Most residential buildings and industrial zones are equipped with smart sensors such as metering electric sensors, that are inadequately utilized for better energy management. In this paper, we develop a hybrid convolutional neural network (CNN) with an long short-term memory autoencoder (LSTM-AE) model for future energy prediction in residential and commercial buildings. The central focus of this research work is to utilize the smart meters’ data for energy forecasting in order to enable appropriate energy management in buildings. We performed extensive research using several deep learning-based forecasting models and proposed an optimal hybrid CNN with the LSTM-AE model. To the best of our knowledge, we are the first to incorporate the aforementioned models under the umbrella of a unified framework with some utility preprocessing. Initially, the CNN model extracts features from the input data, which are then fed to the LSTM-encoder to generate encoded sequences. The encoded sequences are decoded by another following LSTM-decoder to advance it to the final dense layer for energy prediction. The experimental results using different evaluation metrics show that the proposed hybrid model works well. Also, it records the smallest value for mean square error (MSE), mean absolute error (MAE), root mean square error (RMSE) and mean absolute percentage error (MAPE) when compared to other state-of-the-art forecasting methods over the UCI residential building dataset. Furthermore, we conducted experiments on Korean commercial building data and the results indicate that our proposed hybrid model is a worthy contribution to energy forecasting.
BibTeX
@inproceedings{khan2020towards,
  author = {Zulfiqar Ahmad Khan and Tanveer Hussain and Amin Ullah and Seungmin Rho and Mi Young Lee and Sung Wook Baik},
  title = {{Towards Efficient Electricity Forecasting in Residential and Commercial Buildings: A Novel Hybrid CNN with a LSTM-AE based Framework}},
  booktitle = {Sensors},
  year = {2020},
  url = {https://openreview.net/forum?id=16iq8gve2Tf},
}
Figure