Cloud computing load prediction method based on CNN-BiLSTM model under low-carbon background

H. Zhang, Jie Li, Haoran YangScientific 2024 · DOI

Abstract

As global industries strive toward "double carbon" goals—carbon peaking and carbon neutrality—cloud data centers have emerged as critical targets for energy optimization. These facilities often suffer from a mismatch between resource supply and demand, leading to significant energy waste and carbon emissions. This paper presents a hybrid deep learning model, CNN-BiLSTM, designed to predict cloud computing loads with high precision. By integrating spatial feature extraction via Convolutional Neural Networks (CNN) and temporal dependency modeling via Bidirectional Long Short-Term Memory (BiLSTM) networks, the proposed method enables dynamic carbon emission forecasting. Experimental results using Google Cluster Data demonstrate that the CNN-BiLSTM model reduces Mean Square Error (MSE) by up to 52% compared to traditional models, providing a robust framework for sustainable data center management.

The Challenge of Data Center Carbon Emissions

Data centers are massive energy consumers, with power consumption distributed across IT equipment, cooling systems, and power distribution units. A primary inefficiency in these environments is the static allocation of resources; servers often remain idle or underutilized, yet continue to consume power and require cooling.

Figure 2: Breakdown of power consumption in a typical data center, highlighting the significant impact of IT equipment and cooling systems.

As shown in Figure 2, IT equipment and cooling systems account for approximately 85% of total power usage. To achieve meaningful carbon reduction, data center managers require tools that can predict load fluctuations in real-time, allowing for the dynamic adjustment of power and cooling systems based on actual demand rather than static overheads.

Methodology: Capturing Spatial-Temporal Duality

The proposed CNN-BiLSTM architecture addresses the inherent complexity of cloud workloads, which exhibit both spatial and temporal characteristics.

  1. Spatial Feature Extraction (CNN): The model utilizes a CNN to identify correlations between different Machine IDs and Task IDs. This "spatial" dimension captures how different nodes in a cluster interact and share the workload.
  2. Temporal Modeling (BiLSTM): Unlike standard LSTMs, the BiLSTM processes data in both forward and backward directions, capturing long-term dependencies and sudden "bursty" patterns typical of cloud applications.
  3. Dynamic Carbon Modeling: Predicted CPU utilization is converted into real-time power consumption using server-specific formulas (e.g., Intel specifications). This power value is then translated into carbon emissions using the national power grid's emission factors (e.g., 0.5703 t CO2 / 10,000 kWh).
Figure 4: Visualization of the spatial-temporal nature of cloud load data, showing CPU rate variations across (a) start time and (b) machine ID.

Figure 4 illustrates the dual nature of the data: the temporal fluctuations over time (a) and the spatial distribution across different machine IDs (b). The hybrid model is specifically designed to exploit these multi-dimensional patterns.

Experimental Results and Discussion

The model was validated using the Google Cluster Data set, a large-scale trace of approximately 12,000 machines. The CNN-BiLSTM model significantly outperformed several benchmarks in terms of prediction accuracy:

  • MSE Reduction: Compared to the BP neural network, standard LSTM, BiLSTM, and CEEMDAN-ConvLSTM models, the MSE decreased by 52%, 50%, 34%, and 45%, respectively.
  • Fitting Accuracy: The model achieved an R-squared (R2) value of approximately 0.95, indicating a near-perfect correlation between predicted and actual load values.
  • Carbon Impact: In a 24-hour simulation, the dynamic prediction method calculated a footprint of 3.12 kg of CO2, compared to 3.81 kg estimated by traditional static methods. This suggests that dynamic management can prevent the overestimation of energy needs and facilitate more efficient cooling cycles.

Conclusion

The CNN-BiLSTM model provides a highly accurate mechanism for predicting cloud computing loads and their associated carbon footprints. By moving from static power models to dynamic, spatial-temporal predictions, data centers can significantly reduce their environmental impact while maintaining quality of service. Future research will focus on integrating attention mechanisms to further refine prediction during extreme workload spikes and exploring federated learning to address data privacy concerns in multi-tenant cloud environments.

Summary updated

Abstract

With the establishment of the "double carbon" goal, various industries are actively exploring ways to reduce carbon emissions. Cloud data centers, represented by cloud computing, often have the problem of mismatch between load requests and resource supply, resulting in excessive carbon emissions. Based on this, this paper proposes a complete method for cloud computing carbon emission prediction. Firstly, the convolutional neural network and bidirectional long-term and short-term memory neural network (CNN-BiLSTM) combined model are used to predict the cloud computing load. The real-time prediction power is obtained by real-time prediction load of cloud computing, and then the carbon emission prediction is obtained by power calculation. Develop a dynamic server carbon emission prediction model, so that the server carbon emission can change with the change of CPU utilization, so as to achieve the purpose of low carbon emission reduction. In this paper, Google cluster data is used to predict the load. The experimental results show that the CNN-BiLSTM combined model has good prediction effect. Compared with the multi-layer feed forward neural network model (BP), long short-term memory network model (LSTM ), bidirectional long short-term memory network model (BiLSTM), modal decomposition and convolution long time series neural network model (CEEMDAN-ConvLSTM), the MSE index decreased by 52 <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mo>%</mml:mo></mml:math> , 50 <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mo>%</mml:mo></mml:math> , 34 <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mo>%</mml:mo></mml:math> and 45 <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mo>%</mml:mo></mml:math> respectively.
BibTeX
@inproceedings{zhang2024cloud,
  author = {H. Zhang and Jie Li and Haoran Yang},
  title = {{Cloud computing load prediction method based on CNN-BiLSTM model under low-carbon background}},
  booktitle = {Scientific},
  year = {2024},
  doi = {10.1038/s41598-024-68339-1},
}
Figure