A Combined Model Based on Feature Selection and WOA for PM2.5 Concentration Forecasting

Fang Zhao, Weide LiAtmosphere 2019 · DOI

TL;DR

This paper introduces a novel hybrid model (VCEEMDAN-SF-WOA-LSSVM) for highly accurate PM2.5 concentration forecasting. By combining advanced signal decomposition (CEEMDAN-VMD), intelligent feature selection (ACF), and parameter optimization (WOA) for a Least Squares Support Vector Machine (LSSVM), the model significantly outperforms existing methods. This work is crucial for better air quality monitoring and control, ultimately benefiting public health.

What Problem Does This Paper Address?

Air pollution, particularly fine particulate matter (PM2.5), is a growing concern with significant health implications. Accurate forecasting of PM2.5 concentrations is vital for implementing effective pollution control strategies and issuing timely public health advisories. Traditional methods often struggle with the complex, non-linear relationships inherent in air quality data, and many existing hybrid models face challenges with computational cost due to large input datasets. This paper aims to address these issues by developing a more efficient and accurate PM2.5 forecasting model that intelligently selects relevant features and optimizes its predictive engine.

Methods

The proposed VCEEMDAN-SF-WOA-LSSVM model is a sophisticated hybrid approach built upon several key components:

  • Data Preprocessing (CEEMDAN-VMD): To handle the noisy and complex nature of PM2.5 data, the researchers employ a combination of Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) and Variational Mode Decomposition (VMD). This process decomposes the PM2.5 time series into several intrinsic mode functions (IMFs), reconstructs them, and filters out noise, leading to a cleaner signal for subsequent analysis.
  • Feature Selection (ACF): Instead of using all available historical data, the paper utilizes the Autocorrelation Function (ACF) to identify the most relevant input variables. ACF helps determine the temporal dependencies within the time series, allowing the model to select a reduced set of input features that have the strongest correlation with the target PM2.5 concentration. This is a crucial step for improving efficiency and potentially accuracy.
  • Optimization (WOA): The core prediction engine is a Least Squares Support Vector Machine (LSSVM). To overcome the challenge of selecting optimal parameters (c and σ²) for LSSVM, the Whale Optimization Algorithm (WOA) is employed. WOA, inspired by the foraging behavior of humpback whales, is a meta-heuristic algorithm that efficiently searches for the best parameter combination to maximize the model's predictive accuracy.
  • Forecasting (LSSVM): The optimized LSSVM model then uses the preprocessed and feature-selected data to forecast hourly PM2.5 concentrations.

Datasets

The study utilizes hourly PM2.5 concentration data collected from two locations in China:

  • Beijing: Located in northern China, characterized by less rainfall and relatively poorer air quality.
  • Yibin: Located in central China, with adequate rainfall and good air quality.

Both datasets cover the period from January 5, 2015, to April 26, 2015. The first 2520 data points from each location were used for training, and the remaining 168 points were used for testing, aiming to predict PM2.5 concentrations for the subsequent week.

Key Insights and Ideas

  • The Power of Hybridization: Combining multiple advanced techniques (decomposition, feature selection, optimization, and a robust regression model) is significantly more effective than using any single method for complex time-series forecasting like PM2.5.
  • Feature Selection is Crucial: Intelligently selecting input features using ACF dramatically improves prediction accuracy and efficiency. This is a key differentiator from many existing models that rely on a large number of input variables.
  • WOA for Parameter Tuning: The Whale Optimization Algorithm proves to be a highly effective method for optimizing LSSVM parameters, leading to superior forecasting performance compared to default or other optimization methods.
  • Decomposition Enhances Signal Quality: CEEMDAN-VMD effectively denoises and reconstructs the PM2.5 signal, providing a cleaner and more representative dataset for the forecasting model.
  • Automated Prediction: The proposed model represents a step towards fully automated PM2.5 prediction, capable of identifying relevant input variables and making predictions with minimal manual intervention.

Key Results

The proposed VCEEMDAN-SF-WOA-LSSVM model demonstrated superior performance across both Beijing and Yibin datasets:

  • Improved Accuracy: The model consistently achieved lower error metrics (MAE, MSE, MAPE) and higher Index of Agreement (IA) compared to various benchmark models, including single LSSVM, BPNN, GRNN, and other hybrid combinations.
  • Significant Gains from Feature Selection: For instance, in Beijing, the MAPE was reduced by 43.77% compared to a model without feature selection (VCEEMDAN-WOA-LSSVM).
  • Optimization Benefits: Replacing WOA with other optimization algorithms (like CS) or using default parameters led to a noticeable decrease in prediction accuracy.
  • Statistical Significance: DM tests confirmed statistically significant differences in performance between the proposed model and benchmark models, reinforcing its superiority.
  • Specific Performance: In Yibin, the model achieved a MAPE of 6.15, which is reported as being better than existing literature. In Beijing, the IA reached 0.9940.

Limitations and Future Work

  • Computational Cost: While feature selection reduces input data, the overall hybrid model, especially the optimization phase, still requires significant computational resources and training time compared to simpler models.
  • Future Research Directions:
    • Investigating the PM2.5 generation process and incorporating more diverse factors (geographical, climatic, etc.) for more comprehensive forecasting.
  • Exploring other complex real-world problems where this hybrid model could be applied.
  • Further optimizing the model's performance and potentially reducing computational demands.

Summary updated

Abstract

As people pay more attention to the environment and health, P M 2.5 receives more and more consideration. Establishing a high-precision P M 2.5 concentration prediction model is of great significance for air pollutants monitoring and controlling. This paper proposed a hybrid model based on feature selection and whale optimization algorithm (WOA) for the prediction of P M 2.5 concentration. The proposed model included five modules: data preprocessing module, feature selection module, optimization module, forecasting module and evaluation module. Firstly, signal processing technology CEEMDAN-VMD (Complete Ensemble Empirical Mode Decomposition with Adaptive Noise and Variational Mode Decomposition) is used to decompose, reconstruct, identify and select the main features of P M 2.5 concentration series in data preprocessing module. Then, AutoCorrelation Function (ACF) is used to extract the variables which have relatively large correlation with predictor, so as to select input variables according to the order of correlation coefficients. Finally, Least Squares Support Vector Machine (LSSVM) is applied to predict the hourly P M 2.5 concentration, and the parameters of LSSVM are optimized by WOA. Two experiment studies reveal that the performance of the proposed model is better than benchmark models, such as single LSSVM model with default parameters optimization, single BP neural networks (BPNN), general regression neural network (GRNN) and some other combined models recently reported.
BibTeX
@inproceedings{zhao2019combined,
  author = {Fang Zhao and Weide Li},
  title = {{A Combined Model Based on Feature Selection and WOA for PM2.5 Concentration Forecasting}},
  booktitle = {Atmosphere},
  year = {2019},
  doi = {10.3390/atmos10040223},
}
Figure