Multi-Site and Multi-Pollutant Air Quality Data Modeling

Min Hu, Bin Liu, Guosheng YinSustainability 2023 · DOI

TL;DR

This paper introduces a novel deep learning model, the de-trending graph convolutional LSTM (LS-deGCN), to predict air quality across multiple monitoring stations and pollutants simultaneously. By integrating spatial correlations and handling non-stationary data, the model significantly improves prediction accuracy compared to existing methods.

What Problem Does This Paper Address?

Air pollution is a critical issue for public health and sustainable development. In urban areas, numerous monitoring stations collect data on various pollutants (like PM2.5, CO, NO2) over time. However, accurately predicting future air quality faces two major challenges:

  1. Ignoring Spatial Correlations: Traditional models often focus on data from a single station or predict only one pollutant at a time, neglecting how pollution spreads and interacts between different locations.
  2. Non-Stationarity: Air quality data is inherently non-stationary, meaning its statistical properties (like mean and variance) change over time. This makes it difficult for models to capture long-term trends and leads to inaccurate predictions.

This paper aims to address these limitations by developing a model that can jointly predict multiple pollutants from multiple stations while effectively handling the non-stationary nature of the data.

Methods

The core of the proposed solution is the de-trending graph convolutional LSTM (LS-deGCN). Here's a breakdown of its key components:

  • Graph Convolutional LSTM (GCN-LSTM): This combines the strengths of Graph Convolutional Networks (GCNs) for capturing spatial relationships and Long Short-Term Memory (LSTM) networks for modeling temporal dependencies. Instead of standard matrix multiplications in LSTMs, GCNs use diffusion convolution to learn how information propagates across the network of monitoring stations. This allows the model to understand spatial correlations between stations.
  • De-trending Operation: To tackle non-stationarity, the model incorporates a de-trending step. This involves using the difference between consecutive data points (e.g., xt - xt-1) as an additional input. This transformation helps convert the non-stationary data into a more stationary signal, making it easier for the LSTM to learn underlying patterns.
  • Two Prediction Variants: The authors propose two ways to define the prediction target:
  • Sequence-to-Frame (seq2frame): Predicts a single future time step's entire station × feature matrix.
  • Sequence-to-Sequence (seq2seq): Predicts a sequence of future time steps' station × feature matrices.

Datasets

The models were trained and evaluated on air quality data from:

  • Chengdu, China: A dataset comprising hourly measurements from nine monitoring stations (later reduced to seven due to redundancy and missing data) for six air pollutants (NO2, CO, SO2, O3, PM2.5, PM10) and three meteorological parameters (air pressure, temperature, humidity) from January 2013 to December 2016.
  • Seven Major Cities in China: A dataset with daily measurements for seven pollutants (AQI, PM2.5, PM10, SO2, CO, NO2, O3) from seven cities (Beijing, Shanghai, Chengdu, Wuhan, Guangzhou, Xi'an, and Nanjing) spanning from December 2013 to February 2020.

Key Insights and Ideas

  • Spatial-Temporal Synergy: The paper strongly advocates for the necessity of modeling both spatial and temporal dependencies simultaneously for accurate air quality prediction. Ignoring spatial correlations leads to significant performance degradation.
  • De-trending for Non-Stationarity: The de-trending mechanism is crucial for handling the inherent non-stationarity of air quality data. This simple yet effective technique allows the model to better capture the true dynamics of pollution.
  • Graph Convolution for Spatial Awareness: Using graph convolution, rather than simple inner products, allows the model to explicitly learn how pollution spreads and influences neighboring monitoring stations, mimicking real-world atmospheric transport.
  • Seq2Seq Superiority: The seq2seq model generally shows better performance, especially for longer prediction horizons, suggesting that predicting a sequence of future states is more robust than predicting a single frame.

Key Results

The proposed LS-deGCN models, particularly the seq2seq variant, demonstrated superior performance across various metrics (RMSE, accuracy, MAE) compared to baseline methods like linear regression, support vector regression, and a standard LSTM.

  • Chengdu Dataset: The LS-deGCN seq2seq model achieved the lowest RMSE and highest accuracy across all tested scenarios (prediction horizons of 1, 24, and 48 hours, and historical data windows of 24 and 48 hours). For instance, with l=1 and Δt=48, the LS-deGCN seq2seq model achieved an RMSE of 0.57, significantly outperforming the next best LSTM seq2scalar (0.95).
  • Multi-City Experiment: While the performance on the multi-city dataset was not as strong as the single-city Chengdu dataset, it still showed promising results, suggesting the model's generalizability. The authors attribute the lower performance to weaker spatial correlations between distant cities compared to stations within the same city.
  • Parameter Sensitivity: The results indicated that a larger historical data window (Δt=48) generally led to better predictions than a smaller one (Δt=24). The effect of the prediction horizon (l) was more nuanced, with accuracy peaking at l=24 in some cases, suggesting a complex trade-off.

Limitations and Future Work

  • Data Availability: The authors note that the specific datasets used are not publicly available due to privacy concerns.
  • Other Factors: The paper acknowledges that air quality prediction is influenced by many other factors, such as geographical information (beyond station proximity) and traffic patterns.
  • Future Work: The authors plan to incorporate these additional data sources (geographical and traffic information) into the LS-deGCN framework to further enhance prediction accuracy.

Summary updated

Abstract

This study proposes a new method for predicting air quality in major industrialized cities around the world. In some big cities, multiple air quality measurement stations are deployed at different locations to monitor air pollutants, such as NO2, CO, PM 2.5, and PM 10, over time. At every monitoring timestamp t, we observe one station × feature matrix xt of the pollutant data, which represents a spatio-temporal process. Traditional methods of prediction of air quality typically use data from one station or can only predict a single pollutant (such as PM 2.5) at a time, which ignores the spatial correlation among different stations. Moreover, the air pollution data are typically highly non-stationary. This study has explicitly overcome the limitations of these two aspects, forming its unique contributions. Specifically, we propose a de-trending graph convolutional LSTM (long short-term memory) to continuously predict the whole station × feature matrix in the next 1 to 48 h, which not only captures the spatial dependency among multiple stations by replacing an inner product with convolution, but also incorporates the de-trending signals (transforms a non-stationary process to a stationary one by differencing the data) into our model. Experiments on the air quality data of the city of Chengdu and multiple major cities in China demonstrate the feasibility of our method and show promising results.
BibTeX
@inproceedings{hu2023multi,
  author = {Min Hu and Bin Liu and Guosheng Yin},
  title = {{Multi-Site and Multi-Pollutant Air Quality Data Modeling}},
  booktitle = {Sustainability},
  year = {2023},
  doi = {10.3390/su16010165},
}
Figure