Spatial and Attribute Neural Network Weighted Regression for the Accurate Estimation of Spatial Non-Stationarity

Sihan Ni, Zhongyi Wang, Yuanyuan Wang, Minghao Wang, Shuqi Li, Nan WangISPRS Int. J. Geo Inf 2022 · OpenReview

TL;DR

This paper introduces a novel "spatial-attribute" unified distance metric and a corresponding Spatial and Attribute Neural Network Weighted Regression (SANNWR) model. By integrating both spatial location and inherent attribute features of geographic entities, SANNWR significantly improves the accuracy of estimating spatial non-stationarity compared to traditional methods like GWR and its neural network extension, GNNWR.

What Problem Does This Paper Address?

Geographic Information Science heavily relies on spatial modeling to understand and analyze phenomena. A key challenge is capturing "spatial non-stationarity," where relationships between geographic features vary across space. Traditional methods like Geographically Weighted Regression (GWR) address this by considering spatial proximity. However, GWR and its successor, Geographically Neural Network Weighted Regression (GNNWR), primarily rely on Euclidean distance based on spatial coordinates. This overlooks the rich information contained in the attribute features of geographic entities (e.g., temperature, humidity, elevation), which can also reflect inter-entity relationships. The paper aims to bridge this gap by developing a model that effectively incorporates both spatial and attribute information for more accurate spatial non-stationarity analysis.

Methods

The core innovation lies in the proposed Spatial-Attribute Proximities Deep Neural Network (SAPDNN) and the Spatial and Attribute Neural Network Weighted Regression (SANNWR) model.

  • SAPDNN: This deep neural network is designed to create a unified distance metric that combines spatial distance (Euclidean) and attribute distance (absolute difference of attribute values). It takes spatial and attribute distances as input and, through several dense layers, outputs a single "spatial-attribute" unified distance. This allows for a more nuanced representation of relationships between sample points.
  • SANNWR: This model builds upon the GNNWR framework but replaces the standard spatial distance metric with the newly developed "spatial-attribute" unified distance metric from SAPDNN. SANNWR uses this unified distance to calculate a weighted matrix, which is then used in a regression framework to estimate spatial non-stationarity. The model structure involves SAPDNN for distance fusion and a Spatial Weight Neural Network (SWNN) to derive the weight matrix.

Datasets

The study utilizes a dataset of PM2.5 concentration monitoring stations in China from 2018. This dataset includes:

  • Target Variable: PM2.5 concentration.
  • Attribute Features: Aerosol Optical Depth (AOD), 2m temperature (TEMP), relative humidity (r), precipitation (TP), 10m wind speed (WS), wind direction (WD), and elevation (DEM).
  • Data Split: The dataset was divided into a cross-validation set (85% for training/validation) and a test set (15% for final evaluation). Ten-fold cross-validation was employed.

Key Insights and Ideas

  • Attribute Features Matter: The study strongly suggests that attribute features, in addition to spatial location, are crucial for accurately modeling spatial non-stationarity. Ignoring them leads to a less comprehensive understanding of geographic relationships.
  • Unified Distance Metric: The concept of a "spatial-attribute" unified distance metric is a powerful way to capture richer semantic information about the relationships between geographic entities. It moves beyond simple spatial proximity.
  • Deep Learning for Fusion: Deep neural networks (SAPDNN) are effective tools for fusing diverse types of data (spatial and attribute) into a single, meaningful representation (the unified distance).
  • SANNWR's Superiority: The proposed SANNWR model, by leveraging this unified distance, demonstrates a significant improvement in fitting accuracy and generalization capability over existing methods.

Key Results

The study compared GWR, GNNWR, and SANNWR using various evaluation metrics (R², RMSE, MAE, MAPE, AICc) on both training and test sets.

  • Attribute Distance Alone is Insufficient: Models using only attribute distance showed lower performance than those using spatial distance, indicating that spatial context remains vital.
  • GNNWR Outperforms GWR: The GNNWR model, incorporating neural networks for spatial weighting, showed better fitting ability than GWR.
  • SANNWR is the Best Performer: SANNWR consistently outperformed both GWR and GNNWR across all evaluation metrics on both training and test datasets. For instance, on the test set, SANNWR achieved an R² of 0.857, compared to 0.844 for GNNWR-S and a range of 0.711-0.742 for the GWR models. This highlights its superior fitting and generalization capabilities.
  • Unified Metric's Effectiveness: The "spatial-attribute" unified distance metric was proven to be effective in improving the analytical capability for spatial non-stationarity.

Limitations and Future Work

  • Single Attribute Focus: The current study primarily focused on integrating spatial distance with a single attribute feature (wind direction).
  • Future Directions: The authors suggest several avenues for future research:
  • Exploring multi-attribute distances using different fusion formulas.
  • Developing methods for multi-attribute fusion to incorporate multiple attribute features simultaneously.
  • Extending the model to incorporate the time dimension, creating a spatio-temporal-attribute framework. This could lead to even more comprehensive and accurate modeling of dynamic geographic processes.

Summary updated

Abstract

Geographically neural network weighted regression is an improved model of GWR combined with a neural network. It has a stronger ability to fit nonlinear functions, and complex geographical processes can be modeled more fully. GNNWR uses the distance metric of Euclidean space to express the relationship between sample points. However, except for spatial location features, geographic entities also have many diverse attribute features. Incorporating attribute features into the modeling process can make the model more suitable for the real geographical process. Therefore, we proposed a spatial-attribute proximities deep neural network to aggregate data from the spatial feature and attribute feature, so that one unified distance metric can be used to express the spatial and attribute relationships between sample points at the same time. Based on GNNWR, we designed a spatial and attribute neural network weighted regression (SANNWR) model to adapt to this new unified distance metric. We developed one case study to examine the effectiveness of SANNWR. We used PM2.5 concentration data in China as the research object and compared the prediction accuracy between GWR, GNNWR and SANNWR. The results showed that the “spatial-attribute” unified distance metric is useful, and that the SANNWR model showed the best performance.
BibTeX
@article{ni2022spatial,
  author = {Sihan Ni and Zhongyi Wang and Yuanyuan Wang and Minghao Wang and Shuqi Li and Nan Wang},
  title = {{Spatial and Attribute Neural Network Weighted Regression for the Accurate Estimation of Spatial Non-Stationarity}},
  journal = {ISPRS Int. J. Geo Inf.},
  year = {2022},
  url = {https://openreview.net/forum?id=ltDmknHjDx},
}
Figure