Nonstationary Spatial Modeling of Massive Global Satellite Data

Huang Huang, Lewis R. Blake, Matthias Katzfuß, Dorit HammerlingJournal of Computational and Graphical Statistics 2021

TL;DR

This paper introduces a novel nonstationary Gaussian Process (GP) model called the Multi-Resolution Approximation (M-RA) to analyze massive global satellite data, specifically sea surface temperature (SST). By accounting for spatially varying relationships and using a distributed computing approach, they achieve significantly improved prediction accuracy and uncertainty quantification compared to traditional stationary models, analyzing a record-breaking 43 million SST observations.

What Problem Does This Paper Address?

Earth-observing satellites collect vast amounts of data daily, like sea surface temperature (SST). However, this data is often incomplete and noisy, making it difficult to create accurate, high-resolution maps of these geophysical processes. Existing methods for creating these "Level 3" data products often rely on simple averaging, which can lose fine-scale details and provide unclear uncertainty estimates, limiting their scientific utility. A key challenge is the "nonstationary" nature of these processes – their statistical properties change across the globe (e.g., SST is smoother offshore than nearshore) and are influenced by geographical features like landmasses, which break spatial correlations. Analyzing such massive, nonstationary datasets computationally is also a significant hurdle.

Methods

The core of this work is an extension of the Multi-Resolution Approximation (M-RA) for Gaussian Processes (GPs). The M-RA breaks down the spatial domain into a hierarchy of partitions, allowing for efficient modeling of spatial variation at multiple scales. The key innovation here is making the M-RA nonstationary. This is achieved by:

  • Local Covariance Fitting: Instead of a single global covariance function, they fit local covariance functions and combine them to create a nonstationary global one. This allows the model to adapt to spatially varying statistical properties.
  • Domain Partitioning for Oceanography: They specifically design the domain partitioning to account for land barriers, weakening the dependence across these features to better reflect oceanographic processes.
  • Distributed Computing: To handle the massive scale of the data, they implement the M-RA using a distributed-memory computing approach, leveraging high-performance computing (HPC) environments. This allows the computational load to be split across many nodes.

Datasets

The primary dataset used is the MODIS (Moderate Resolution Imaging Spectroradiometer) on the NASA Aqua satellite's Level-2 Global Sea Surface Skin Temperature (SST) data. This dataset consists of approximately 43 million observations collected on April 7, 2019. The paper also mentions using data from April 1-6, 2019, for covariance modeling.

Key Insights and Ideas

  • Nonstationarity is Crucial for Global Data: The results strongly suggest that assuming stationarity for global geophysical data like SST is a significant oversimplification. Incorporating nonstationarity leads to substantial improvements in prediction accuracy and uncertainty quantification.
  • Domain Decomposition Matters: The careful partitioning of the domain, specifically to account for landmasses, is shown to be effective in modeling the spatial dependencies in SST.
  • Scalability is Achieved: The distributed computing implementation of the nonstationary M-RA successfully handles a dataset of unprecedented size for probabilistic GP modeling, demonstrating the feasibility of applying these advanced methods to massive real-world problems.
  • Improved Probabilistic Predictions: Beyond just point predictions, the nonstationary model provides more reliable confidence intervals and probabilistic forecasts, which are essential for scientific understanding and decision-making.

Key Results

  • The nonstationary M-RA model achieved substantially improved predictive performance compared to a stationary M-RA model.
  • The paper analyzed a MODIS SST dataset of over 43 million observations, which is claimed to be the largest dataset ever analyzed using a probabilistic GP model.
  • In prediction performance assessments, the nonstationary model was better in 62% of experiments for MSPE, 96% for log-score, and 92% for CRPS compared to the stationary model.
  • The nonstationary model's confidence interval coverage was substantially closer to theoretical values than the stationary model.
  • The computational time for prediction on the Cheyenne supercomputer was 35 seconds per node (with 36 cores each), demonstrating efficient parallelization.

Limitations and Future Work

  • Identifiability Issues: The paper notes that identifiability issues can arise when both the covariance parameters (like $\Sigma_s$) and the smoothness parameter ($\nu$) are spatially varying.
  • Data Gaps: While the model handles gaps well, the quality of local parameter estimates can be affected by insufficient observations in small areas, requiring careful handling (e.g., eliminating estimates from points with too few observations).
  • Future Work: The authors plan to use these statistically rigorous, full-coverage global data products to study SST gradients with proper uncertainties, which is important for understanding atmosphere-ocean coupling, climate change impacts on upwelling, and coastal fisheries. They also anticipate that future satellite instruments with even higher resolution will further strengthen the need for such advanced methodologies.

Summary updated

Abstract

Earth-observing satellite instruments obtain a massive number of observations every day. Despite their size, such datasets are incomplete and noisy, necessitating spatial statistical inference to obtain complete, high-resolution fields with quantified uncertainties. Such inference is challenging due to the high computational cost and the nonstationary behavior of environmental processes on a global scale. Classical methods for constructing complete maps of environmental variables can be overly simplistic and result in opaque uncertainties, thereby limiting the scientific application of these data. In this work, we address the need to construct complete, high resolution maps of geophysical processes (Level 3 data) from incomplete, noisy, georeferenced observations (Level 2 data). We develop a multi-resolution approximation (<i>M</i>-RA) of a Gaussian process (GP) whose nonstationary, global covariance function is obtained using local fits. We consider sea surface temperature (SST) as an application to illustrate the workflow and our computational implementation. The <i>M</i>-RA requires domain partitioning, which can be application-specific. In the SST case, we partition the domain purposefully to account for and weaken dependence across land barriers. Our <i>M</i>-RA implementation is tailored to distributed-memory computation in high-performance-computing environments. We analyze a Moderate Resolution Imaging Spectroradiometer (MODIS) SST dataset consisting of more than 43 million observations, to our knowledge the largest dataset ever analyzed using a probabilistic GP model. We show that our nonstationary model based on local fits provides substantially improved predictive performance relative to a stationary approach, which already improves upon current methods. Supplementary materials for this article are available online.
BibTeX
@article{huang2021nonstationary,
  author = {Huang Huang and Lewis R. Blake and Matthias Katzfuß and Dorit Hammerling},
  title = {{Nonstationary Spatial Modeling of Massive Global Satellite Data}},
  journal = {Journal of Computational and Graphical Statistics},
  year = {2021},
}
Figure