Spatiotemporal modeling of European paleoclimate using doubly sparse Gaussian processes

Seth D. Axen, Alexandra Gessner, Christian Sommer, Nils Weitzel, Álvaro Tejero-CanteroarXiv 2022 · DOI · arXiv

Abstract

Researchers have developed a new spatiotemporal model for European paleoclimate that successfully fuses massive climate simulation datasets with localized fossilized pollen records. By employing "doubly sparse" Gaussian processes (GPs), the team overcame the traditional computational hurdles of GP scaling, creating a continuous, probabilistic map of temperatures from the Last Glacial Maximum (21,000 years ago) to the mid-Holocene. This approach provides a scalable, uncertainty-aware framework for reconstructing past climates, which is essential for understanding historical human migration and cultural evolution.

Introduction

Understanding the Earth's past climate (paleoclimatology) is vital for climate science, archaeology, and anthropology. However, researchers face a significant "data fusion" problem. Information typically comes from two disparate sources: massive, gridded outputs from physical climate simulations and sparse, localized physical evidence like fossilized pollen grains found in lake sediments (proxy records).

Until now, there hasn't been a consensus model that is continuous in both space and time, provides clear uncertainty estimates, and can handle the sheer volume of available data. Gaussian Processes (GPs) are the "gold standard" for this kind of probabilistic modeling, but they usually scale poorly—specifically $O(N^3)$. With over 600,000 data points, a standard GP is computationally intractable.

Methodology

The authors utilize doubly sparse spatiotemporal Gaussian processes to make the computation tractable. The "double" sparsity arises from two mathematical techniques:

  1. Spatial Sparsity (Inducing Variables): Instead of calculating relationships between every data point, the model uses a small set of "inducing points" (100 in this study) to represent the spatial field.
  2. Temporal Sparsity (State-Space Formulation): By treating the temporal dimension as a Markovian process, they can use efficient Kalman filter-style updates, reducing temporal complexity from cubic to linear.

The model was implemented using the $S^2CVI$ (doubly sparse conjugate-computation variational inference) algorithm, allowing for optimization via natural gradients. The training dataset ($N = 661,028$) combined 41,986 site-specific temperature reconstructions from the LegacyClimate 1.0 database with outputs from 10 different climate models via WorldClim 1.4.

Results and Discussion

The model effectively reconciles broad-scale global climate simulations with localized "ground truth" pollen samples. A key advantage of this continuous spatiotemporal approach is its ability to interpolate across time. For example, the model can predict climate states for periods where no simulation data exists, such as 20.5 ka, effectively "filling in the gaps" between major simulated time slices.

Spatiotemporal interpolation of temperature fields showing the model's ability to fill temporal gaps.

Validation using a "leave-one-time-slice-out" test showed high accuracy, with an average posterior predictive error of just 0.05 °C and a mean absolute error of 0.69 °C. Furthermore, 98.9% of all data points fell within three standard deviations of the model's mean, indicating that the uncertainty estimates are well-calibrated.

Model validation metrics including predictive error over time and error density distributions.

Training the model on the full dataset took approximately 36 hours on a single NVIDIA V100 GPU, demonstrating the efficiency of the doubly sparse method compared to traditional GP approaches.

Conclusion and Future Work

While successful, the current model assumes simulation data points are independent and identically distributed (i.i.d.), whereas simulation errors are often spatially correlated. Future work will incorporate a sparse covariance matrix to address this. Additionally, the authors plan to expand the model to multi-output GPs for joint temperature and precipitation modeling and to integrate dating uncertainty from fossil records directly into the variational objective. The ultimate goal is to scale this approach to a global, queryable paleoclimate database.

Summary updated

BibTeX
@misc{axen2022spatiotemporal,
  author = {Seth D. Axen and Alexandra Gessner and Christian Sommer and Nils Weitzel and Álvaro Tejero-Cantero},
  title = {{Spatiotemporal modeling of European paleoclimate using doubly sparse Gaussian processes}},
  year = {2022},
  eprint = {2211.08160},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2211.08160},
}
Figure