SAMBoost: Spatially Aware Mesh Boosting

Mulah Moriah, Franck Vermet, Pierre Ailliot, Juliette LegrandarXiv 2026 · arXiv

TL;DR

SAMBoost (Spatially Aware Mesh Boosting) is a novel gradient boosting framework that jointly learns complex, non-linear covariate interactions and an interpretable, latent spatial field. By leveraging a sparse mesh-based representation of spatial processes, it achieves a 16x speedup over traditional Bayesian methods, making it capable of processing millions of records while maintaining the rigorous spatial "dissociation" required for applications like insurance risk mapping.

What Problem Does This Paper Address?

In fields like insurance, ecology, and epidemiology, location matters. However, researchers often face a frustrating trade-off. On one hand, Machine Learning (ML) models like XGBoost are excellent at capturing high-dimensional, non-linear interactions between features (covariates), but they often "entangle" spatial signals within the trees, making it impossible to extract a clean geographic risk map. On the other hand, Spatial Statistics models (like INLA) provide beautiful, interpretable spatial fields but struggle with complex, non-linear covariate effects.

Furthermore, most "joint" models that try to do both suffer from a "curse of dimensionality" regarding spatial locations. If you have 100,000 unique locations, traditional Gaussian Process (GP) methods become computationally paralyzed. SAMBoost aims to solve this by providing a model that is flexible, interpretable, and scalable to millions of observations.

Methods

SAMBoost introduces a two-stage boosting loop that optimizes a single penalized objective function. The model assumes an additive predictor: $$F = \text{Intercept} + F_{cov}(\text{features}) + F_{spa}(\text{location})$$

  1. Stage 1 (The Tree Update): The algorithm fits a standard regression tree to the current residuals using only the non-spatial covariates. This captures the non-linear "business logic" of the data.
  2. Stage 2 (The Mesh Update): The algorithm updates a latent spatial field represented on a triangulated mesh. Instead of calculating a dense covariance matrix for every observation point, it uses the Stochastic Partial Differential Equation (SPDE) approach to represent the spatial field as a Gaussian Markov Random Field (GMRF).

The "magic" is in the mesh: because the spatial update is solved on a fixed number of mesh nodes ($M$) rather than observation points ($N$), the computational cost of the spatial component becomes largely independent of the sample size. The resulting precision matrix is sparse, allowing for lightning-fast Cholesky factorizations.

Datasets

The authors evaluated SAMBoost against two primary baselines: GPBoost (a tree/GP hybrid) and INLA (the Bayesian spatial gold standard).

  • Simulated Data: Two scenarios—one with a chequerboard spatial pattern and one with "spatial confounding" (where a covariate is perfectly correlated with a geographic feature, like a river).
  • Lucas County House Prices: A benchmark dataset of ~25,000 home sales in Ohio, used to predict log-selling prices.
  • French Flood Insurance Portfolio: A massive real-world dataset containing 4.9 million policy records. This dataset is highly imbalanced (only 0.22% claim rate) and serves as the ultimate test for scalability.

Key Insights and Ideas

  • Structural Dissociation: One of the most important findings is that SAMBoost prevents "leakage." In traditional ML, if you include coordinates as features, the model might use a spatial proxy to explain a covariate effect. SAMBoost’s two-stage architecture forces a clean separation, ensuring the spatial field represents unobserved geographic risk.
  • Sublinear Scaling: Because the spatial solver operates on the mesh, the training time scales at roughly $N^{0.37}$. This is a massive improvement over the cubic scaling ($N^3$) of exact Gaussian Processes.
  • Robustness to Complexity: The authors show that when covariate effects include complex interactions, additive models like INLA fail, and the "unmodeled" covariate signal bleeds into the spatial map, distorting it. SAMBoost remains stable because its tree component absorbs that complexity.

Key Results

  • Speed: On the 4.9-million-record insurance dataset, SAMBoost trained in just 119 seconds. In comparison, INLA took over 30 minutes, and GPBoost could not even be fitted to the full dataset within a four-hour window (requiring subsampling).
  • Accuracy: In the house price benchmark, SAMBoost achieved the lowest Mean Squared Error (0.244) compared to GPBoost (0.246) and INLA (0.326).
  • Field Recovery: In simulations with spatial confounding, SAMBoost recovered the "true" spatial hotspot more accurately (lower RMSE) than GPBoost, which tended to produce "false positive" patches near confounded covariates.

Limitations and Future Work

  • Point Estimates: Unlike Bayesian methods (INLA), SAMBoost currently provides a point estimate of the spatial field rather than a full posterior distribution. This means it doesn't natively provide "uncertainty maps" (e.g., "we are 95% sure the risk here is high"). The authors suggest a Gaussian approximation at the final boosting round could address this.
  • Hyperparameter Tuning: The spatial range parameter ($\kappa$) currently needs to be tuned via cross-validation, whereas Bayesian models often estimate this internally.
  • Space-Covariate Interactions: The current additive structure assumes that the effect of a covariate (e.g., "building age") is the same everywhere. It cannot currently model "varying coefficients" where a feature's impact changes based on geography.

For those interested in implementation, the authors have released a public Python implementation of SAMBoost on GitHub.

Summary updated

Abstract

We propose SAMBoost (Spatially Aware Mesh Boosting), a gradient boosting method that combines tree-based covariate modelling with a stochastic partial differential equation (SPDE) latent spatial field through a single penalised objective. At each boosting iteration, the predictor is decomposed into separate covariate and spatial components. The method is motivated by applications in which the spatial effect is not a nuisance to be removed but a quantity of interest that must be recovered alongside the covariates. In insurance, for example, practitioners need both flexible nonlinear covariate effects and an interpretable geographic risk surface that can be reported on its own. Existing approaches often involve trade-offs, offering flexible covariate modelling but no explicit spatial field, rigorous spatial inference with a fixed additive covariate structure, or a combination of both at computational costs that limit practicality for large datasets. SAMBoost addresses these goals within the boosting loop, and the underlying mesh produces a sparse precision structure whose cost is largely independent of sample size. On simulations and on an open benchmark, SAMBoost matches or improves on the predictive accuracy of joint Gaussian process and tree boosting approaches. It is also faster and recovers the spatial field and covariate effects more accurately. When covariate effects include interactions, it outperforms additive Bayesian spatial models. Applied to a flood insurance portfolio with 4.9 million records, SAMBoost trains on the full training set without subsampling and runs about sixteen times faster than a Bayesian reference, with a consistent spatial risk surface. A public Python implementation is available.
BibTeX
@misc{moriah2026samboost,
  author = {Mulah Moriah and Franck Vermet and Pierre Ailliot and Juliette Legrand},
  title = {{SAMBoost: Spatially Aware Mesh Boosting}},
  year = {2026},
  eprint = {2611.10373},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.10373},
}
Figure