Abstract
Maximum-Variance Total Variation (MVTV) is a spatial regression framework designed to generate "sharp partitions"—regions of constant value with well-defined boundaries. While traditional methods like CART often over-smooth data and modern convex approaches like CRISP tend to under-smooth, MVTV utilizes a data-adaptive grid-selection heuristic combined with graph-based total variation denoising to find an optimal balance. Evaluations on synthetic benchmarks and real-world crime datasets from Austin and Chicago, alongside human interpretability studies, demonstrate that MVTV produces models that are both more accurate and significantly more interpretable than existing baselines.
Introduction
Spatial data is a cornerstone of decision-making in fields such as epidemiology, urban planning, and criminology. For these data-driven decisions to be actionable, the underlying models must be interpretable to human stakeholders. Humans typically favor spatial models that divide territory into clear, constant-value neighborhoods rather than complex, continuous gradients. However, achieving this "sharp partition" effect while maintaining predictive accuracy remains a challenge for current smoothing algorithms.
The Problem with Existing Methods
Standard smoothing techniques, such as Kriging, often assume global smoothness, which blurs critical boundaries. Conversely, interpretable methods like Classification and Regression Trees (CART) frequently over-smooth, creating regions too coarse to capture local nuances. More recent convex methods, such as CRISP, often under-smooth, resulting in "blurry" maps with thousands of tiny, non-intuitive regions that hinder human comprehension.
Methodology
MVTV addresses these issues through a two-stage automated process:
- Maximum-Variance Grid Selection: Instead of a fixed resolution, MVTV employs a heuristic to select a grid granularity ($q$) that maximizes the sum of variances across all cells. This ensures the grid is fine enough to capture the signal without overfitting to noise.
- Graph-Based Total Variation (TV) Denoising: The model treats grid cells as nodes in a graph and applies a Total Variation penalty. This encourages the merging of adjacent cells into flat "plateaus," resulting in the desired sharp boundaries.
Results and Discussion
The authors compared MVTV against CART and CRISP using synthetic data and crime reports. Visual analysis reveals that MVTV successfully recovers underlying plateaus without the over-smoothing of CART or the fragmentation of CRISP.
Quantitatively, MVTV achieves superior Akaike Information Criterion (AIC) scores, indicating a better balance between model fit and complexity. In a human study involving 207 participants, MVTV-smoothed maps led to significantly higher accuracy in predicting missing values, confirming that the method aligns with human spatial intuition.
Conclusion
MVTV provides a robust, fully automated solution for interpretable spatial smoothing. By prioritizing the creation of sharp partitions, it bridges the gap between high-accuracy statistical modeling and human-centric decision support.
Summary updated