Disaggregation of SMAP L3 Brightness Temperatures to 9km using Kernel Machines

Subit Chakrabarti, Tara Bongiovanni, Jasmeet Judge, Anand Rangarajan, Sanjay RankaarXiv 2016 · arXiv

TL;DR

When the NASA SMAP satellite's radar failed in 2015, it left a massive resolution gap in global soil moisture data. This paper introduces a machine learning framework that uses kernel-based regression and unsupervised image segmentation to "disaggregate" coarse 36km thermal data down to 9km, effectively filling the hardware gap using only passive radiometer data and auxiliary high-resolution environmental products.

What Problem Does This Paper Address?

The Soil Moisture Active Passive (SMAP) mission was designed to provide high-resolution soil moisture maps by combining two instruments: a coarse-resolution (36km) passive radiometer and a high-resolution (3km) active radar. By merging these, scientists could achieve a "sweet spot" resolution of 9km. However, in July 2015, the SMAP radar suffered a permanent hardware failure.

This left researchers with a dilemma: how do you maintain 9km resolution when your primary high-res instrument is dead? Existing "downscaling" methods often require high-resolution ground truth data for training (which is rarely available) or rely on simple linear models that fail to capture the complex, non-linear relationships between soil moisture, vegetation, and weather. The authors aim to solve this by creating a model that learns these relationships directly from the available coarse data without needing in-situ training sites.

Methods

The authors propose an enhanced Self-Regularized Regressive Model (SRRM). The process follows two main stages:

  1. Unsupervised Segmentation: Instead of applying one global model to an entire region, the algorithm first clusters the study area into segments of "radiometric similarity." It uses an information-theoretic approach—the Cauchy-Schwarz cost function—to group pixels that share similar meteorological and land-cover characteristics.
  2. Kernel-Based Regression: For each segment, the model trains a Support Vector Regression (SVR). SVRs are powerful because they use "kernels" (specifically the Radial Basis Function in this study) to map data into high-dimensional spaces where non-linear relationships become easier to model.

The workflow is clever: the model is trained at the 36km scale (comparing coarse satellite data to aggregated auxiliary data). Once the relationship is learned, it is applied to the fine-scale (9km or 1km) auxiliary data to predict the high-resolution brightness temperature ($T_B$).

The multi-scale SRRM workflow: from coarse 36km data to disaggregated 9km results.

Datasets

The study focused on a 320 × 560 km² region in Iowa, USA, during the 2015 growing season. The authors utilized a variety of satellite products to provide the "context" needed for downscaling:

  • Primary Data: SMAP L1C Brightness Temperature (36km).
  • Auxiliary Features:
    • NASA Aqua/Terra: Land Surface Temperature (LST), NDVI, and EVI (1km).
  • NASA GPM: Precipitation data (0.1°).
  • USDA NASS-CDL: High-resolution Land Cover (30m).
  • Soil Texture: Volumetric ratios of sand, clay, and silt.
Summary of satellite observations and auxiliary data products used in the study.

Key Insights and Ideas

  • Localization Matters: By segmenting the image first, the model avoids the "one size fits all" trap. A regression model that works for a cornfield might fail for a nearby forest; clustering ensures the SVR is specialized for the local terrain.
  • Non-Linearity is Essential: Soil moisture doesn't relate to vegetation or temperature in a straight line. The use of kernel machines allows the model to capture "complex non-linear correlations" that simpler second-order metrics miss.
  • Spatial Regularization: Unlike pixel-by-pixel methods that produce "salt and pepper" noise, the SRRM uses spatial information to regularize the results, leading to smoother, more physically plausible maps.

Key Results

The algorithm was validated against the actual SMAP 9km product (from the brief period before the radar failed).

  • High Accuracy: The mean difference between the disaggregated data and the official product was $\leq$ 5K, even in heavily vegetated areas.
  • Noise Reduction: The disaggregated product was significantly smoother, with a standard deviation 7K lower than the official active-passive product, suggesting the machine learning approach filtered out significant noise.
  • Robustness: The model performed well even when certain data (like LST) were missing due to cloud cover, demonstrating its utility for real-world operational use.
The study area in Iowa, showing the distribution of sand, clay, and silt used as auxiliary soil texture features.

Limitations and Future Work

  • Temporal Mismatch: The authors noted a 4-hour time lag between SMAP observations and GPM precipitation data. This lag can lead to underestimations of $T_B$ in areas with rapid rainfall changes.
  • Smoothing Bias: While lower standard deviation indicates less noise, there is a risk that the model might be too smooth, potentially masking very fine-scale extreme soil moisture events.
  • Geographic Scope: The study was limited to the relatively flat, agricultural landscape of Iowa. Future work is needed to see how this kernel-based approach handles more topographically complex regions like mountains or urban environments.

Summary updated

Abstract

In this study, a machine learning algorithm is used for disaggregation of SMAP brightness temperatures (T$_{\textrm{B}}$) from 36km to 9km. It uses image segmentation to cluster the study region based on meteorological and land cover similarity, followed by a support vector machine based regression that computes the value of the disaggregated T$_{\textrm{B}}$ at all pixels. High resolution remote sensing products such as land surface temperature, normalized difference vegetation index, enhanced vegetation index, precipitation, soil texture, and land-cover were used for disaggregation. The algorithm was implemented in Iowa, United States, from April to July 2015, and compared with the SMAP L3_SM_AP T$_{\textrm{B}}$ product at 9km. It was found that the disaggregated T$_{\textrm{B}}$ were very similar to the SMAP-T$_{\textrm{B}}$ product, even for vegetated areas with a mean difference $\leq$ 5K. However, the standard deviation of the disaggregation was lower by 7K than that of the AP product. The probability density functions of the disaggregated T$_{\textrm{B}}$ were similar to the SMAP-T$_{\textrm{B}}$. The results indicate that this algorithm may be used for disaggregating T$_{\textrm{B}}$ using complex non-linear correlations on a grid.
BibTeX
@misc{chakrabarti2016disaggregation,
  author = {Subit Chakrabarti and Tara Bongiovanni and Jasmeet Judge and Anand Rangarajan and Sanjay Ranka},
  title = {{Disaggregation of SMAP L3 Brightness Temperatures to 9km using Kernel Machines}},
  year = {2016},
  eprint = {1601.05350},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1601.05350},
}
Figure