Mitigating Temporal Data Gaps in Optical Remote Sensing

24 concepts25 papers1 proposal

Optical remote sensing has revolutionized our ability to monitor the Earth by providing high-resolution spectral data. By tracking changes in surface reflectance over time, researchers can map crop growth, estimate forest carbon sinks, and detect environmental disasters.

However, optical sensors share a fundamental vulnerability: they cannot see through clouds, thick aerosols, or adverse atmospheric conditions. When a satellite passes over a cloud-covered region, that observation is effectively lost. This creates temporal data gaps—irregular, unpredictable intervals of missing data in what should be a continuous time series.

In fields like precision agriculture and climate science, these gaps occur at the worst possible times. Because cloud cover is often tied to seasonal weather shifts, data is frequently lost during critical biological transition windows, such as early-season crop emergence or rapid ice melts. Overcoming these gaps is not just a matter of data cleanup; it requires a fundamental rethinking of how models process time-series observations.

Why Simple Interpolation Fails

A common baseline approach to missing data is temporal interpolation—simply drawing a straight line or a smooth curve between the nearest available cloud-free observations. While intuitive, this assumption breaks down in real-world applications for three core reasons:

  1. Missing Short-Lived Events: Agricultural and environmental events can happen rapidly. As Tilemachos Moumouris et al. demonstrate in Large Scale Mowing Event Detection on Dense Time Series Data Using Deep Learning Methods and Knowledge Distillation, persistent cloud cover can completely hide short-lived events like grass mowing or create artificial dips in vegetation indices, leading to severe interpolation errors.
  2. Hidden Atmospheric Biases: Even when data appears "clean" after cloud removal, residual atmospheric interference remains. Yao Zhang 0004 et al. showed in Monitoring the impact of aerosol contamination on the drought-induced decline of gross primary productivity that standard temporal filling products often retain strong correlations with aerosol optical depth. This means models can mistake atmospheric haze for actual changes in vegetation health, distorting long-term trend analysis.
  3. Breaking Sequential Models: Modern deep learning models and physical data assimilation pipelines rely on a steady, predictable cadence of updates. Zhongxin Chen et al. (Application of Crop Model Data Assimilation With a Particle Filter for Estimating Regional Winter Wheat Yields) and Liangliang ZHANG et al. (Rapid assessment of maize chilling damage based on GEE) both emphasize that irregular observation intervals prevent data assimilation techniques from reliably updating real-time crop growth simulations. When a model goes blind for weeks during a critical growth phase, its predictive trajectory drifts drastically.

These limitations degrade downstream performance across a variety of tasks, from field-scale yield prediction (Dino Ienco et al. in Out-of-year corn yield prediction at field-scale using Sentinel-2 satellite imagery and machine learning methods) to parcel-level cropland segmentation (Chen Du et al. in PARCS: A Deployment-Oriented AI System for Robust Parcel-Level Cropland Segmentation of Satellite Images).

Strategy 1: Active Sensing via Radar Fusion

To build a continuous observation pipeline, researchers frequently turn to Synthetic Aperture Radar (SAR). Unlike optical sensors, radar emits its own microwave signals, which easily penetrate clouds and aerosols to measure surface roughness and moisture.

SAR does not directly capture the chemical signatures of vegetation (like chlorophyll absorption), but it provides a structural scaffold that remains unbroken by weather. Researchers use this property in two distinct ways:

Strategy 2: Cross-Resolution Generative Modeling

When alternative modalities like radar are unavailable, deep learning can exploit the inherent trade-offs of satellite constellations. In remote sensing, you rarely get high spatial resolution and high temporal frequency from the same sensor. Coarse-resolution satellites (like MODIS) pass over the Earth daily, making it highly likely they will catch a cloud-free window, whereas high-resolution satellites (like Sentinel-2) have revisit cycles of several days, meaning a single cloudy day can cause a multi-week data gap.

Coarse-Res (Daily)   [ O ] [ O ] [ X ] [ O ] [ O ]  <- High chance of cloud-free views
High-Res (Weekly)    [ O ] . . . . . . [ X ] . . .  <- Missing one view creates massive gap
Fused Latent State   [===========================]  <- Continuous, high-resolution tracking

Xiaowei Jia et al. capitalized on this dynamic in Recurrent Generative Networks for Multi-Resolution Satellite Data: An Application in Cropland Monitoring. They introduced MARSM, a generative framework that uses Variational Recurrent Neural Networks (VRNNs) to fuse coarse-frequency and fine-resolution imagery. Instead of performing a static interpolation, the recurrent network learns the underlying latent physics of land-surface dynamics. When a high-resolution observation is missing, the model uses the daily coarse-resolution trend to guide the generation of the missing high-resolution details, maintaining a continuous, high-fidelity record over time.

Strategy 3: Multi-Modal Predictive Forecasting

The most recent shift in handling temporal gaps moves away from retrospective imputation (filling in the past) toward predictive forecasting. If a model understands how environmental drivers—such as temperature, rainfall, and soil moisture—cause vegetation to change, it can simulate what the land surface looks like behind a cloud layer.

This is the core intuition behind the work of Vitus Benson et al. in Multi-Modal Learning for Geospatial Vegetation Forecasting. They developed Contextformer, a transformer-based architecture designed to ingest both satellite imagery and continuous meteorological data.

When clouds obscure the optical sensors, Contextformer maintains temporal consistency by relying on the weather data stream. Because meteorological variables are unaffected by cloud cover, the transformer can synthesize the historical vegetation trend with the recent weather context to accurately forecast and reconstruct missing surface observations. This shifts the problem from a missing-data struggle to a multi-modal synthesis task, allowing continuous tracking across highly volatile environmental transition periods.

History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_temporal_data_gaps_e8a4d35a,
  title = {temporal data gaps},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/temporal-data-gaps/rdr_e8a4d35a456947e99ec7ba0cdc5e20eb},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_temporal_data_gaps_e8a4d35a_v1,
  title = {temporal data gaps},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/temporal-data-gaps/rdr_e8a4d35a456947e99ec7ba0cdc5e20eb/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake