FusionCast: Enhancing Precipitation Nowcasting with Asymmetric Cross-Modal Fusion and Future Radar Priors

Henan Wang, Shengwu Xiong, Yifang Zhang, Wenjie Yin, Chen Zhou, Yuqiang Zhang, Pengfei Duan

TL;DR

FusionCast is a new deep learning framework that significantly improves precipitation nowcasting (0–6 hour rainfall prediction) by integrating historical radar data with water vapor measurements and AI-generated "future priors." By using a novel gating mechanism to fuse these mismatched data types, the model achieves a 33% reduction in error compared to state-of-the-art baselines.

What Problem Does This Paper Address?

Precipitation nowcasting is critical for disaster warning, yet it remains notoriously difficult because weather is a chaotic, multi-scale process. While Doppler radar provides high-resolution snapshots of current rain, it struggles to predict the "growth and decay" of storm cells.

To solve this, researchers often try to "fuse" radar data with other sources, like Precipitable Water Vapor (PWV) from GPS/GNSS stations. However, most existing models use "simple fusion"—essentially just stacking different data types like layers in a sandwich. This is problematic because a dense radar map and a sparse collection of vapor sensors are fundamentally different. Ignoring these differences leads to "feature interference," where the noise from one data source degrades the signal of another, often resulting in blurry or inaccurate forecasts.

Methods

The authors introduce FusionCast, which moves away from simple stacking in favor of an Asymmetric Cross-Modal Fusion approach. The architecture consists of three parallel encoding branches:

  1. PWV Branch: Processes interpolated water vapor grids.
  2. Historical Radar Branch: Processes the last few hours of observed rainfall.
  3. Prior Knowledge Branch: This is a clever "look-ahead" step. It takes the output of a high-performing existing model (NowcastNet) and treats it as a "future prior" to provide positional guidance on where the storm is likely heading.

The core innovation is the Radar–PWV Fusion (RPF) module. Instead of just adding the data together, it uses:

  • Spatial Attention: It treats water vapor as a "spatial energy regulator." If the vapor levels are low, the model suppresses radar signals in that area (since rain is physically unlikely).
  • Channel Attention: It sharpens the radar features to improve the signal-to-noise ratio.
  • Gating Mechanism: A dynamic gate decides how much information from each modality to let through based on the current weather pattern, preventing the "blurring" effect common in older models.

Datasets

The model was evaluated on the Mississippi River Basin (MRB), a region covering 41% of the contiguous U.S. and prone to complex convective storms.

  • Radar Data: Multi-Radar/Multi-Sensor (MRMS) quantitative precipitation estimation (QPE) at 1km resolution.
  • PWV Data: Derived from 743 GNSS stations via the Nevada Geodetic Laboratory.
  • Timeframe: Data spans February 1, 2023, to June 30, 2023, split into training, validation, and test sets.

Key Insights and Ideas

  • The "Future" as an Input: One of the most interesting ideas is using a "prior" from another model. By feeding FusionCast a rough draft of the future (via NowcastNet), the model can focus its "attention" on refining the intensity and texture of the rain rather than just trying to guess where the clouds are moving.
  • Physical Constraints as Gates: The authors didn't just treat PWV as "more pixels." They recognized the physical relationship: water vapor is the fuel for rain. By using PWV as a gate, the model learns a physically motivated "admission criterion" for rainfall.
  • Asymmetry is a Feature: The model uses a deeper feature extraction process for the "Prior Knowledge" branch (increasing filters from 32 to 128). This acknowledges that the "future prior" contains richer semantic context than raw historical observations.

Key Results

FusionCast outperformed established baselines like ConvLSTM, PredRNN, and NowcastNet across all metrics:

  • Continuous Accuracy: It achieved an RMSE of 1.004 mm/h, a massive improvement over NowcastNet (1.500 mm/h) and Optical Flow (1.598 mm/h).
  • Categorical Success: Using the Critical Success Index (CSI), FusionCast showed superior performance across light, moderate, and heavy rain thresholds.
  • Lead Time Robustness: While most models degrade rapidly after 60 minutes, FusionCast maintained significantly higher accuracy at the 120-minute mark, particularly for heavy rainfall (4.0 mm/h threshold), where it scored 0.213 compared to NowcastNet’s 0.208 and ConvLSTM’s 0.000.

Limitations and Future Work

While FusionCast is powerful, it has a few dependencies:

  • Two-Step Pipeline: Because it requires a "future prior" from NowcastNet, the inference process is a two-stage pipeline, which adds computational overhead.
  • Station Density: The PWV data relies on GNSS stations. In regions with sparse sensor networks, the interpolation might become a bottleneck for accuracy.
  • Future Directions: The authors suggest that exploring more sophisticated "future priors" or integrating satellite-based vapor data (which is denser than ground stations) could further enhance the model's global applicability.

Summary updated

Abstract

Deep learning has significantly improved the accuracy of precipitation nowcasting. However, most existing multimodal models typically use simple channel concatenation or interpolation methods for data fusion, which often overlook the feature differences between different modalities. This paper therefore proposes a novel precipitation nowcasting optimisation framework called FusionCast. This framework incorporates three types of data: historical precipitable water vapour (PWV) data derived from global navigation satellite system (GNSS) inversions, historical radar based quantitative precipitation estimation (QPE), and forecasted radar QPE serving as a future prior. The FusionCast model comprises two core modules: the future prior radar QPE processing Module, which forecasts future radar data; and the Radar PWV Fusion (RPF) module, which uses a gate mechanism to efficiently combine features from various sources. Experimental results show that FusionCast significantly improves nowcasting performance.
BibTeX
@misc{wang2026fusioncast,
  author = {Henan Wang and Shengwu Xiong and Yifang Zhang and Wenjie Yin and Chen Zhou and Yuqiang Zhang and Pengfei Duan},
  title = {{FusionCast: Enhancing Precipitation Nowcasting with Asymmetric Cross-Modal Fusion and Future Radar Priors}},
  year = {2026},
  eprint = {2603.13298},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2603.13298},
}

Loading related content...

Figure