BRIGHT: A globally distributed multimodal building damage assessment dataset with very-high-resolution for all-weather disaster response

Hongruixuan Chen, Jian Song, Olivier Dietrich, Clifford Broni-Bediako, Weihao Xuan, Junjue Wang, Xinlei Shao, Yimin Wei, Junshi Xia, Cuiling Lan, Konrad Schindler, Naoto Yokoya

Abstract

Rapid and accurate building damage assessment (BDA) is critical for effective disaster response. However, traditional Earth Observation (EO) methods rely heavily on optical imagery, which is often obstructed by clouds, smoke, or darkness. This paper introduces BRIGHT, the first open-access, globally distributed, multimodal benchmark for BDA. By integrating very-high-resolution (VHR) optical and Synthetic Aperture Radar (SAR) imagery across 14 diverse disaster events, BRIGHT enables the development of robust AI models capable of operating under all-weather conditions. Our benchmarks demonstrate that while SAR is a viable alternative to optical data, the fusion of both modalities yields superior performance in identifying structural damage.

Introduction

When natural or human-made disasters strike, the speed of humanitarian response is directly linked to the availability of accurate situational awareness. Satellite-based remote sensing has become the gold standard for rapid damage mapping. Yet, a significant bottleneck remains: the "optical gap." Most existing building damage assessment models rely on passive optical sensors that require clear skies and sunlight. During hurricanes (heavy cloud cover) or wildfires (thick smoke), these sensors are effectively blinded.

Synthetic Aperture Radar (SAR) offers a solution as an active sensor that penetrates atmospheric obstructions and operates independently of solar illumination. Despite its potential, SAR data is complex to interpret and lacks the large-scale, high-quality labeled datasets necessary for modern deep learning. The BRIGHT dataset addresses this gap, providing a standardized, high-resolution multimodal framework to advance the state of all-weather disaster response.

The BRIGHT Dataset: Scope and Scale

The BRIGHT dataset is distinguished by its geographic diversity and high spatial resolution. It encompasses 14 distinct disaster events, including five natural disaster types (such as earthquakes and floods) and two human-made categories (explosions and armed conflicts).

Key characteristics include:

  • Scale: The dataset contains 384,596 individual building instances across 14 global regions, with a focus on developing countries that are often underrepresented in EO datasets.
  • Resolution: Imagery features very-high-resolution (VHR) ranging from 0.3 to 1 meter per pixel, sourced from commercial providers like Capella and Umbra.
  • Accessibility: Unlike previous datasets with restricted access or lower SAR resolution, BRIGHT is fully open-access, intended to foster community-wide innovation in disaster AI.

Methodology

Creating a multimodal dataset for BDA requires more than simply gathering images; it requires rigorous harmonization and architectural innovation.

Data Harmonization and Registration

One of the primary challenges in multimodal EO is the alignment of optical and SAR data. Even geocoded images often suffer from pixel-level offsets due to different sensor geometries. The BRIGHT team employed EO experts to manually align optical and SAR pairs, ensuring that building footprints in the pre-event optical imagery perfectly correspond to the backscatter patterns in the post-event SAR imagery.

Architectural Strategies

The researchers evaluated two primary modeling strategies:

  1. Direct Segmentation: A unified approach that attempts to map damage directly from the input imagery.
  2. Task Decoupling: A two-stage process that first performs building localization (identifying where buildings are) and then executes damage classification (determining the severity of the impact).

Furthermore, the study established "Zero-shot" and "One-shot" protocols to evaluate cross-event transferability. This simulates real-world scenarios where an AI model must be deployed to a new disaster zone (e.g., an earthquake in Turkey) without having been trained on data from that specific geographic region.

Key Insights and Benchmarking

The Value of Multimodal Fusion

Experimental results indicate that SAR is not merely a backup for optical sensors. Fusing SAR with optical data improves model performance even when clear optical imagery is available. SAR captures unique structural signatures—such as changes in corner reflectors and radar backscatter—that provide a different "view" of structural integrity than visible light.

Performance Results

The authors benchmarked seven state-of-the-art models. ChangeMamba, a Mamba-based architecture, emerged as the leading model:

  • Overall Accuracy (OA): 96.22% on the standard test split.
  • Mean Intersection over Union (mIoU): 67.63%, significantly outperforming traditional CNN-based architectures like UNet.

Crucially, the study tested the viability of SAR-only post-event assessment. When post-event optical data was removed, models remained remarkably robust. For instance, the DamageFormer model achieved a 65.56% mIoU using only SAR, compared to 69.76% using only optical imagery, confirming that SAR is a highly capable primary sensor for rapid response.

Discussion and Future Work

While BRIGHT represents a significant leap forward, several challenges remain. The "signature problem" is a primary hurdle: a building destroyed by fire looks different in SAR than one destroyed by a flood. Generalizing these signatures across different disaster types remains the "Holy Grail" of the field.

Future iterations of the dataset could benefit from:

  • Multi-polarization SAR: Moving beyond single-polarization to provide richer structural details.
  • Geographic Expansion: Increasing data from the Southern Hemisphere to account for diverse architectural styles.
  • 3D Integration: Incorporating LiDAR data to better quantify vertical structural collapse.

Conclusion

The BRIGHT dataset provides the foundational data necessary to move disaster response AI from "fair-weather only" to "all-weather capable." By bridging the gap between optical and SAR modalities, BRIGHT enables the development of models that can provide life-saving information in the immediate, often obscured, aftermath of a catastrophe.

Summary updated

Abstract

Hongruixuan Chen, Jian Song, Olivier Dietrich, Clifford Broni-Bediako, Weihao Xuan, Junjue Wang, Xinlei Shao, Yimin Wei, Junshi Xia, Cuiling Lan, Konrad Schindler, and Naoto Yokoya Abstract. Disaster events occur around the world and cause significant damage to human life and property. Earth observation (EO) data enables rapid and comprehensive building damage assessment, an essential capability crucial in the aftermath of a disaster to reduce human casualties and inform disaster relief efforts. Recent research focuses on developing artificial intelligence (AI) models to accurately map unseen disaster events, mostly using optical EO data. These solutions based on optical data are limited to clear skies and daylight hours, preventing a prompt response to disasters. Integrating multimodal EO data, particularly combining optical and synthetic aperture radar (SAR) imagery, makes it possible to provide all-weather, day-and-night disaster responses. Despite this potential, the lack of suitable benchmark datasets has constrained the development of robust multimodal AI models. In this paper, we present a Building damage assessment dataset using veRy-hIGH-resoluTion optical and SAR imagery (BRIGHT) to support AI-based all-weather disaster response. To the best of our knowledge, BRIGHT is the first open-access, globally distributed, event-diverse multimodal dataset specifically curated to support AI-based disaster response. It covers five types of natural disasters and two types of human-made disasters across 14 regions worldwide, focusing on developing countries where external assistance is most needed. The dataset's optical and SAR images with spatial resolutions between 0.3 and 1 meters provide detailed representations of individual buildings, making it ideal for precise damage assessment. We train seven advanced AI models on BRIGHT to validate transferability and robustness. Beyond that, it also serves as a challenging benchmark for a variety of tasks in real-world disaster scenarios, including unsupervised domain adaptation, semi-supervised learning, unsupervised multimodal change detection, and unsupervised multimodal image matching. The experimental results serve as baselines to inspire future research and model development. The dataset (Chen et al., 2025), along with the code and pretrained models, is available at https://github.com/ChenHongruixuan/BRIGHT and will be updated as and when a new disaster data is available. BRIGHT also serves as the official dataset for the 2025 IEEE GRSS Data Fusion Contest Track II. We hope that this effort will promote the development of AI-driven methods in support of people in disaster-affected areas. How to cite. Chen, H., Song, J., Dietrich, O., Broni-Bediako, C., Xuan, W., Wang, J., Shao, X., Wei, Y., Xia, J., Lan, C., Schindler, K., and Yokoya, N.: BRIGHT: A globally distributed multimodal building damage assessment dataset with very-high-resolution for all-weather disaster response, Earth Syst. Sci. Data Discuss. [preprint], https://doi.org/10.5194/essd-2025-269, in review, 2025. Received: 08 May 2025 – Discussion started: 18 Jun 2025 Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors. Views expressed in the text are those of the authors and do not necessarily reflect the views of the publisher. Download & links Preprint (PDF, 32165 KB) Download & links Preprint (32165 KB) Metadata XML BibTeX EndNote Share document.addEventListener("DOMContentLoaded", function () { const mobileShareElement = document.querySelector(".mobile-native-share"); if (navigator.share) { // Native sharing is available if (mobileShareElement) { mobileShareElement.style.display = "block"; } } else { // Native sharing is NOT available if (mobileShareElement) { mobileShareElement.style.display = "none"; } } });
BibTeX
@misc{chen2025bright,
  author = {Hongruixuan Chen and Jian Song and Olivier Dietrich and Clifford Broni-Bediako and Weihao Xuan and Junjue Wang and Xinlei Shao and Yimin Wei and Junshi Xia and Cuiling Lan and Konrad Schindler and Naoto Yokoya},
  title = {{BRIGHT: A globally distributed multimodal building damage assessment dataset with very-high-resolution for all-weather disaster response}},
  year = {2025},
  eprint = {2501.06019},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2501.06019},
}
Figure