Faster Annotation for Elevation-Guided Flood Extent Mapping by Consistency-Enhanced Active Learning

Saugat Adhikari, Da Yan, Tianyang Wang, Landon Dyken, Sidharth Kumar, Lyuheng Yuan, Akhlaque Ahmad, Jiao Han, Yang Zhou, Steve Petruzza

Abstract

Accurate flood mapping is critical for disaster response, yet the scarcity of labeled high-resolution satellite imagery creates a significant bottleneck. Manual annotation is labor-intensive, often taking hours per image due to complex terrain and obstructions. This paper introduces ALFA (Active Learning for Flood Annotation), an interactive framework that combines a physics-aware neural network with a novel consistency-enhanced active learning strategy. By integrating elevation data and identifying informative regions through prediction inconsistencies, ALFA reduces annotation time from hours to approximately 20 minutes per image while achieving high accuracy.

Introduction

During a disaster, flood mapping is a race against time. While satellite imagery is increasingly available, the labels required to train AI models are scarce. Existing datasets are often too small for robust generalization, and manual labeling remains the primary bottleneck. Experts must painstakingly outline jagged flood boundaries, often obscured by buildings or tree canopies. ALFA addresses this "annotation bottleneck" by facilitating a collaborative workflow between humans and AI, maximizing the impact of every user interaction.

Methodology

The ALFA framework is built upon four primary pillars designed to streamline the labeling process:

  1. Elevation-Guided BFS: Utilizing the physical properties of water, the system employs a Breadth-First Search (BFS) algorithm. When a user marks a pixel as "flooded," the system automatically labels all connected lower-elevation pixels (pit-filling). Conversely, marking a "dry" pixel propagates the label to higher elevations (hill-climbing).
  2. Consistency-Enhanced Active Learning: Rather than relying solely on model uncertainty, ALFA identifies informative regions by looking for View Consistency (robustness across image rotations) and Temporal Consistency (stability of predictions across training cycles).
  3. Superpixel Recommendations: The system recommends clusters of similar pixels (superpixels) that the model finds most confusing, allowing users to label large areas with single clicks.
  4. EvaNet: A lightweight U-Net variant that integrates Digital Elevation Model (DEM) data directly into its architecture, ensuring the model respects physical flow constraints.
The ALFA system architecture, illustrating the integration of EvaNet, consistency checks, and the active learning loop for superpixel recommendation.

Datasets and Evaluation

The researchers evaluated ALFA using high-resolution aerial imagery and DEM data from two major events: Hurricane Matthew (2016) in North Carolina and Hurricane Harvey (2017) in Texas. To handle visual obstructions, a "tree score" derived from a separate model (ForestNet) was used to filter out ambiguous areas under dense canopy, keeping the user focused on high-impact regions.

Key Results

Experimental results demonstrate that ALFA significantly outperforms traditional manual and automated baselines:

  • Massive Speedup: In user studies with domain experts, the median time to annotate a region dropped from several hours to approximately 20 minutes.
  • Superior Accuracy: The ALFA-PO variant (using probability offset) consistently achieved higher F1 scores and mIoU than random sampling or standard active learning methods like PixelPick.
  • Rapid Convergence: The model typically reaches high performance (F1 > 90%) very early in the annotation process, requiring only a small fraction of the total image to be labeled.
Comparison of manual vs. AL-assisted annotation time across five distinct regions, demonstrating a reduction in effort of up to 80%.

Discussion and Future Work

ALFA demonstrates that incorporating physical laws and prediction robustness can dramatically accelerate geospatial data labeling. While the current system uses a lightweight model for interactivity, future work could involve using ALFA to generate high-quality labels for fine-tuning massive geo-foundation models. Additionally, while the elevation-guided BFS is highly effective in rural and suburban areas, more sophisticated modeling may be required for dense urban environments with complex man-made drainage systems.

Summary updated

Abstract

Flood extent mapping is crucial for disaster response and damage assessment. While Earth imagery and terrain data (in the form of DEM) are now readily available, there are few flood annotation data for training machine learning models, which hinders the automated mapping of flooded areas. We propose ALFA, an interactive active-learning-based approach to minimize the annotators' efforts when preparing the ground-truth flood map in a satellite image. ALFA calibrates the prediction consistency of a segmentation model (1) across training cycles and (2) for various data augmentations. The two consistencies are integrated into the design of both the acquisition function and the loss function to enhance the robustness of active learning with limited annotation inputs. ALFA recommends those superpixels that the underlying model is most uncertain about, and users can annotate their pixels with minimal clicks with the help of elevation guidance. Extensive experiments on various regions hit by flooding show that we can improve the annotation time from hours to around 20 minutes. ALFA is open sourced at https://github.com/saugatadhikari/alfa.
BibTeX
@inproceedings{adhikari2025faster,
  author = {Saugat Adhikari and Da Yan and Tianyang Wang and Landon Dyken and Sidharth Kumar and Lyuheng Yuan and Akhlaque Ahmad and Jiao Han and Yang Zhou and Steve Petruzza},
  title = {{Faster Annotation for Elevation-Guided Flood Extent Mapping by Consistency-Enhanced Active Learning}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2025},
  doi = {10.24963/ijcai.2025/1057},
}
Figure