TopoAL: An Adversarial Learning Approach for Topology-Aware Road Segmentation

Subeesh Vasu, Mateusz Kozinski, Leonardo Citraro, Pascal Fua

Introduction

Extracting road networks from aerial and satellite imagery is a fundamental task for modern cartography, urban planning, and autonomous navigation. Traditionally, this is framed as a binary segmentation problem where a Convolutional Neural Network (CNN) classifies each pixel as "road" or "background." However, standard pixel-wise loss functions, such as Binary Cross-Entropy (BCE), treat all pixels with equal weight.

In the context of road networks, this approach is flawed. A few missing pixels in the middle of a highway might have a negligible impact on overall pixel accuracy, but they create a "broken" road that is useless for routing. Standard Generative Adversarial Networks (GANs) also struggle to address this, as a global discriminator often fails to provide the fine-grained feedback needed to fix small, local connectivity errors. To bridge these gaps, the authors introduce TopoAL (Topology-Aware Adversarial Learning), a specialized framework designed to ensure road networks are not just visually plausible but topologically sound.

The TopoAL Framework

TopoAL adapts the adversarial learning paradigm specifically for curvilinear structures. The system consists of a generator (any standard segmentation network like UNet or DRU) and a novel multi-scale discriminator.

Overview of the TopoAL architecture, featuring a segmentation generator and a multi-scale discriminator that focuses on topological connectivity.

The core innovation lies in how the discriminator evaluates the generator's output. Instead of a single "real vs. fake" scalar, the discriminator produces a label pyramid, assessing the road network at multiple scales (from $32 \times 32$ local patches up to the full image). This allows the model to pinpoint local interruptions that would be overlooked in a global view.

To maintain end-to-end differentiability while working with binary masks, the framework employs a Straight-Through Estimator (STE). This allows gradients to bypass the non-differentiable thresholding step during training. Furthermore, to prevent the discriminator from being distracted by minor misalignments (false positives), the authors use a dilated version of the ground truth to mask the prediction. This forces the discriminator to focus exclusively on "missing" road segments (false negatives) that cause disconnections.

Multi-Scale Topology Supervision

A key challenge in training such a system is defining what "topologically correct" means for a discriminator. TopoAL uses a Dynamic Label Assignment strategy. During training, the discriminator's labels are generated on-the-fly by comparing the generator's prediction to the ground-truth skeleton.

Illustration of topological correctness labeling. The model identifies local breaks (red boxes) and generates a multi-scale label pyramid to guide the generator.

If a specific patch in the prediction contains a road interruption of at least 4 pixels compared to the ground truth, it is labeled as "topologically incorrect." This spatial map of correctness provides the generator with precise, localized feedback on where connectivity needs to be restored. Additionally, the discriminator receives the original satellite image as an extra input channel, providing the necessary context to distinguish between intentional dead-ends and erroneous breaks caused by shadows or tree canopies.

Experimental Evaluation

The researchers benchmarked TopoAL on the RoadTracer dataset, which includes high-resolution imagery from 40 cities across six countries. This dataset is particularly challenging due to extreme variations in urban and rural appearances and heavy occlusions.

The results demonstrate that TopoAL consistently outperforms standard segmentation baselines and previous topology-aware methods. On the RoadTracer benchmark, the DRU-TopoAL variant achieved state-of-the-art results in critical metrics such as Average Path Length Similarity (APLS) and Junction F1-score (JUNCT). Specifically, TopoAL improved the Too Long/Too Short (TLTS) score—a measure of path length accuracy—from 0.323 (standard UNet) to 0.388. Qualitatively, the model excels at "filling in" roads hidden by trees or shadows, where traditional models typically fail.

Conclusion and Future Directions

TopoAL represents a significant step forward in making deep learning models "topology-aware." By shifting the focus from global pixel accuracy to local connectivity through a multi-scale discriminator, the framework produces road networks that are far more suitable for real-world navigation.

While the current method is highly effective, extremely dense tree cover remains a hurdle. The authors suggest that the TopoAL framework is generalizable beyond road networks. Future work could extend this approach to 3D volumetric data for biomedical applications, such as mapping complex networks of blood vessels, axons, or dendrites in the brain.

Summary updated

Abstract

Most state-of-the-art approaches to road extraction from aerial images rely on a CNN trained to label road pixels as foreground and remainder of the image as background. The CNN is usually trained by minimizing pixel-wise losses, which is less than ideal to produce binary masks that preserve the road network's global connectivity. To address this issue, we introduce an Adversarial Learning (AL) strategy tailored for our purposes. A naive one would treat the segmentation network as a generator and would feed its output along with ground-truth segmentations to a discriminator. It would then train the generator and discriminator jointly. We will show that this is not enough because it does not capture the fact that most errors are local and need to be treated as such. Instead, we use a more sophisticated discriminator that returns a label pyramid describing what portions of the road network are correct at several different scales. This discriminator and the structured labels it returns are what gives our approach its edge and we will show that it outperforms state-of-the-art ones on the challenging RoadTracer dataset.
BibTeX
@inproceedings{vasu2020topoal,
  author = {Subeesh Vasu and Mateusz Kozinski and Leonardo Citraro and Pascal Fua},
  title = {{TopoAL: An Adversarial Learning Approach for Topology-Aware Road Segmentation}},
  booktitle = {European Conference on Computer Vision},
  year = {2020},
  doi = {10.1007/978-3-030-58583-9\_14},
}
Figure