TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relations

Yifeng Bai, Zhirong Chen, Bo Song, Erkang Cheng, Haibin Ling

TL;DR

TopoHR introduces a novel end-to-end framework for autonomous driving that breaks the traditional sequential pipeline of centerline detection and topology reasoning. By establishing a cyclic interaction loop and utilizing a hierarchical representation that models both fine-grained point-to-instance and global instance-to-instance relationships, the system allows detection and reasoning to mutually enhance each other. This approach achieves a new state-of-the-art on the challenging OpenLane-V2 benchmark.

What Problem Does This Paper Address?

For autonomous vehicles to navigate complex urban environments safely, they need to understand more than just the raw geometry of the road; they must comprehend its topology—how lane centerlines connect to one another and how they relate to traffic elements like signs and signals.

Traditional approaches handle this using a strict, one-way cascade: a centerline detector first extracts lane instances, and a subsequent topology module (often a simple Multi-Layer Perceptron) infers connections. This sequential setup suffers from two major flaws:

  1. Feature Inconsistency: The detector and reasoning modules are optimized separately, meaning geometric features aren't informed by topological context, and vice versa.
  2. Coarse Granularity: Previous methods rely almost entirely on instance-level queries, ignoring the fine-grained, point-level relationships (e.g., exactly where a lane starts or ends) that physically define road connectivity.
Figure 1. Different centerline detection and topology reasoning pipelines. (a) The conventional sequential pipeline. (b) Our cyclic pipeline. (c) Our motivation to integrate point-to-instance (P2I) and point-to-traffic (P2T) relations to boost topology reasoning.

Methods

TopoHR addresses these challenges by introducing a cyclic architecture and a multi-level hierarchical representation.

Figure 2. Overview of TopoHR. Aside from a BEV feature extractor and a traffic element decoder, TopoHR has three notable compo- nents: (a) Hierarchical Centerline Decoder, which employs a hierarchical query representation to simultaneously model point-level and instance-level features through a series of attention mechanisms and integration modules; (b) Hierarchical L2L Topology Module and (c) Hierarchical L2T Topology Module, both of which perform topology reasoning by combining both fine-grained point-to-instance relation- ships and global instance-to-instance topological connections.

Key components include:

  • Iterative Cyclic Enhancement: Instead of a sequential pipeline, TopoHR passes query attention weights forward from the decoder to the topology module, and feeds predicted topological relations back to the decoder as attention masks. This creates a mutually reinforcing loop.
  • Hierarchical Centerline Decoder: Rather than using only instance-level queries, TopoHR augments its representation with point-level queries. It features an Instance-Aware Module (which uses a Discrete Distance Transform mask to focus on relevant spatial regions) and a Point-Aware Module (which uses a point-to-point constrained relation mask to prevent information leakage across different lanes).
  • Hierarchical Integrator: A cross-attention mechanism that seamlessly fuses local point-wise geometric details with global instance-level semantic context.
  • Hierarchical Topology Reasoning Module: This module features two prediction branches that calculate both global Instance-to-Instance (I2I) connections and fine-grained Point-to-Instance (P2I) relationships, combining them for the final topological output.
  • Adaptive Topological Loss (ATL): A dynamic weighting strategy based on reparameterized cross-entropy that applies heavier penalties to high-confidence false positives, preserving topological coherence.

Datasets

The authors evaluated TopoHR on the OpenLane-V2 benchmark, a large-scale dataset for 3D topology map prediction that integrates data from Argoverse2 and nuScenes. The dataset is split into two primary subsets:

  • Subset A: Features seven camera views and highly complex urban scenes.
  • Subset B: Features six camera views.

Performance is measured using standard metrics: Centerline Detection ($\text{DET}_\text{l}$), Traffic Element Detection ($\text{DET}_\text{t}$), Lane-to-Lane Topology ($\text{TOP}_{\text{ll}}$), Lane-to-Traffic Topology ($\text{TOP}_{\text{lt}}$), and an OpenLane Overall Score ($\text{OLS}$).

Key Insights and Ideas

  • Co-Evolution over Cascades: Geometry and topology are intrinsically linked. Knowing that two lanes connect provides a strong prior for where their boundaries lie, just as accurate geometry clarifies connectivity. TopoHR proves that letting these tasks "talk" to each other iteratively yields superior results.
  • Topology Manifests at Points: Lane connectivity isn't an abstract relationship between two entire lane objects; it is anchored to physical locations (e.g., the endpoint of an incoming lane meeting the start point of an outgoing lane). Incorporating Point-to-Instance (P2I) relations captures this reality.
  • Discrete Distance Transforms for Virtual Objects: Centerlines are invisible, virtual constructs without distinct pixel boundaries, making standard binary segmentation difficult. Converting distance values into discrete intervals provides a smoother, geometry-aware spatial prior that significantly stabilizes transformer training.

Key Results

TopoHR achieves significant performance gains over previous state-of-the-art models on OpenLane-V2:

Table 1. Performance comparison with other state-of-the-art methods on OpenLane-V2 subset A benchmark. All compared methods utilize ResNet-50 as the CNN backbone. The best results are highlighted in bold, the second best is underline, and the third best is in italics. (Repr: representation of centerline; #Query: number of centerline queries.)
  • Subset A: TopoHR-L (trained for 48 epochs) achieves a 37.6 $\text{DET}_\text{l}$ (+3.8 over the previous best) and a 34.6 $\text{TOP}_{\text{ll}}$ (+5.4 improvement).
  • Subset B: The model achieves an even larger jump, hitting 43.6 $\text{DET}_\text{l}$ (+11.0) and 39.7 $\text{TOP}_{\text{ll}}$ (+7.9).
  • Efficiency: Despite the multi-level query architecture, the addition of point queries and DDT segmentation only increases the model's parameters by 13.8%. The base TopoHR model runs at 12.6 FPS on a single NVIDIA RTX 4090 GPU.

Limitations and Future Work

While TopoHR sets new performance benchmarks, the authors note a few areas for improvement:

  • Hyperparameter Tuning: The exploration of the Adaptive Topological Loss hyperparameters ($\lambda_{\text{neg}}$ and $\lambda_{\text{pos}}$) was kept limited to prove the baseline concept; exhaustive optimization could yield further gains.
  • Convergence Time: The large-scale variant (TopoHR-L) requires an extended training schedule (48 epochs) to fully converge on complex subsets.
  • Real-Time Deployment: At 12.6 FPS on a high-end desktop GPU, additional optimization or model quantization will likely be required to meet the ultra-low-latency constraints of real-time vehicle deployment.

Summary updated

Abstract

Topology reasoning is crucial for autonomous driving. Current methods primarily focus on instance-level learning for centerline detection, followed by a sequential module for topology reasoning that relies on simplified MLP layers. Moreover, they often neglect the importance of \textit{point-to-instance} (P2I) relationships in topology reasoning. To address these limitations, we present TopoHR (Topological Hierarchical Representation), a novel end-to-end framework that establishes cyclic interaction between centerline detection and topology reasoning, allowing them to iteratively enhance each other. Specifically, we introduce a hierarchical centerline representation including point queries, instance queries, and semantic representations. These multi-level features are seamlessly integrated and fused within a hierarchical centerline decoder. Furthermore, we design a hierarchical topology reasoning module that captures both fine-grained P2I relationships and global instance-to-instance (I2I) connections within a unified architecture. With these novel components, TopoHR ensures accurate and robust topology reasoning. On the OpenLane-V2 benchmark, TopoHR refreshes state-of-the-art performance with significant improvements. Notably, compared with previous best results, TopoHR achieves +3.8 in $\mathrm{DET}_{\text{l}}$, +5.4 in $\mathrm{TOP}_{\text{ll}}$ on $\text{subset_A}$ and +11.0 in $\mathrm{DET}_{\text{l}}$, +7.9 in $\mathrm{TOP}_{\text{ll}}$ on $\text{subset_B}$, validating the effectiveness of the proposed components. The code will be shared publicly at https://github.com/Yifeng-Bai/TopoHR.git.
BibTeX
@inproceedings{bai2026topohr,
  author = {Yifeng Bai and Zhirong Chen and Bo Song and Erkang Cheng and Haibin Ling},
  title = {{TopoHR: Hierarchical Centerline Representation for Cyclic Topology Reasoning in Driving Scenes with Point-to-Instance Relations}},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year = {2026},
  url = {https://openreview.net/forum?id=7h86Gw6QlW},
}
Figure