KPMapNet: Keypoint Representation Learning for Online Vectorized High-Definition Map Construction

Bicheng Jin, Wenyu Hao, W. Qiu, Shanmin PangSensors 2025 · DOI

TL;DR

This paper introduces KPMapNet, a novel framework for online construction of vectorized High-Definition (HD) maps for autonomous driving. It tackles the issue of shape distortion in existing methods by proposing a keypoint fine-tuning strategy for ground truth representation and a new point-to-line matching loss, achieving state-of-the-art performance on benchmark datasets.

What Problem Does This Paper Address?

Autonomous driving systems rely heavily on High-Definition (HD) maps to understand their environment for tasks like trajectory forecasting and path planning. Traditionally, these maps are created manually, which is time-consuming and costly. While recent efforts focus on generating HD maps online using sensor data, existing methods often represent map elements (like lane dividers or pedestrian crossings) as sequences of points. A common approach is to use equidistant sampling to ensure a fixed number of points, but this can distort the original shape, especially at curves and corners, leading to errors that propagate to downstream tasks. Furthermore, subtle and sparse annotations in datasets can make it difficult for detection-based models to capture fine structural details.

Methods

KPMapNet introduces several key innovations to address these challenges:

  • Keypoint Fine-Tuning for Ground Truth: Instead of equidistant sampling, KPMapNet refines the ground truth representation. It first identifies "key points" that capture essential shape features and then uses "collinear filler points" to maintain a consistent number of points. A novel matching algorithm aligns these key points with an equidistant set to create a fine-tuned representation that better preserves the original geometry.
  • BEV Mask Fusion Module: This module enhances the Bird's-Eye View (BEV) features by incorporating a rasterized map mask. This fusion helps to emphasize salient spatial and semantic information, improving the model's ability to distinguish map elements from background noise and capture detailed shapes.
  • Hybrid Attention Decoder: The decoder uses a combination of "instance queries" and "point queries." Instance queries are dynamically updated to capture instance-specific features, and they are fused with BEV features to improve initialization. This hybrid approach allows for more effective detection of both category and geometric details.
  • Point-to-Line Matching Loss: To accommodate the non-equidistant nature of the fine-tuned ground truth, a new loss function is proposed. It calculates the L1 distance for key points directly and for collinear points, it projects them onto the predicted line, ensuring more accurate alignment.

Datasets

The proposed KPMapNet is evaluated on two widely recognized datasets for autonomous driving:

  • NuScenes: This dataset contains 1000 driving scenarios with multi-view RGB images, LiDAR point clouds, and annotated 2D map instances.
  • Argoverse2: This dataset includes 1000 scenarios with 3D map annotations from six U.S. cities, featuring data from LiDAR, stereo cameras, and ring cameras.

The experiments focus on three static map element categories: pedestrian crossing (ped.), lane divider (div.), and road boundary (bou.).

Key Insights and Ideas

  • Ground Truth Representation Matters: The paper strongly emphasizes that how ground truth map elements are represented significantly impacts downstream model performance. Simply using equidistant points can introduce subtle but critical geometric errors.
  • Keypoints as Shape Anchors: Identifying and preserving key points that define the essential shape of map elements is crucial for accurate representation, especially for complex curves and corners.
  • Masks Enhance Spatial Understanding: Integrating rasterized map masks into BEV features provides a richer contextual understanding, helping the model to better localize and represent map elements.
  • Point-to-Line for Non-Uniform Data: The development of a point-to-line loss function is a clever adaptation to handle the non-uniform spacing of points in the refined ground truth, which is a common challenge when moving away from simple equidistant sampling.

Key Results

KPMapNet achieves state-of-the-art performance on both datasets:

  • NuScenes: 75.1 mAP (mean Average Precision) with the VoVNetV2-99 backbone and 74.2 mAP with the ResNet50 backbone. These results show significant improvements over previous methods like MapTRv2, especially for complex elements like pedestrian crossings and road boundaries.
  • Argoverse2: 74.2 mAP with the ResNet50 backbone, outperforming previous state-of-the-art methods.

Qualitative results (visualizations) further demonstrate the improved accuracy of KPMapNet in generating map shapes, particularly for complex instances.

Limitations and Future Work

  • Limitations: The paper notes that the initial integration of keypoint fine-tuning slightly increased the network's learning complexity. While subsequent components resolved this, it highlights a trade-off. The ablation study also shows that excessively high or low weights for the point-line matching loss can degrade performance.
  • Future Work: The authors suggest future research will focus on integrating multimodal sensor data and temporal information to create more holistic and robust representations of the driving environment. This is expected to further enhance vectorized map detection systems and contribute to more reliable autonomous driving solutions.

Summary updated

Abstract

Vectorized high-definition (HD) map construction is a critical task in the autonomous driving domain. The existing methods typically represent vectorized map elements with a fixed number of points, establishing robust baselines for this task. However, the inherent shape priors introduce additional shape errors, which in turn lead to error accumulation in the downstream tasks. Moreover, the subtle and sparse nature of the annotations limits detection-based frameworks in accurately extracting the relevant features, often resulting in the loss of fine structural details in the predictions. To address these challenges, this work presents KPMapNet, an end-to-end framework that redefines the ground truth training representation of vectorized map elements to achieve precise topological representations. Specifically, the conventional equidistant sampling method is modified to better preserve the geometric features of the original instances while maintaining a fixed number of points. In addition, a map mask fusion module and an enhanced hybrid attention module are incorporated to mitigate the issues introduced by the new representation. Moreover, a novel point-line matching loss function is introduced to further refine the training process. Extensive experiments on the nuScenes and Argoverse2 datasets demonstrate that KPMapNet achieves state-of-the-art performance, with 75.1 mAP on nuScenes and 74.2 mAP on Argoverse2. The visualization results further corroborate the enhanced accuracy of the map generation outcomes.
BibTeX
@inproceedings{jin2025kpmapnet,
  author = {Bicheng Jin and Wenyu Hao and W. QIU and Shanmin Pang},
  title = {{KPMapNet: Keypoint Representation Learning for Online Vectorized High-Definition Map Construction}},
  booktitle = {Sensors},
  year = {2025},
  doi = {10.3390/s25061897},
}
Figure