SGCCNet: Single-Stage 3D Object Detector With Saliency-Guided Data Augmentation and Confidence Correction Mechanism

Ao Liang, Wenyu Chen, Jian Fang, Huaici Zhao

Abstract

Single-stage point-based 3D object detectors are efficient but often suffer from inadequate learning of low-quality objects (ILQ) and misalignment between localization accuracy and classification confidence (MLC). We propose SGCCNet to address these issues. SGCCNet utilizes a Saliency-Guided Data Augmentation (SGDA) strategy to reduce reliance on salient features and a Confidence Correction Mechanism (CCM) to align classification scores with localization quality. On the KITTI benchmark, SGCCNet achieves 80.82% AP3D on the Moderate level, outperforming existing point-based detectors while maintaining real-time inference speeds.

Introduction

LiDAR-based 3D object detection is critical for autonomous vehicle perception. While single-stage point-based detectors offer lightweight and fast inference, they face two major hurdles. First, Insufficient Learning of Low-Quality Objects (ILQ) occurs because neural networks tend to focus on the most prominent (salient) features, making them fragile when these features are missing. Second, Misalignment between Localization and Classification (MLC) leads to high-confidence scores for poorly localized boxes, which degrades performance during post-processing. SGCCNet is designed to tackle these challenges directly.

Methodology

The SGCCNet architecture integrates novel data augmentation and post-processing techniques into a point-based detection framework.

The overall architecture of SGCCNet, featuring the SGDA pipeline and CCM module.

Saliency-Guided Data Augmentation (SGDA)

To address ILQ, SGDA identifies salient points by calculating how much shifting a point toward the object's centroid affects classification loss. During training, these high-saliency points are intentionally dropped, forcing the model to learn from more subtle, low-quality features. This "differentiable erasure" process makes the model significantly more robust to occlusions and sparse data.

Saliency maps showing the most influential points for different object classes.

Backbone Enhancements

Dropping points can introduce instability. To counter this, SGCCNet includes a Geometric Normalization Module (GNM)—a specialized normalization for local point groups—and Skip Connection Blocks (SCB) to preserve contextual features during downsampling.

Confidence Correction Mechanism (CCM)

CCM addresses the MLC problem by refining classification scores in the post-processing stage. Instead of relying on a single point's prediction, CCM aggregates information from neighboring key points. If multiple neighbors support a high-quality bounding box, the confidence is boosted, ensuring that the best-aligned boxes are preserved during Non-Maximum Suppression (NMS).

Experimental Results

SGCCNet was evaluated on the KITTI 3D Object Detection Benchmark.

  • Accuracy: It achieved 80.82% AP3D for the "Moderate" Car category, surpassing IA-SSD by 2.35% and Fast Point R-CNN by 3.42%.
  • Small Objects: Significant gains were observed for Pedestrians (+1%) and Cyclists (+3.1%) compared to previous state-of-the-art models.
  • Efficiency: The model maintains an inference time of 23ms (~43 FPS), meeting the requirements for real-time autonomous systems.
  • Generality: The SGDA and CCM modules are "plug-and-play," demonstrating performance boosts when integrated into other detectors like 3DSSD.

Conclusion

SGCCNet provides a robust solution for single-stage 3D object detection by addressing the fundamental issues of feature over-reliance and confidence misalignment. While the current implementation uses Farthest Point Sampling (FPS), which may face scaling challenges on extremely dense datasets, its performance on KITTI establishes it as a leading point-based detection framework.

Summary updated

Abstract

The single-stage point-based 3D object detectors have attracted widespread research interest due to their advantages of lightweight and fast inference speed. However, they still face challenges such as inadequate learning of low-quality objects (ILQ) and misalignment between localization accuracy and classification confidence (MLC). In this paper, we propose SGCCNet to alleviate these two issues. For ILQ, SGCCNet adopts a Saliency-Guided Data Augmentation (SGDA) strategy to enhance the robustness of the model on low-quality objects by reducing its reliance on salient features. Specifically, We construct a classification task and then approximate the saliency scores of points by moving points towards the point cloud centroid in a differentiable process. During the training process, SGCCNet will be forced to learn from low saliency features through dropping points. Meanwhile, to avoid internal covariate shift and contextual features forgetting caused by dropping points, we add a geometric normalization module and skip connection block in each stage. For MLC, we design a Confidence Correction Mechanism (CCM) specifically for point-based multi-class detectors. This mechanism corrects the confidence of the current proposal by utilizing the predictions of other key points within the local region in the post-processing stage. Extensive experiments on the KITTI dataset demonstrate the generality and effectiveness of our SGCCNet. On the KITTI \textit{test} set, SGCCNet achieves $80.82\%$ for the metric of $AP_{3D}$ on the \textit{Moderate} level, outperforming all other point-based detectors, surpassing IA-SSD and Fast Point R-CNN by $2.35\%$ and $3.42\%$, respectively. Additionally, SGCCNet demonstrates excellent portability for other point-based detectors
BibTeX
@misc{liang2024sgccnet,
  author = {Ao Liang and Wenyu Chen and Jian Fang and Huaici Zhao},
  title = {{SGCCNet: Single-Stage 3D Object Detector With Saliency-Guided Data Augmentation and Confidence Correction Mechanism}},
  year = {2024},
  eprint = {2407.01239},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2407.01239},
}
Figure