An Efficient 3D Multi-Object Tracking Algorithm for Low-Cost UGV Using Multi-Level Data Association

Xiaochun Yang, Albert S. Huang, Jin Lou, Junhua Gou, Wenxing Fu, Jie YanDrones 2025 · DOI

TL;DR

This paper introduces an efficient 3D multi-object tracking system for low-cost UGVs that combines 2D image detection with point cloud clustering, avoiding computationally heavy neural networks. Its novel multi-level data association strategy significantly improves tracking robustness, especially in challenging scenarios with occlusions and detection errors, making it practical for resource-constrained platforms.

What Problem Does This Paper Address?

Autonomous navigation in Unmanned Ground Vehicles (UGVs) relies heavily on accurate real-time perception, particularly for detecting and tracking obstacles. Existing 3D object detection and tracking algorithms often depend on powerful GPUs and high-resolution LiDAR sensors, making them unsuitable for cost-sensitive UGV platforms with limited computational resources. These algorithms also struggle with issues like missed detections, false positives, and trajectory fragmentation caused by occlusions or sensor noise. The paper aims to bridge this gap by developing an efficient and robust tracking system that can operate on low-cost hardware.

Methods

The proposed system follows a "tracking-by-detection" paradigm and consists of two main stages:

  • Efficient 3D Object Detection:
    • It starts with a 2D object detector (YOLO with SE modules) to identify potential objects in images.
  • This 2D detection is used to extract a Region of Interest (ROI) from the 3D point cloud data.
  • Unsupervised learning techniques, specifically ground point filtering and DBSCAN clustering, are then applied to the ROI to isolate object point clouds from noise and background. This avoids complex point cloud neural networks.
  • Finally, 3D bounding boxes are generated for the detected objects.
  • Multi-Level Data Association for Tracking:
    • The tracking process involves prediction, data association, and trajectory management.
  • State Prediction: A constant velocity model is used to predict object states, incorporating 2D bounding box information and 3D center coordinates.
  • Multi-Level Data Association: This is the core innovation. Detections are categorized into three groups: high-confidence 3D detections, low-confidence 3D detections, and 2D-only detections (when 3D clustering fails).
  • A Hungarian algorithm is used for matching, prioritizing high-confidence 3D detections.
  • A second stage matches low-confidence 3D detections.
  • Crucially, a third stage handles 2D-only detections, using 2D IoU for association. This prevents trajectory fragmentation when 3D information is temporarily unavailable.
  • Trajectory Management: Standard Kalman filtering is used for updating trajectories, with mechanisms for initializing new tracks and removing old ones.

Datasets

  • KITTI Dataset: Used for accuracy evaluation. Specifically, sequences from the KITTI 3D multi-object tracking dataset were used, with a split into training and validation subsets.
  • Real UGV Platform: Experiments were also conducted on a custom-built UGV platform equipped with a monocular camera and a 32-line LiDAR, operating in real-world campus environments.

Key Insights and Ideas

  • Leveraging 2D for 3D Robustness: The paper demonstrates that by integrating 2D image information, tracking can remain robust even when 3D point cloud data is sparse or noisy due to occlusion or sensor limitations.
  • Unsupervised Clustering for Efficiency: Replacing complex 3D point cloud neural networks with unsupervised methods like DBSCAN for feature extraction significantly reduces computational load, making the system suitable for low-cost hardware.
  • Multi-Level Association as a Key to Fragmentation Prevention: The tiered data association strategy, particularly the dedicated step for handling 2D-only detections, is crucial for maintaining track continuity and preventing fragmentation, a common problem in existing methods.
  • Hardware Agnosticism: The approach is designed to be compatible with low-resolution LiDAR (e.g., 32-line) and GPU-free platforms, broadening its applicability.

Key Results

  • Accuracy: The proposed algorithm achieved superior MOTA (Multi-Object Tracking Accuracy) scores compared to the AB3DMOT baseline on the KITTI dataset, particularly for pedestrians. For example, MOTA for pedestrians reached 81.07% compared to AB3DMOT's 65.06% at an IoU threshold of 0.5.
  • Efficiency: The algorithm demonstrated significant computational efficiency. On an Intel i5-12600 CPU, it achieved a detection time of 0.059s per frame, outperforming other state-of-the-art methods that often require GPUs.
  • Robustness: Experiments on the KITTI dataset and the real UGV platform showed that the algorithm maintained high association accuracy (AssA) even with poor detection performance in dense scenarios, and its multi-level association strategy significantly reduced trajectory fragmentation (FRAG).

Limitations and Future Work

  • Detection Accuracy: While the system is efficient, its detection accuracy is noted to be relatively poorer in scenarios with high object density or mutual occlusion, impacting overall MOTA. The authors acknowledge that their approach doesn't aim to outperform the most advanced (and computationally expensive) methods in pure accuracy.
  • Future Work: The paper suggests that further improvements could be made by integrating more sophisticated modules or replacing YOLO with a more advanced neural network architecture, though this would likely increase computational cost. The current work prioritizes efficiency and deployability on low-cost platforms.

Summary updated

Abstract

3D object detection and tracking technology are increasingly being adopted in unmanned ground vehicles, as robust perception systems significantly improve the obstacle avoidance performance of a UGV. However, most existing algorithms depend heavily on computationally intensive point cloud neural networks, rendering them unsuitable for resource-constrained platforms. In this work, we propose an efficient 3D object detection and tracking method specially designed for deployment on low-cost vehicle platforms. For the detection phase, our method integrates an image-based 2D detector with data fusion techniques to coarsely extract object point clouds, followed by an unsupervised learning approach to isolate objects from noisy point cloud data. For the tracking process, we propose a multi-target tracking algorithm based on multi-level data association. This method introduces an additional data association step to handle targets that fail in 3D detection, thereby effectively reducing the impact of detection errors on tracking performance. Moreover, our method enhances association precision between detection outputs and existing trajectories through the integration of 2D and 3D information, thereby further mitigating the adverse effects of detection inaccuracies. By adopting unsupervised learning as an alternative to complex neural networks, our approach demonstrates strong compatibility with both low-resolution LiDAR and GPU-free computing platforms. Experiments on the KITTI benchmark demonstrate that our tracking framework achieves significant computational efficiency gains while maintaining detection accuracy. Furthermore, experimental evaluations on the real-world UGV platform demonstrated the deployment feasibility of our approach.
BibTeX
@inproceedings{yang2025efficient,
  author = {Xiaochun Yang and Albert S. Huang and Jin Lou and Junhua Gou and Wenxing Fu and Jie Yan},
  title = {{An Efficient 3D Multi-Object Tracking Algorithm for Low-Cost UGV Using Multi-Level Data Association}},
  booktitle = {Drones},
  year = {2025},
  doi = {10.3390/drones9110747},
}
Figure