A Bidirectional Scoring Strategy-Based Transformation Matrix Estimation of Dynamic Factors in Environmental Sensing

Bo Wang, Xina Cheng, Jialiang Wang, Licheng Jiao

TL;DR

This paper introduces a novel approach to Simultaneous Localization and Mapping (SLAM) that significantly improves accuracy and robustness in dynamic environments. By employing a bidirectional scoring strategy and an enhanced transformation matrix estimation, the system effectively filters out dynamic objects, leading to more reliable pose estimation and map building.

What Problem Does This Paper Address?

Autonomous navigation systems, particularly those relying on SLAM, often assume a static environment. However, real-world scenarios are replete with dynamic objects (people, moving vehicles, etc.) that can severely degrade the accuracy of localization and mapping. Existing methods struggle to robustly handle these dynamic elements, leading to positioning errors and inaccurate map reconstructions. While some approaches use geometric constraints or deep learning for dynamic object detection, they often have limitations, such as being sensitive to external points, requiring prior information, or failing to segment less dynamic or partially occluded objects. This paper aims to bridge this gap by proposing a more effective method for dynamic feature point filtering and transformation matrix estimation.

Methods

The proposed system enhances the semantic SLAM framework with a two-pronged approach:

  • Bidirectional Scoring Strategy: This core innovation focuses on identifying and filtering out dynamic feature points. It first uses a geometric constraint function based on the Euclidean distance between corresponding feature points and the average distance of their connecting edges. This function helps identify "abnormal scores" for feature points. A bidirectional scoring mechanism then uses these abnormal scores to eliminate highly dynamic feature points. This strategy is designed to be more robust than previous geometric constraint methods by considering the relationship between multiple feature points and their edges.
  • Transformation Matrix Estimation: After the initial filtering of dynamic points, a refined transformation matrix estimation is employed. This step further removes outliers by optimizing a function that evaluates the similarity of key points between two images. This process leverages intrinsic constraints between samples to guide selective sampling, leading to a more accurate estimation of the transformation matrix.

The overall pipeline involves an initial segmentation of dynamic objects using Mask R-CNN, followed by the proposed geometric dynamic feature filtering to handle objects not identified by the CNN and human limbs.

Datasets

The authors evaluated their system on two widely used datasets:

  • TUM RGB-D dataset: This dataset contains RGB and depth images of indoor scenes with corresponding camera motion trajectories. The authors specifically used the "Dynamic Objects" category, which includes sequences with people sitting and walking, featuring various sensor movements (static, xyz, rpy, halfsphere).
  • Dynamic Bonn RGB-D dataset: This open-source dataset, captured with an ASUS Xtion PRO LIVE, emulates complex real-world motions like crowd movement, individual tracking, and object transport. The authors selected three representative sequences: rgbd_bonn_balloon, rgbd_bonn_crowd3, and rgbd_bonn_person_tracking2.

Key Insights and Ideas

  • Geometric constraints can be powerful, but need careful application: The paper demonstrates that while geometric constraints are efficient, their effectiveness is enhanced when combined with a robust scoring strategy that accounts for multiple relationships between points.
  • Bidirectional scoring is key for dynamic filtering: The novel bidirectional scoring strategy effectively identifies and removes dynamic feature points by looking at the "abnormalness" of their geometric relationships, going beyond simple point-to-point matching.
  • Transformation matrix estimation as a second-stage filter: Using the transformation matrix estimation as a subsequent step after initial dynamic point filtering proves effective in removing remaining outliers and improving overall accuracy.
  • Mask R-CNN is a good starting point, but not sufficient: The paper acknowledges the utility of Mask R-CNN for initial dynamic object detection but highlights its limitations in segmenting less dynamic objects or those without prior training data, necessitating the proposed geometric filtering.

Key Results

The proposed system demonstrated significant improvements in performance compared to state-of-the-art methods like ORB-SLAM3 and DynaSLAM, particularly in highly dynamic scenarios.

  • Improved Trajectory Accuracy: The system achieved notable reductions in Absolute Pose Error (APE) and Root Mean Squared Error (RMSE) across various sequences. For instance, in highly dynamic walking sequences from the TUM dataset, the APE reduction was over 70% compared to ORB-SLAM3.
  • Effective Dynamic Feature Point Removal: Visualizations show that the proposed method successfully filtered out a larger number of dynamic feature points compared to DynaSLAM, especially those associated with potential dynamic targets that Mask R-CNN might miss.
  • Robustness in Dynamic Environments: The system showed better overlap with ground truth trajectories in highly dynamic sequences, indicating enhanced robustness.

Limitations and Future Work

The authors acknowledge two main limitations:

  • Real-time Performance: Further improvements are needed to enhance the system's real-time capabilities.
  • Semantic Segmentation Optimization: Continuous optimization of the semantic segmentation network is required to improve its effectiveness in mitigating the impacts of dynamic objects.

Future work could focus on addressing these limitations to make the system even more practical for real-world applications.

Summary updated

Abstract

Simultaneous localization and mapping (SLAM) is the technological basis of environmental sensing, and it has been widely applied to autonomous navigation. In combination with deep learning methods, dynamic SLAM algorithms have emerged to provide a certain stability and accuracy in dynamic scenes. However, the robustness and accuracy of existing dynamic SLAM algorithms are relatively low in dynamic scenes, and their performance is affected by potential dynamic objects and fast-moving dynamic objects. To solve the positioning interference caused by these dynamic objects, this study proposes a geometric constraint algorithm that utilizes a bidirectional scoring strategy for the estimation of a transformation matrix. First, a geometric constraint function is defined according to the Euclidean distance between corresponding feature points and the average distance of the corresponding edges. This function serves as the basis for determining abnormal scores for feature points. By utilizing these abnormal score values, the system can identify and eliminate highly dynamic feature points. Then, a transformation matrix estimation based on the filtered feature points is adopted to remove more outliers, and a function for evaluating the similarity of key points in two images is optimized during this process. Experiments were performed based on the TUM dynamic target dataset and Bonn RGB-D dynamic dataset, and the results showed that the added dynamic detection method effectively improved the performance compared to state of the art in highly dynamic scenarios.
BibTeX
@article{wang2024bidirectional,
  author = {Bo Wang and Xina Cheng and Jialiang Wang and Licheng Jiao},
  title = {{A Bidirectional Scoring Strategy-Based Transformation Matrix Estimation of Dynamic Factors in Environmental Sensing}},
  journal = {Remote Sensing},
  year = {2024},
  doi = {10.3390/rs16040723},
}
Figure