Abstract
Visual Simultaneous Localization and Mapping (vSLAM) is a cornerstone of robotics and computer vision, enabling devices to perceive 3D environments and determine their own position. However, standard vSLAM systems often fail in real-world settings because they rely on a "static world assumption." When objects move, these systems suffer from tracking drift or failure. This paper introduces DSP-SLAM, a novel monocular visual SLAM algorithm that utilizes semantic probability prediction to handle dynamic scenes. By combining semantic segmentation with robust geometric estimation, the system represents the motion state of observations as probabilities. This allows it to filter out dynamic interference while retaining stable features from stationary objects, significantly improving tracking accuracy and map quality in complex environments.
Introduction
Simultaneous Localization and Mapping (SLAM) is the "holy grail" of spatial awareness for autonomous systems. Despite its success, the traditional reliance on a frozen, static world remains a major hurdle. In dynamic environments—such as a busy office or a crowded street—moving people or objects can confuse the system, leading to significant localization errors.
Existing solutions typically either use geometric outliers to identify motion (which fails in high-dynamic scenes) or use semantic labels to blindly delete all potentially moving objects (which discards valuable stable data). DSP-SLAM proposes a middle ground: a probabilistic approach that determines if a "person" or "chair" is actually moving before deciding whether to use its visual features for tracking.
Methodology
The DSP-SLAM pipeline operates through several integrated modules designed to handle dynamic uncertainty:
- Semantic Segmentation & Association: The system employs PanopticFCN to generate semantic labels for each frame. To maintain temporal consistency, these labeled clusters are tracked across frames using optical flow and spatial overlap, ensuring that the system understands the identity of objects over time.
- Motion State Detection: Rather than assuming all objects with certain labels (like "person") are moving, the system uses a modified RANSAC variant called PARSAC. It applies geometric constraints, specifically the Sampson error, to check if a cluster's movement aligns with the camera's ego-motion.
- Semantic Probability Prediction: This core innovation uses a Logistic regression model to calculate the probability that a specific 2D observation is dynamic. This "soft" logic allows the system to prioritize features that are statistically likely to be static.
- Weighted Pose Estimation: During camera pose estimation (the PnP problem), observations are weighted by their static probability. This ensures that even if a person is in the frame, if they are stationary, their features can still contribute to the system's stability.
- Map Maintenance: The system proactively culls "invalid" map points—those that have transitioned from static to dynamic—preventing the 3D map from being cluttered with "ghost" artifacts.
Experimental Evaluation
The researchers evaluated DSP-SLAM using two primary sources:
- TUM-RGBD Dataset: The industry standard for SLAM evaluation, focusing on "walking" and "sitting" sequences with varying dynamic levels.
- Custom Dynamic Dataset: A high-precision dataset captured using a VICON motion capture system to provide ground truth. This included challenging scenarios like moving objects on a desktop and crowded indoor environments.
Key Results
DSP-SLAM demonstrated a significant leap in performance over baselines like ORB-SLAM2 and dynamic-focused systems like DynaSLAM:
- Accuracy: In the "Desktop 1" sequence, DSP-SLAM achieved an Absolute Trajectory Error (ATE) of 2.48 cm, a massive improvement over ORB-SLAM2's 15.70 cm.
- Robustness: In high-dynamic "Walking" sequences, the system maintained a tracking percentage of over 91%, where standard SLAM systems often failed entirely.
- AR Stability: Qualitative tests in Augmented Reality (AR) showed that virtual objects remained pinned to the real world even as people moved objects in the scene, highlighting the system's superior mapping quality.
Conclusion
By moving away from binary "static vs. dynamic" classifications and adopting a probabilistic semantic model, DSP-SLAM provides a robust solution for monocular SLAM in the real world. While current processing speeds (15 fps) present a minor bottleneck for real-time high-speed robotics, the system's ability to maintain high accuracy in crowded, changing environments marks a significant advancement for autonomous navigation and AR applications.
Summary updated