Introduction
Locating distant objects in 3D space is a critical challenge for aerial robotics, particularly in safety-critical applications like wildfire monitoring. Traditional depth-sensing technologies often fall short at long ranges: LiDAR resolution degrades cubically with distance, and stereo cameras require impractically large baselines to achieve meaningful depth perception at distances exceeding several kilometers.
While Structure-from-Motion (SfM) offers a potential solution using a single moving camera, its high computational demands make it unsuitable for the resource-constrained "edge" hardware typically found on small drones. Furthermore, SfM relies on distinct visual keypoints, which are absent in amorphous, shifting targets like smoke plumes. This research proposes a lightweight alternative for long-range 3D localization using 2D semantic segmentation and probabilistic filtering.
Methodology
The proposed system translates 2D image detections into 3D coordinates by integrating two mathematical frameworks:
- Multi-view Triangulation (MVT): This geometric approach utilizes multiple viewpoints captured as the drone traverses its path. Rays are projected from the camera center through the centroid of the detected object mask. The 3D position is estimated at the point of near-intersection. To handle noise from GNSS (GPS) data or false detections, the authors employ Robust Multi-view Triangulation (RMVT), which incorporates RANSAC (Random Sample Consensus) to filter out outlier frames.
- Particle Filters (PF): This probabilistic method maintains a "cloud" of thousands of potential object locations (particles). As new visual evidence is acquired, the system updates the weights of these particles. Particles inconsistent with the visual data are discarded, while new ones are generated near high-probability locations. This approach is particularly effective at representing the inherent uncertainty and the physical shape of the target.
Experimental Evaluation
The methods were validated across three scenarios:
- Synthetic Simulation: A controlled environment used to test resilience against pose errors and detection noise.
- Telecom Mast Sequence: Real-world tracking of a stationary tower to establish a baseline for point-target accuracy.
- Industrial Smoke Sequence: Tracking smoke from a chimney at a distance of 1,770 meters. This sequence utilized the Segment Anything Model (SAM 3) for initial 2D segmentation, testing the system's ability to handle amorphous shapes.
Key Results and Discussion
The study highlights a trade-off between precision and stability. In synthetic tests with high noise, RMVT achieved a minimum Root Mean Square Error (RMSE) of approximately 1.2 meters, significantly lower than the Particle Filter's ~17 meters. However, the Particle Filter demonstrated superior stability over time and better resilience to "dirty" data, such as false positive detections.
A critical finding is the "convergence requirement." As shown in the performance metrics, the drone must travel a baseline of approximately 150–200 meters before the 3D estimates for a target 2km away become reliable. In real-world smoke tracking, the system achieved an RMSE of 200–350 meters. While less precise than point-target tracking, this level of accuracy is sufficient for directing emergency services to specific forest quadrants.
Conclusion and Future Work
The developed methods are computationally efficient enough to run on embedded hardware like the NVIDIA Jetson Orin NX, enabling fully autonomous onboard localization. Current limitations include the assumption of a single target; future work will focus on multi-target tracking to handle multiple simultaneous smoke plumes. Additionally, incorporating digital elevation models to constrain the initial search area of the Particle Filter could significantly accelerate convergence.
Summary updated