Towards an Autonomous Vision-Based Unmanned Aerial System against Wildlife Poachers

Miguel Olivares-Mendez, Changhong Fu, Philippe Ludivig, Tegawendé F. Bissyandé, Somasundar Kannan, Maciej Zurad, Arun Annaiyan, Holger Voos, Pascual CampoySensors 2015 · DOI

TL;DR

This paper presents an autonomous, vision-based Unmanned Aerial System (UAS) designed to combat wildlife poaching. It integrates advanced computer vision techniques for animal and poacher detection, tracking, and autonomous navigation for surveillance and landing, offering a more efficient and effective anti-poaching solution.

What Problem Does This Paper Address?

Poaching is a rampant illegal activity with devastating consequences for wildlife and even funding armed conflicts, generating billions of dollars annually. Traditional anti-poaching methods, often relying on limited security personnel and vast park areas, are insufficient to combat this threat. The paper addresses the urgent need for more efficient and technologically advanced solutions, specifically focusing on leveraging Unmanned Aerial Vehicles (UAVs) equipped with sophisticated vision systems to enhance surveillance, detection, and response capabilities in remote and challenging environments.

Methods

The core of this work lies in the integration of several vision-based algorithms and control strategies for UAVs:

  • Adaptive Visual Animal Tracking: This algorithm tackles the challenges of tracking animals in their natural environment, such as significant appearance changes, varying illumination, partial occlusion, and rapid pose variations. It employs a low-dimensional Principal Component Analysis (PCA) subspace representation with online incremental learning and a hierarchical tracking strategy using a multi-resolution structure to achieve robust and real-time tracking.
  • Vision-Based Face Detection: To identify potential poachers, the system utilizes a Viola and Jones boosting cascade algorithm. This approach is chosen for its real-time capabilities and efficiency, leveraging Haar-like features and an AdaBoost classifier with a cascade system for speed optimization.
  • Vision-Based Control for Vehicle Following and Autonomous Landing: The system integrates vision-based control to enable the UAV to follow suspicious vehicles (potential poachers) and to perform autonomous landings on static or moving platforms for recharging. This involves using a downward-looking camera and an Inertial Measurement Unit (IMU) to estimate the UAV's pose relative to a target. Fuzzy logic PID-like controllers are employed to manage the inherent uncertainties and complexities of UAV control.

Datasets

The paper describes the generation of ground truth datasets by manually annotating aerial videos taken by quadcopters in Africa. These datasets were used to evaluate the performance of the visual animal tracking algorithm. For face detection, the paper mentions using pre-trained models from OpenCV, implying that standard datasets were likely used for training these models, though specific datasets are not detailed.

Key Insights and Ideas

  • Integration is Key: The paper emphasizes that a standalone algorithm isn't enough; the true innovation lies in the seamless integration of animal tracking, poacher detection, and autonomous control into a cohesive system.
  • Robustness in Challenging Environments: The adaptive visual tracking algorithm demonstrates significant robustness in handling the inherent difficulties of tracking animals in natural, dynamic environments.
  • Real-time Performance is Achievable: The use of efficient algorithms like Viola and Jones for face detection and fuzzy logic for control highlights the feasibility of real-time operation on UAV platforms.
  • Autonomous Landing is Crucial for Mission Continuity: The ability for UAVs to autonomously land and recharge is vital for extended surveillance missions, ensuring continuous operation without constant human intervention.

Key Results

  • Animal Tracking: The visual animal tracking algorithm demonstrated accurate tracking of rhinos and elephants in various challenging scenarios, including varying speeds, partial occlusion, and similar coloration to the background. Average errors for center location, rotation, width, and height were reported in the range of a few pixels and degrees.
  • Face Detection: The face detection system achieved consistent detection in various lighting conditions, including direct sunlight and shadows, though performance degraded for individuals further from the camera. The system processed an average of 4.258 frames per second on an off-line machine.
  • Vehicle Following and Landing: Experiments showed that the vision-based control system could effectively follow a moving target (a Youbot robot) with root mean squared errors (RMSE) for lateral, longitudinal, and vertical controllers generally below 15 cm. The heading controller also performed well, managing significant orientation changes. Autonomous landing experiments also showed promising results with low errors.

Limitations and Future Work

  • Face Detection Distance: A significant limitation is the reduced detection distance for faces due to camera configuration (lack of zoom) and sensor resolution. Future work includes improving camera configurations to enhance detection range.
  • Continuous Face Detection: The current face detection is not always continuous. The authors are working on improving this by integrating image tracking algorithms, specifically the mean shift algorithm, to bridge gaps between successful detections.
  • Outdoor Testing of Tracking Improvements: Promising results from laboratory tests of the mean shift algorithm for continuous detection need to be validated in outdoor environments.
  • Vision Tracking for Control: The vision-based control approach for vehicle following and landing currently relies on AR codes for target estimation. Future work aims to integrate vision tracking algorithms to improve this aspect of the control approach.

Summary updated

Abstract

Poaching is an illegal activity that remains out of control in many countries. Based on the 2014 report of the United Nations and Interpol, the illegal trade of global wildlife and natural resources amounts to nearly $ 213 billion every year, which is even helping to fund armed conflicts. Poaching activities around the world are further pushing many animal species on the brink of extinction. Unfortunately, the traditional methods to fight against poachers are not enough, hence the new demands for more efficient approaches. In this context, the use of new technologies on sensors and algorithms, as well as aerial platforms is crucial to face the high increase of poaching activities in the last few years. Our work is focused on the use of vision sensors on UAVs for the detection and tracking of animals and poachers, as well as the use of such sensors to control quadrotors during autonomous vehicle following and autonomous landing.
BibTeX
@inproceedings{olivaresmendez2015towards,
  author = {Miguel Olivares-Mendez and Changhong Fu and Philippe Ludivig and Tegawendé F. Bissyandé and Somasundar Kannan and Maciej Zurad and Arun Annaiyan and Holger Voos and Pascual Campoy},
  title = {{Towards an Autonomous Vision-Based Unmanned Aerial System against Wildlife Poachers}},
  booktitle = {Sensors},
  year = {2015},
  doi = {10.3390/s151229861},
}
Figure