Autonomous Aerial Manipulation at Arbitrary Pose in SE(3) with Robust Control and Whole-body Planning

Dongjae Lee, Byeongjun Kim, H. Jin KimarXiv 2025 · DOI · arXiv

Abstract

This paper introduces a comprehensive framework for an Omnidirectional Aerial Manipulator (OAM) designed to execute high-precision tasks at arbitrary 3D orientations. Conventional aerial manipulators are often limited by underactuation and mathematical singularities at extreme angles. We overcome these challenges through a novel geometric Robust Integral of the Tanh of the Error (gRITE) controller and a two-step whole-body motion planner. Experimental results demonstrate centimeter-level precision and the ability to operate in complex, cluttered environments while maintaining stability at poses previously considered impossible, such as 90° pitch or upside-down hovering.

Introduction

Aerial manipulation has traditionally been constrained by the underactuated nature of standard multirotors. These platforms must tilt to translate, preventing them from maintaining arbitrary poses in $SE(3)$. Furthermore, the dynamic coupling between a robotic arm and a flying base often leads to instability during manipulation tasks.

Experimental demonstration of the OAM performing tasks at extreme poses, including (a) floor grasping and (b) navigating under a table by tilting the base.

The core contribution of this work is a system that treats the flying base as an additional set of degrees of freedom (DoF), effectively adopting a "base as a joint" philosophy. This allows the robot to reach occluded or difficult-to-access areas by tilting the entire vehicle. To achieve this, we address three primary hurdles: dynamic coupling, mathematical singularities (e.g., gimbal lock), and the computational complexity of real-time whole-body planning.

Methods

The proposed framework integrates a robust control law with a hierarchical motion planning strategy.

System Architecture

The system architecture consists of an offline trajectory generator for the end-effector and an online whole-body trajectory generator that coordinates the base and arm movements.

System architecture of the proposed whole-body motion planner and gRITE controller framework.

The gRITE Controller

For the flying base, we developed the geometric Robust Integral of the Tanh of the Error (gRITE) controller. Unlike traditional Euler-angle-based controllers, gRITE operates directly on the rotation group $SO(3)$, eliminating mathematical singularities. It utilizes a smooth tanh function within its integral term to provide robust disturbance rejection without the high-frequency chattering common in Sliding Mode Control. This ensures smooth motor commands and hardware longevity.

Two-Step Whole-Body Planner

To enable real-time operation, the motion planning is split into two phases:

  1. Offline Phase: A jerk-minimized trajectory is computed for the end-effector to reach its target.
  2. Online Phase: A Nonlinear Model Predictive Control (NMPC) solver operates at frequencies above 10Hz. It dynamically adjusts the base's 6D pose and the arm's joint angles to follow the end-effector path while ensuring stability, avoiding self-collisions, and navigating around obstacles. Obstacles are modeled as composites of ellipsoids to facilitate smooth, differentiable optimization.

Experimental Results

The system was validated using a custom OAM with a 6-rotor tilt-rotor base and a 4-DoF robotic arm. Key findings include:

  • High Precision: The system achieved a position error of less than 2 cm and an orientation error of less than 3° across various manipulation tasks.
  • Extreme Maneuverability: The OAM successfully performed grasping and pulling tasks while pitched at 90° and nearly 180° (upside down).
  • Robustness: In comparative tests, the gRITE controller outperformed standard geometric PID and Disturbance Observers (DOB), particularly during rapid arm movements where dynamic coupling is most significant.
  • Real-time Efficiency: The online planner consistently solved within 20-30 ms, allowing for immediate reactions to environmental disturbances.

Conclusion

This work demonstrates a robust and flexible framework for omnidirectional aerial manipulation. By combining geometric control with efficient whole-body planning, we enable drones to perform complex physical interactions in cluttered spaces at any orientation. Future research will focus on integrating real-time vision for dynamic obstacle avoidance and optimizing configurations for increased payload capacity.

Summary updated

Abstract

Aerial manipulators based on conventional multirotors can conduct manipulation only in small roll and pitch angles due to the underactuatedness of the multirotor base. If the multirotor base is capable of hovering at arbitrary orientation, the robot can freely locate itself at any point in $\mathsf{SE}(3)$, significantly extending its manipulation workspace and enabling a manipulation task that was originally not viable. In this work, we present a geometric robust control and whole-body motion planning framework for an omnidirectional aerial manipulator (OAM). To maximize the strength of OAM, we first propose a geometric robust controller for a floating base. Since the motion of the robotic arm and the interaction forces during manipulation affect the stability of the floating base, the base should be capable of mitigating these adverse effects while controlling its 6D pose. We then design a two-step optimization-based whole-body motion planner, jointly considering the pose of the floating base and the joint angles of the robotic arm to harness the entire configuration space. The devised two-step approach facilitates real-time applicability and enhances convergence of the optimization problem with non-convex and non-Euclidean search space. The proposed approach enables the base to be stationary at any 6D pose while autonomously carrying out sophisticated manipulation near obstacles without any collision. We demonstrate the effectiveness of the proposed framework through experiments in which an OAM performs grasping and pulling of an object in multiple scenarios, including near $90^\circ$ and even $180^\circ$ pitch angles.
BibTeX
@misc{lee2025autonomous,
  author = {Dongjae Lee and Byeongjun Kim and H. Jin Kim},
  title = {{Autonomous Aerial Manipulation at Arbitrary Pose in SE(3) with Robust Control and Whole-body Planning}},
  year = {2025},
  eprint = {2508.19608},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2508.19608},
}
Figure