Directing Cinematographic Drones

Quentin Galvane, Christophe Lino, Marc Christie, Julien Fleureau, Fabien Servant, François-Louis Tariolle, Philippe Guillotel

Abstract

Professional drone cinematography typically requires a coordinated effort between a pilot and a cinematographer. This paper introduces a high-level control system that simplifies this process, allowing a single user to act as both. The system maps complex drone physics and framing constraints into a specialized "Drone Toric Space," enabling real-time path planning, interactive sketching of trajectories, and automated multi-drone coordination. Experimental results demonstrate that the system allows novices to capture professional-grade shots of dynamic targets with high computational efficiency and physical feasibility.

Introduction

In professional filmmaking, capturing dynamic aerial shots is a complex task requiring synchronized expertise in flight and camera control. While consumer drones offer basic "follow-me" modes, they often struggle with maintaining specific cinematographic framing, ensuring physical feasibility of paths, and avoiding collisions in dynamic environments. Furthermore, coordinating multiple drones to provide complementary views without visual interference remains a significant challenge.

Overview of the system showing the sketching interface, framing constraints, and multi-drone coordination in a real-world lab.

Methods

The proposed system architecture is built around a novel mathematical representation called the Drone Toric Space (DTS). The DTS re-parameterizes a spindle torus surface to embed safety distances and physical gimbal limits directly into the coordinate system. This ensures that the search space for valid shots is pre-filtered for safety and feasibility.

The multi-layered system architecture featuring the Interface, Environment tracker, and Master/Slave drone coordination.

The system employs a multi-layered control scheme:

  1. Real-time Path Planning: Using a visibility-aware roadmap and A* search in a 4D $\tau$-space, the system finds paths that optimize for visual properties rather than just Euclidean distance.
  2. Smooth Trajectories: To ensure stable flight, the system generates $C^4$ continuous trajectories (piecewise degree-5 polynomials), accounting for "snap" to minimize jerky movements.
  3. Interactive Control: A sketching interface allows users to draw 2D paths on a screen, which are then projected and optimized into 3D flight paths.
  4. Multi-Drone Coordination: A master/slave hierarchy uses "min-conflict" optimization to assign distinct framing instances to multiple drones while preventing them from entering each other's field of view.

Evaluation and Results

The system was evaluated in both simulated Unity 5 environments and a real-world lab setup using a Vicon motion capture system for high-precision tracking. In a user study with 12 novices, the proposed tools significantly outperformed manual controllers, enabling users to achieve fluid, precisely framed shots that were previously impossible for them.

Key findings include:

  • Efficiency: Path planning algorithms consistently run in under 200ms, supporting real-time interaction.
  • Smoothness: Quantitative analysis confirmed that DTS-based planning results in smoother footage with fewer variations in target framing compared to standard Euclidean methods.

Conclusion

By abstracting low-level flight controls into high-level cinematographic directives, this system empowers solo creators to produce professional-quality aerial footage. While currently limited by reactive planning and hardware constraints of non-stabilized drones, future work aims to integrate predictive motion schemes and automated real-time editing for even more complex multi-drone behaviors.

Summary updated

Abstract

Quadrotor drones equipped with high quality cameras have rapidely raised as novel, cheap and stable devices for filmmakers. While professional drone pilots can create aesthetically pleasing videos in short time, the smooth -- and cinematographic -- control of a camera drone remains challenging for most users, despite recent tools that either automate part of the process or enable the manual design of waypoints to create drone trajectories. This paper proposes to move a step further towards more accessible cinematographic drones by designing techniques to automatically or interactively plan quadrotor drone motions in 3D dynamic environments that satisfy both cinematographic and physical quadrotor constraints. We first propose the design of a Drone Toric Space as a dedicated camera parameter space with embedded constraints and derive some intuitive on-screen viewpoint manipulators. Second, we propose a specific path planning technique which ensures both that cinematographic properties can be enforced along the path, and that the path is physically feasible by a quadrotor drone. At last, we build on the Drone Toric Space and the specific path planning technique to coordinate the motion of multiple drones around dynamic targets. A number of results then demonstrate the interactive and automated capacities of our approaches on a number of use-cases.
BibTeX
@article{galvane2018directing,
  author = {Quentin Galvane and Christophe Lino and Marc Christie and Julien Fleureau and Fabien Servant and François-Louis Tariolle and Philippe Guillotel},
  title = {{Directing Cinematographic Drones}},
  journal = {ACM Trans. Graphics},
  year = {2018},
  doi = {10.1145/3181975},
}
Figure