Payload Prediction for Quadro Drone using Temporal Deep Machine Learning Models

Raed Abu Zitar, Mariam Kashkash, Amal El Fallah Seghrouchni, Frédéric BarbarescoResearch Square 2024 · DOI

Abstract

In this research, four deep-learning and temporal machine-learning techniques—RNN, LSTM, TCN, and GRU—are evaluated for their ability to predict the payload of a DJI Matrice 100 quadcopter drone based on tracking data. Using an open-source dataset of over 270 flights with payloads ranging from 0 to 750 grams, the study demonstrates the necessity of models that incorporate historical context. The results highlight the superiority of Temporal Convolutional Networks (TCNs), which achieved the lowest error rates (RMSE and MAE) compared to traditional recurrent architectures.

Introduction: The Challenge of Non-Intrusive Monitoring

As Unmanned Aerial Vehicles (UAVs) become ubiquitous in delivery, agriculture, and surveillance, the ability to determine what a drone is carrying—without physical inspection—is becoming a critical security and operational need. Whether it's detecting the transport of illegal materials or optimizing battery life for a delivery fleet, knowing the payload weight is essential for safety and efficiency.

However, predicting payload from flight data is inherently challenging. A drone’s motion (kinematics) is a complex time series influenced by acceleration, velocity, and power consumption. While traditional Recurrent Neural Networks (RNNs) are designed for sequential data, they often struggle with "vanishing gradients" and long-term dependencies, making them less effective for the nuanced patterns found in high-frequency flight logs.

Methodology: Comparing Temporal Architectures

The authors conducted a comparative study of four temporal deep learning models to identify the most effective architecture for mass prediction:

  1. RNN (Recurrent Neural Network): Served as the baseline model for sequential data processing.
  2. LSTM (Long Short-Term Memory): Designed to overcome RNN limitations by using "gates" to manage information flow over time.
  3. GRU (Gated Recurrent Unit): A more computationally efficient variant of the LSTM.
  4. TCN (Temporal Convolutional Network): A modern architecture that utilizes dilated causal convolutions to capture long-range patterns without the recursive overhead of traditional RNNs.
The architecture of the Temporal Convolutional Network (TCN) used for payload prediction, featuring residual blocks and dilated causal convolutions.

As shown in the TCN architecture diagram, the model processes time-variant inputs (velocity and acceleration) through a series of Residual Blocks (RB). These blocks use dilated convolutions to expand the receptive field, allowing the model to "see" further back into the flight history simultaneously. The researchers treated the flight data as a multi-dimensional tensor, incorporating time-invariant data like programmed ground speed to refine the prediction.

Experimental Setup and Datasets

The study utilized an open-source dataset involving the DJI Matrice 100 quadcopter. The scale of the experiment was significant:

  • Flight Volume: Over 270 flights were conducted, generating more than 1,400 records per flight.
  • Payload Variety: The models were trained to distinguish between four specific weights: 0g, 250g, 500g, and 750g.
  • Sensor Data: High-resolution readings were collected from GPS, IMU, and ultrasonic anemometers, covering a total flight distance of approximately 65 kilometers.
Aerial view of the experimental flight path used to collect drone kinematics data.

The flight path followed a specific triangular trajectory (as seen in the aerial view). Interestingly, the authors found that raw positional data (x, y, z coordinates) acted as "noise" because the trajectories were fixed. By pruning these features and focusing on the relationship between mass and motion (velocity/acceleration), the models achieved higher accuracy.

Key Results and Insights

The TCN model emerged as the clear top performer, achieving a training loss as low as 0.0046 and the lowest overall Mean Absolute Error (MAE) and Root Mean Square Error (RMSE) across all testing phases.

Key insights from the comparison include:

  • TCN Supremacy: TCNs outperformed LSTMs and GRUs due to their wider "receptive field," which provided more stability when analyzing physical kinematics.
  • Robustness against Overfitting: Standard RNNs and GRUs showed a tendency to overfit the training data. In contrast, TCNs proved much more robust during cross-validation, generalizing well to unseen flight logs.
  • Efficiency with Limited Data: Even when the input window was reduced to only 50 data points per flight, the TCN maintained its performance lead, suggesting high efficiency for real-world applications where sensor history might be limited.

Conclusion and Future Directions

While TCNs show great promise for non-intrusive UAV monitoring, the authors noted that their computational complexity could be a hurdle for real-time processing on low-power onboard computers. Future research will focus on generalizing these models across different drone frames and motor configurations. Additionally, the use of Generative Adversarial Networks (GANs) is proposed to synthesize flight data, helping to train models for rare or dangerous flight conditions without risking physical hardware.

Summary updated

Abstract

<title>Abstract</title> In this paper, four different deep-learning and temporal machine-learning techniques are used to predict the payload of the DJI Matrice 100 quadcopter drone based on its tracking data. Tracking variables for real-life experimentations are provided as open source for payloads of 0.0, 250, 500, and 750 grams. The drone is a Quado drone DJI matrice 100. The Machine Learning techniques are RNN, LSTM, TCN, and GRU. The values of the tracks’ kinematics come from several different flights for the different loads. The tracks’ kinematics and flight parameters are used in training the four models. The temporal nature of the data values triggers the need for machine learning methods that use history/memory as part of inputs. This application is a real and relevant test to evaluate the capabilities of the 4 famous types of deep temporal machine learning models. The original data has more than 1400 records for every flight with more than 22 variable values. More than 270 flights were conducted with the 4 payloads. The models were tuned and initialized with the optimum parameters found. Several simulations were implemented for training, testing, and validation. Cross-validation for the models was implemented The RMSE and MAE errors were used to evaluate the loss and the accuracies. The TCN model with the optimum parameters showed the best performance compared to other techniques. The RNN (many-to-one) showed the lowest performance. The results emphasize the superiority of the modern TCN methods over other temporal deep techniques for this kind of problem.
BibTeX
@inproceedings{zitar2024payload,
  author = {Raed Abu Zitar and Mariam Kashkash and Amal El Fallah Seghrouchni and Frédéric Barbaresco},
  title = {{Payload Prediction for Quadro Drone using Temporal Deep Machine Learning Models}},
  booktitle = {Research Square},
  year = {2024},
  doi = {10.21203/rs.3.rs-3412454/v1},
}
Figure