Door-to-Door Parcel Delivery From Supply Point to User’s Home With Heterogeneous Robot Team: The euROBIN First-Year Robotics Hackathon

Alejandro Suárez, Rainer Kartmann, Daniel Leidner, Luca Rossini, J.b. Huber, Carlos Azevedo, Quentin Rouxel, Marko Bjelonic, Antonio González-Morgado, Christian Dreher, Peter Schmaus, Arturo Laurenzi, François Hélénon, Rodrigo Serra, Jean-Baptiste Mouret, Lorenz Wellhausen, V. Perez-Sanchez, Jianfeng Gao, Adrian S. Bauer, Alessio De Luca, Mouad Abrini, Rui Bettencourt, Olivier Rochel, Joonho Lee, Pablo Viana, Christoph Pohl, Nesrine Batti, Diego Vedelago, Vamsi Krishna Guda, Alexander Reske, Carlos Álvarez, Fabian Reister, Werner Friedl, Corrado Burchielli, Aline Baudry, Fabian Peller-Konrad, Thomas Gumpert, Luca Muratore, Philippe Gauthier, Franziska Krebs, Sung Yong Jung, Lorenzo Baccelliere, Hippolyte Watrelot, Andre Meixner, Anne Köpken, Mohamed Chétouani, Pascal Weiner, Florian Lay, Felix Hundhausen, Anne E. Reichert, Noémie Jaquier, Frederick H. Schmidt, Marco Sewtz, Freek Stulp, Lioba Suchenwirth, Rudolph Triebel, Xuwei Wu, Begoña C. Arrue, Rebecca Schedl-Warpup, Marco Hutter, Serena Ivaldi, Pedro U. Lima, Stéphane Doncieux, Nikos G. Tsagarakis, Tamim Asfour, Anı́bal Ollero, Alin Albu‐Schäffer

Abstract

Logistics and service operations involving parcel preparation, delivery, and unpacking from a supply point to a user’s home could be carried out completely by robots in the near future, taking advantage of the capabilities of the different robot morphologies for the logistics, outdoor, and domestic environments. The use of robots for parcel delivery can contribute to the goals of sustainability and reduced emissions by exploiting their different locomotion modalities (wheeled, legged, and aerial). This article reports the development and results obtained from the first robotics hackathon celebrated as part of the European Robotics and Artificial Intelligence Network involving eight robotic platforms in three domains: 1) an industrial robotic arm for parcel preparation at the supply point, 2) a Centauro robot, a dual-arm aerial manipulator, and a wheeled-legged quadruped for parcel transportation, and 3) two humanoid robots and two commercial mobile manipulators for parcel delivery and unpacking in domestic scenarios.

Introduction

While autonomous delivery is a hot topic, most current solutions are "siloed." A drone might fly a package to a yard, or a sidewalk bot might roll it down a street, but they rarely interact. The "last-meter" problem—getting a package from a delivery vehicle, through a sensorized door, and into a user’s hands or cupboard—remains a massive hurdle. This paper addresses the integration challenge: orchestrating a multi-stage, door-to-door parcel delivery using eight distinct robotic platforms. By leveraging the specific strengths of different robot morphologies, the researchers demonstrate a complete logistics chain without human physical intervention.

Experimental Setup and Methods

The experiment was conducted as a "hackathon" involving eight robots from top European research institutes (DLR, KIT, ETHZ, etc.). The workflow spanned three distinct domains: a supply point, a simulated outdoor area, and a user's home.

Overview of the euROBIN hackathon testbed and the heterogeneous robot team.

Key technical approaches included:

  • Communication via Episodic Memory: Coordination was managed via a RESTful API based on the ArmarX cognitive architecture, serving as a shared "blackboard" for status updates and task triggers.
  • Hybrid Control: The mission combined autonomous behaviors (using "Action Templates" for grasping and navigation) with kinesthetic teleoperation for high-stakes tasks like aerial handovers and door opening.
  • Advanced Perception: For domestic unboxing, the ARMAR-6 robot utilized Grounding DINO for object detection and SAM-Track for mask tracking to handle unknown objects.
  • Standardized Benchmarking: Robots interacted with a standardized cardboard parcel, modified with a simple handle for aerial-ground handover. Datasets like the YCB Object Set and a custom doorbell dataset (trained with Detectron2) were used for training.

Key Insights: The "Downwash" Dilemma

A critical finding involved the interaction between aerial and ground robots. The aerodynamic downwash from the drone's propellers was strong enough to displace light, empty parcels. To mitigate this, the ground robot (Centauro) had to maintain a firm, force-controlled grip during the handover to stabilize the package against the downward air pressure.

The aerial-to-ground handover between a dual-arm aerial manipulator and the Centauro robot, illustrating the aerodynamic downwash force.

This interaction highlighted that heterogeneity is a feature: wheels provide energy efficiency on flat surfaces, legs navigate uneven terrain, and human-like arms are essential for domestic manipulation.

Results and Discussion

The mission achieved several milestones:

  • Full Mission Success: The end-to-end chain was completed in approximately 18 minutes.
  • World First: The project recorded the first aerial handover between a dual-arm flying robot and a Centauro (wheeled-legged humanoid) robot.
  • Reliability: The industrial preparation phase (Franka arm) showed a >90% success rate. However, domestic tasks like doorbell ringing were more fragile, failing about 20% of the time due to 3D pose estimation errors.

Conclusion and Future Work

The euROBIN hackathon proved that a heterogeneous team can manage the entire delivery chain. Future work will focus on EuroCore, a collaborative repository for sharing maps and plans, and reducing reliance on teleoperation for "contact-rich" tasks like door opening.

Summary updated

Abstract

Logistics and service operations involving parcel preparation, delivery, and unpacking from a supply point to a user’s home could be carried out completely by robots in the near future, taking advantage of the capabilities of the different robot morphologies for the logistics, outdoor, and domestic environments. The use of robots for parcel delivery can contribute to the goals of sustainability and reduced emissions by exploiting their different locomotion modalities (wheeled, legged, and aerial). This article reports the development and results obtained from the first robotics hackathon celebrated as part of the European Robotics and Artificial Intelligence Network involving eight robotic platforms in three domains: 1) an industrial robotic arm for parcel preparation at the supply point, 2) a Centauro robot, a dual-arm aerial manipulator, and a wheeled-legged quadruped for parcel transportation, and 3) two humanoid robots and two commercial mobile manipulators for parcel delivery and unpacking in domestic scenarios. The article describes the joint operation and the evaluation scenario, the features and capabilities of the robots, particularly those involved in the realization of the tasks, and the lessons learned.
BibTeX
@article{suarez2024door,
  author = {Alejandro Suárez and Rainer Kartmann and Daniel Leidner and Luca Rossini and J.B. Huber and Carlos Azevedo and Quentin Rouxel and Marko Bjelonic and Antonio González-Morgado and Christian Dreher and Peter Schmaus and Arturo Laurenzi and François Hélénon and Rodrigo Serra and Jean-Baptiste Mouret and Lorenz Wellhausen and V. Perez-Sanchez and Jianfeng Gao and Adrian S. Bauer and Alessio De Luca and Mouad Abrini and Rui Bettencourt and Olivier Rochel and Joonho Lee and Pablo Viana and Christoph Pohl and Nesrine Batti and Diego Vedelago and Vamsi Krishna Guda and Alexander Reske and Carlos Álvarez and Fabian Reister and Werner Friedl and Corrado Burchielli and Aline Baudry and Fabian Peller-Konrad and Thomas Gumpert and Luca Muratore and Philippe Gauthier and Franziska Krebs and Sung Yong Jung and Lorenzo Baccelliere and Hippolyte Watrelot and Andre Meixner and Anne Köpken and Mohamed Chétouani and Pascal Weiner and Florian Lay and Felix Hundhausen and Anne E. Reichert and Noémie Jaquier and Frederick H. Schmidt and Marco Sewtz and Freek Stulp and Lioba Suchenwirth and Rudolph Triebel and Xuwei Wu and Begoña C. Arrue and Rebecca Schedl-Warpup and Marco Hutter and Serena Ivaldi and Pedro U. Lima and Stéphane Doncieux and Nikos G. Tsagarakis and Tamim Asfour and Anı́bal Ollero and Alin Albu‐Schäffer},
  title = {{Door-to-Door Parcel Delivery From Supply Point to User’s Home With Heterogeneous Robot Team: The euROBIN First-Year Robotics Hackathon}},
  journal = {IEEE Robotics \& Automation Magazine},
  year = {2024},
  doi = {10.1109/mra.2024.3501954},
}
Figure