Development of Automatic Construction Material Handling Robot: Autonomous Cart Latching and Evaluation

Guang Yang, Shuoyu Wang, Hajime Okamura, Yasuhiro Ueda, Toshiaki Yasui, Tetsuya Yamada, Yuki Miyazawa, Satomi Yoshida, Yuta Inada, Shingo Ino, Kazuo Okuhata, Yoshinobu MizobuchiJournal of the Robotics Society of Japan 2022 · DOI

TL;DR

Researchers have developed a robust autonomous "latching" system for construction robots that allows them to pick up material carts placed in arbitrary positions. By combining AR marker tracking for long-range detection with LiDAR-based edge detection for precision docking, the system achieved a 95% success rate in real-world construction site trials.

What Problem Does This Paper Address?

Automating material transport on construction sites is a major goal for addressing labor shortages. While mobile robots can navigate hallways, the "last meter" problem—autonomously docking with or "latching" onto a cart—remains difficult.

Most existing solutions fall into two categories: manual hitching (which requires a human) or rigid docking (which requires the cart to be placed in a precisely marked spot). In the chaotic, ever-changing environment of a construction site, workers don't have the time to align carts perfectly. This paper tackles the challenge of creating a robot that can find, approach, and latch onto a cart regardless of its initial orientation or exact location.

Methods

The authors utilize a "gate-type" robot equipped with a specialized latching mechanism consisting of snatch locks and linear solenoids. Their software approach is split into two main components:

1. Multi-Modal Perception Sets

To handle different distances, the robot uses two types of sensing:

  • Type 1 (Long Range, 2–8m): Uses cameras to detect AR markers placed on the carts. This provides the robot with the cart's identity and a rough initial pose.
  • Type 2 (Short Range, 0–2.5m): Uses LiDAR (Laser Range Finders) to detect the physical edges of the cart. This provides the high-precision data needed for the final centimeters of the docking maneuver.

2. Hybrid Control Algorithm

The docking process is broken down into four distinct phases:

  • Step 1 (Target Discovery): The robot rotates until a Type 1 sensor (camera) picks up an AR marker.
  • Step 2 (Approach): The robot uses the Dynamic Window Approach (DWA) to navigate toward a "pre-latching position" while actively avoiding obstacles like other carts or workers.
  • Step 3 (Final Approach): Once close, the robot switches to PID control. It focuses on minimizing lateral error ($dy$) and angular error ($\phi$) while slowly closing the distance ($dx$).
  • Step 4 (Latching): The physical connection is made, and limit switches confirm the locks have engaged.

Datasets

This paper does not use standard public datasets. Instead, the authors evaluated their system through:

  • Controlled Validation: Conducted in an unused supermarket to test the transition between sensing modes and the accuracy of the hybrid control.
  • Field Trials: Conducted at active construction sites involving the transport of real materials like gypsum board, light gauge steel (LGS), and flooring materials.

Key Insights and Ideas

  • The "Pre-latching" Buffer: A critical insight was the implementation of a "pre-latching position" where both AR markers and LiDAR data are valid. This overlap ensures a smooth, stable transition from global navigation to high-precision docking.
  • Symmetry as a Shortcut: By mounting LiDAR at a specific height, the robot can detect the two edges of a standard cart symmetrically. This allows the robot to center itself based on the cart's physical geometry rather than relying solely on visual markers, which can be finicky in dusty environments.
  • Hybrid Control for Robustness: DWA is excellent for obstacle avoidance during the approach, but PID is superior for the "finesse" required to align mechanical locks. Combining them allows the robot to be both safe and precise.

Key Results

  • Success Rate: In real-world construction site tests, the robot successfully latched onto carts in roughly 95% of attempts over dozens of trials.
  • Versatility: The system proved capable of handling different cart types (platform carts and cage carts) and various heavy construction materials.
  • Efficiency: The transition from discovery to latching was shown to be fluid, with the robot managing the entire process autonomously once a general transport plan was set.

Limitations and Future Work

The primary limitation identified was occlusion. If a worker accidentally places an object in front of the AR marker or if the cart is partially hidden, the robot cannot initiate the docking sequence.

The authors suggest that future work should focus on:

  1. Intelligent Feature Recognition: Developing algorithms that can recognize a cart from partial geometric features even if the AR marker is obscured.
  2. Active Environment Interaction: Exploring ways for the robot to potentially move small obstacles out of its way to reach a target cart.
  3. Robustness to Lighting: Improving visual detection for environments with extreme shadows or poor lighting, which are common in unfinished buildings.

Summary updated

Abstract

With the shortage of labor in construction sites, in previous work, we have developed an automatic construction material handling robot. However, for tasks such as cart latching, the target is not fixed to a specific location, and the performance of relative pose estimation may be poor. In this study, we propose a method for recognizing a cart in an arbitrary posture and a hybrid control method for the cart latching. The presented approach has been evaluated in real construction sites.
BibTeX
@article{yang2022development,
  author = {Guang Yang and Shuoyu Wang and Hajime Okamura and Yasuhiro Ueda and Toshiaki Yasui and Tetsuya Yamada and Yuki Miyazawa and Satomi Yoshida and Yuta Inada and Shingo Ino and Kazuo Okuhata and Yoshinobu Mizobuchi},
  title = {{Development of Automatic Construction Material Handling Robot: Autonomous Cart Latching and Evaluation}},
  journal = {Journal of the Robotics Society of Japan},
  year = {2022},
  doi = {10.7210/jrsj.40.837},
}
Figure