Learning Rhythmic Trajectories With Geometric Constraints for Laser-Based Skincare Procedures

Anqing Duan, Wanli Liuchen, Jinsong Wu, Raffaello Camoriano, Lorenzo Rosasco, David Navarro-Alarcon

TL;DR

This paper introduces a novel imitation learning framework that enables robots to perform precise, rhythmic laser-based cosmetic procedures on human skin. By incorporating geometric constraints and a structured prediction approach, the system can learn complex, quasi-periodic movements from expert demonstrations and adapt them to new subjects.

What Problem Does This Paper Address?

The beauty industry is increasingly leveraging robotic automation for procedures like laser-based skin treatments. However, automating these tasks, which involve delivering energy from a cosmetic laser onto the skin in specific, repetitive patterns, presents significant challenges. Human practitioners possess a nuanced dexterity that is difficult to replicate with traditional robotic programming. Existing methods often rely on hardcoding motions, making them inflexible and unable to adapt to variations in patient anatomy or procedure requirements. This paper aims to bridge this gap by developing a robot that can learn and adapt these skilled, rhythmic movements from human demonstrations.

Methods

The core of the proposed solution lies in a novel imitation learning algorithm that utilizes structured prediction and is designed to handle geometric constraints. The approach involves:

  • Learning from Demonstration (LfD): The robot learns by observing and mimicking a human expert performing the procedure.
  • Structured Prediction Framework: This framework is particularly adept at handling outputs with inherent geometric structures, like trajectories on a 3D surface. It uses a surrogate approach, where the complex output space (the 3D surface) is mapped to a simpler, linear surrogate space. The learning then occurs in this surrogate space, and the solution is decoded back to the original space.
  • Geometric Constraints: The algorithm explicitly accounts for the fact that the laser trajectory must adhere to the 3D geometry of the human face. This is achieved through a novel structured prediction algorithm that can handle quasi-periodic motions, a common characteristic of these procedures.
  • Kernel Design: The choice of kernel function is crucial for capturing the rhythmic nature of the movements. The paper explores the use of periodic and quasi-periodic kernels to effectively model these patterns, moving beyond the limitations of standard squared exponential kernels.
  • Skill Adaptation: To treat new subjects not present in the demonstrations, the paper proposes a probabilistic non-rigid registration technique. This method allows the learned trajectory to adapt to variations in facial shape by incorporating covariance matrices, providing more flexibility than deterministic approaches.

Datasets

The paper does not explicitly mention or introduce new public datasets for training or evaluation. Instead, it relies on demonstrations collected from human experts performing cosmetic laser procedures. The experiments are conducted using these collected demonstrations and evaluated on simulated and real facial data.

Key Insights and Ideas

  • Structured Prediction for Geometry: The paper highlights the power of structured prediction for tasks involving outputs with inherent geometric structures, like trajectories on manifolds. This approach allows for more robust and accurate imitation learning in such scenarios.
  • Kernel Engineering for Rhythm: The choice of kernel function is critical for capturing the specific dynamics of the demonstrated motion. The paper demonstrates that specialized kernels (periodic and quasi-periodic) are essential for accurately replicating rhythmic laser movements, outperforming general-purpose kernels.
  • Probabilistic Adaptation for Robustness: Incorporating probabilistic information (covariance matrices) into non-rigid registration allows for more flexible and robust adaptation of learned skills to new subjects, accounting for variations in facial features and potentially even local skin conditions.
  • Implicit Embedding: The use of an implicit embedding framework for structured prediction eliminates the need for explicit knowledge of the underlying Hilbert space, feature maps, or operators, simplifying the learning process.

Key Results

  • The proposed algorithm successfully replicates rhythmic movements from demonstrations, capturing quasi-periodic patterns effectively.
  • The method demonstrates the ability to adapt learned skills to previously unseen scenarios and subjects, as shown in adaptation experiments.
  • Quantitative evaluations (Table I, Table III, Table IV) show that the proposed approach, particularly with the quasi-periodic kernel, achieves lower imitation errors compared to other state-of-the-art methods for learning geometric trajectories.
  • The spherelet-based approach for geodesic distance calculation is shown to be efficient and achieve comparable accuracy to other methods.

Limitations and Future Work

  • Static Subjects: In the current experimental setup, human subjects are required to remain still during treatment. The authors acknowledge that incorporating reactive behaviors to respond to potential subject movements is a crucial area for future work.
  • Thermal Dose Control: While the paper focuses on trajectory imitation, future work will involve obtaining quantitative evidence regarding the administration of thermal doses for enhancing skin conditions.
  • New Thermal Servoing Controls: The researchers are actively working on developing new thermal servoing controls for these types of laser-based procedures.

Summary updated

Abstract

The increasing deployment of robots has significantly enhanced the automation levels across a wide and diverse range of industries. This paper investigates the automation challenges of laser-based dermatology procedures in the beauty industry; This group of related manipulation tasks involves delivering energy from a cosmetic laser onto the skin with repetitive patterns. To automate this procedure, we propose to use a robotic manipulator and endow it with the dexterity of a skilled dermatology practitioner through a learning-from-demonstration framework. To ensure that the cosmetic laser can properly deliver the energy onto the skin surface of an individual, we develop a novel structured prediction-based imitation learning algorithm with the merit of handling geometric constraints. Notably, our proposed algorithm effectively tackles the imitation challenges associated with quasi-periodic motions, a common feature of many laser-based cosmetic tasks. The conducted real-world experiments illustrate the performance of our robotic beautician in mimicking realistic dermatological procedures; Our new method is shown to not only replicate the rhythmic movements from the provided demonstrations but also to adapt the acquired skills to previously unseen scenarios and subjects.
BibTeX
@article{duan2023learning,
  author = {Anqing Duan and Wanli Liuchen and Jinsong Wu and Raffaello Camoriano and Lorenzo Rosasco and David Navarro-Alarcon},
  title = {{Learning Rhythmic Trajectories With Geometric Constraints for Laser-Based Skincare Procedures}},
  journal = {IEEE Trans. Robotics},
  year = {2023},
}
Figure