Use of Lower Limb Exoskeletons as an Assessment Tool for Human Motor Performance: A Systematic Review

Tobias Moeller, Felix Moehler, Janina Krell-Roesch, Miha Dezman, Charlotte Marquardt, Tamim Asfour, Thorsten Stein, Alexander Woll

TL;DR

This systematic review synthesizes research on using lower limb exoskeletons to assess human motor performance. It finds that exoskeletons, particularly stationary and single-joint models, offer objective and specific measurements of parameters like range of motion, strength, and gait, potentially surpassing traditional manual tests. However, the quality and specificity of these assessments need careful examination before widespread clinical adoption.

What Problem Does This Paper Address?

Motor performance, encompassing strength, balance, and gait, often declines with age or due to injury and illness, impacting independence and quality of life. While traditional clinical assessments exist, they can be time-consuming, costly, and subjective. The paper addresses the growing potential of exoskeletons, equipped with numerous sensors, to provide continuous, objective, and detailed motor performance data. This review aims to consolidate existing research on how these devices are being used as assessment tools, what motor parameters they can measure, and the methodologies employed, highlighting the need for rigorous validation.

Methods

The authors conducted a systematic literature review following PRISMA guidelines. They searched PubMed, Scopus, and Web of Science for studies using lower limb exoskeletons to assess motor performance. Eligibility criteria included studies measuring parameters like joint angles, muscle strength, gait, proprioception, and spasticity. Studies focusing solely on cognitive parameters or simulated exoskeletons were excluded. The review analyzed 49 studies, categorizing them by exoskeleton type (stationary vs. mobile), motor performance parameter measured, and whether they included validity or reliability testing. A quality assessment tool was adapted to evaluate the risk of bias in validity and reliability studies.

Datasets

Not discussed in the paper. The paper focuses on a systematic review of existing studies rather than introducing new datasets or benchmarks.

Key Insights and Ideas

  • Exoskeletons as Objective Assessors: The built-in sensors of exoskeletons offer a path towards more objective and specific measurements of motor performance compared to traditional, often subjective, manual tests.
  • Stationary vs. Mobile: Stationary exoskeletons (like the Lokomat) offer advantages in controlled environments, while mobile ones provide flexibility for real-world assessments, though with increased confounding variables.
  • Parameter Breadth: Exoskeletons are versatile, capable of measuring a wide array of motor parameters, from basic joint angles and muscle strength to complex gait dynamics and proprioception.
  • Validation is Crucial: While promising, the accuracy of exoskeleton-derived motor performance data relies heavily on sensor quality, placement, and sophisticated algorithms. Simply using raw sensor data is often insufficient.
  • Clinical Potential, But Caution Needed: Exoskeletons hold significant promise for rehabilitation and training, but their use as a definitive assessment tool requires careful validation against gold standards and consideration of their potential influence on the very performance they aim to measure.

Key Results

The review included 49 studies that examined 33 different exoskeletons. Of these, 7 were stationary and 26 were mobile. The majority of studies measured parameters such as range of motion (n=20), gait parameters (n=14), muscle strength and joint torque (n=15), and stiffness/spasticity/impedance (n=11). Proprioception was assessed in 4 studies.

  • Validity and Reliability: 19 studies focused on validity, and 6 on reliability. The overall quality of these studies was rated as good, with an average score of 5.41 out of 8, indicating a low risk of bias. However, common limitations included small sample sizes and single-time measurements.
  • Parameter Measurement: Joint angles were the most frequently measured parameter, followed by gait parameters and muscle strength/joint torque.
  • Sensor Usage: A wide variety of sensors were employed, with encoders and IMUs being the most common for kinematics, and force sensors and load cells for kinetics.
  • Accuracy: While many studies showed good correlation with manual assessments or gold standards, some reported deviations up to 7° for joint angles, highlighting the need for careful validation, especially for applications requiring high precision like inverse dynamics calculations.

Limitations and Future Work

The authors acknowledge several limitations:

  • Heterogeneous Target Populations: Studies often focused on young, healthy males or specific patient groups (e.g., stroke, SCI), limiting generalizability. Future research should include more diverse populations (women, older adults, individuals with cognitive impairments).
  • Lack of Detailed Methodologies: Many studies lacked detailed descriptions of sensor positions, sampling rates, and algorithms, hindering reproducibility and comparison.
  • Definition of Exoskeleton: The distinction between exoskeletons and advanced orthoses can be blurry, leading to potential inconsistencies in study inclusion.
  • Exoskeleton Influence: A significant limitation is the potential for the exoskeleton itself to influence motor performance (e.g., through weight, control, or joint misalignment). This effect needs to be minimized or accounted for.
  • Validation Gaps: While many studies showed promise, comprehensive validation studies examining accuracy, reliability, and clinical relevance are still scarce.

Future work should focus on:

  • Developing standardized assessment protocols and algorithms.
  • Investigating the impact of exoskeletons on motor performance and how to mitigate it.
  • Exploring the use of exoskeletons for assessing parameters like dynamic balance and fall prediction.
  • Expanding research to diverse user groups and real-world environments.
  • Improving the accuracy of sensor data processing, potentially through advanced machine learning techniques, and validating these against gold standards.

Summary updated

Abstract

Exoskeletons are a promising tool to support individuals with a decreased level of motor performance. Due to their built-in sensors, exoskeletons offer the possibility of continuously recording and assessing user data, for example, related to motor performance. The aim of this article is to provide an overview of studies that rely on using exoskeletons to measure motor performance. Therefore, we conducted a systematic literature review, following the PRISMA Statement guidelines. A total of 49 studies using lower limb exoskeletons for the assessment of human motor performance were included. Of these, 19 studies were validity studies, and six were reliability studies. We found 33 different exoskeletons; seven can be considered stationary, and 26 were mobile exoskeletons. The majority of the studies measured parameters such as range of motion, muscle strength, gait parameters, spasticity, and proprioception. We conclude that exoskeletons can be used to measure a wide range of motor performance parameters through built-in sensors, and seem to be more objective and specific than manual test procedures. However, since these parameters are usually estimated from built-in sensor data, the quality and specificity of an exoskeleton to assess certain motor performance parameters must be examined before an exoskeleton can be used, for example, in a research or clinical setting.
BibTeX
@inproceedings{moeller2023use,
  author = {Tobias Moeller and Felix Moehler and Janina Krell-Roesch and Miha Dezman and Charlotte Marquardt and Tamim Asfour and Thorsten Stein and Alexander Woll},
  title = {{Use of Lower Limb Exoskeletons as an Assessment Tool for Human Motor Performance: A Systematic Review}},
  booktitle = {Sensors},
  year = {2023},
  url = {https://openreview.net/forum?id=L8zCutgpom},
}
Figure