How Accurately Can Your Wrist Device Recognize Daily Activities and Detect Falls?

Martin Gjoreski, Hristijan Gjoreski, Mitja Lustrek, Matjaz Gams

TL;DR

This paper systematically evaluates activity recognition (AR) and fall detection (FD) using wrist-worn accelerometers, demonstrating their viability despite common assumptions about poor performance. The authors developed and tested robust methods on four diverse datasets, finding that wrist placement can be surprisingly effective, especially with advanced feature engineering, and that the non-dominant wrist often yields better results.

What Problem Does This Paper Address?

The widespread adoption of wearable sensors for health monitoring, such as activity tracking and fall detection, is hindered by user discomfort with multiple devices or placements perceived as intrusive. While wrist-worn devices like smartwatches are appealing due to their familiarity, their effectiveness for AR and FD has been questioned. This is because the hand's frequent and irregular movements can introduce noise, potentially leading to lower accuracy compared to torso-worn sensors. This paper aims to bridge this gap by rigorously evaluating wrist-based AR and FD performance across various datasets and sensor placements, challenging the notion that wrist placement is inherently inferior.

Methods

The authors employed a machine learning (ML) pipeline for Activity Recognition (AR) consisting of:

  • Data Segmentation: Using a 4-second sliding window with a 2-second overlap.
  • Data Filtering: Applying low-pass and band-pass filters.
  • Feature Extraction: Generating 53 features from accelerometer data, capturing posture, motion shape, variation, and similarity.
  • Feature Selection: A crucial step that reduced the feature set by 34% (from 53 to 33) by removing highly correlated and low-information-gain features, significantly reducing computational complexity without sacrificing accuracy.
  • Classification: Comparing five ML algorithms (J48, NB, SVM, RF, KNN), with Random Forest (RF) consistently showing the best performance.

For Fall Detection (FD), a two-module approach was used:

  • Acceleration Fall Pattern (AFP): Detecting a characteristic drop and rapid increase in acceleration indicative of a fall.
  • Movement Detection: Analyzing the Acceleration Vector Changes (AVC) to distinguish true falls from activities that mimic falls (e.g., quickly sitting down). This combined approach was shown to outperform simpler AFP-only methods.

Datasets

The study utilized four datasets:

  • JSI Dataset: Collected in a lab setting with 5 participants, including specific fall scenarios and everyday activities. This dataset was used for initial feature analysis and method development.
  • Faculty of Sports (FoS) Dataset: A lab-based dataset with 10 participants, focusing more on exercise activities and omitting fall scenarios.
  • Opportunity Dataset: A widely used benchmark dataset for AR, featuring activities of daily living from 3 subjects. Only wrist acceleration data was used.
  • Real-Life Empatica Dataset: Collected from 3 participants wearing a wristband device for several weeks in unconstrained daily life. This dataset was unlabeled for AR, but used to evaluate the AR model's ability to capture daily rhythms and to assess FD false positives.

Key Insights and Ideas

  • Wrist is Viable: Contrary to some prior assumptions, wrist-worn accelerometers can achieve competitive accuracy for AR and FD, especially when employing sophisticated feature engineering and selection.
  • Left Wrist Advantage: The non-dominant (left) wrist generally performed better for both AR and FD compared to the dominant (right) wrist, suggesting it captures more informative motion patterns.
  • Feature Engineering Matters: The authors' feature extraction and selection process significantly improved performance and reduced computational load, highlighting its importance for resource-constrained wearable devices.
  • Fall Detection Nuances: While fast falls are reliably detected, slow falls and fall-like activities (like quickly lying down) require careful post-detection analysis to minimize false alarms.
  • Real-Life Validation: The study successfully demonstrated the applicability of the developed methods on real-life, unlabeled data, providing insights into daily activity patterns.

Key Results

  • Activity Recognition Accuracy:
    • On the JSI dataset, the left wrist achieved 72% accuracy, outperforming the right wrist (68%), elbow, and chest, but was worse than the ankle, knee, and belt.
  • The Opportunity dataset showed that their method outperformed related work, indicating the effectiveness of their feature preprocessing.
  • The real-life dataset successfully captured daily rhythms and activities.
  • Fall Detection Performance (JSI Dataset, Left Wrist):
    • Achieved 85% overall accuracy.
  • Detected all fast falls and 40% of slow falls.
  • Minimized false positives, with only 10 false alarms during 100 non-fall events.
  • False Positives (FD):
    • JSI Dataset: 9 false positives for the left wrist.
  • Faculty of Sports Dataset: 9 false positives for the right wrist.
  • Opportunity Dataset: 1 false positive.
  • Real-Life Empatica Dataset: 15 false alarms over 57 days (1378 hours), which is considered encouraging.

Limitations and Future Work

  • Subject Demographics: The study primarily used young, active participants. Further validation with elderly populations is needed for direct clinical application of fall detection.
  • Fall Mimicry: Distinguishing slow falls from activities like quickly lying down remains a challenge, requiring further refinement of the movement detection module.
  • Sensor Placement: While wrist performance was evaluated, the study acknowledges that placements like the ankle, knee, and belt can still achieve higher AR accuracy.
  • Future Work:
    • Exploring higher-level features that capture instance dependencies.
  • Applying Deep Learning techniques for AR and FD.
  • Integrating energy expenditure estimation (METs) for a more comprehensive health monitoring system.
  • Implementing and testing methods on Android smartwatches over extended periods.
  • Developing strategies to handle wristband removal (e.g., for charging) and improve night-time fall detection.

Summary updated

Abstract

Although wearable accelerometers can successfully recognize activities and detect falls, their adoption in real life is low because users do not want to wear additional devices. A possible solution is an accelerometer inside a wrist device/smartwatch. However, wrist placement might perform poorly in terms of accuracy due to frequent random movements of the hand. In this paper we perform a thorough, large-scale evaluation of methods for activity recognition and fall detection on four datasets. On the first two we showed that the left wrist performs better compared to the dominant right one, and also better compared to the elbow and the chest, but worse compared to the ankle, knee and belt. On the third (Opportunity) dataset, our method outperformed the related work, indicating that our feature-preprocessing creates better input data. And finally, on a real-life unlabeled dataset the recognized activities captured the subject’s daily rhythm and activities. Our fall-detection method detected all of the fast falls and minimized the false positives, achieving 85% accuracy on the first dataset. Because the other datasets did not contain fall events, only false positives were evaluated, resulting in 9 for the second, 1 for the third and 15 for the real-life dataset (57 days data).
BibTeX
@inproceedings{gjoreski2016how,
  author = {Martin Gjoreski and Hristijan Gjoreski and Mitja Lustrek and Matjaz Gams},
  title = {{How Accurately Can Your Wrist Device Recognize Daily Activities and Detect Falls?}},
  booktitle = {Sensors},
  year = {2016},
  url = {https://openreview.net/forum?id=NI6UVKt4sP},
}
Figure