Fall Detection Method for Embedded Devices

Xuepei Ma, Xiaohong Wang, Kun ZhangJournal of Imaging Science and Technology 2022 · DOI

This research paper, published in the Journal of Imaging Science and Technology, presents a specialized deep learning approach for detecting falls in the elderly, specifically optimized for the hardware constraints of embedded devices.

TL;DR

The authors introduce OT-YOLOv3, a lightweight fall detection model that combines OpenCV-based image preprocessing with a MobileNet-enhanced version of Tiny-YOLOv3. It achieves a 90% mean Average Precision (mAP) while reducing model size to just 22MB, making it significantly more accurate and efficient for edge computing than standard YOLOv3 architectures.

What Problem Does This Paper Address?

As global populations age, fall detection has become a critical area of health-tech research. While wearable sensors (like accelerometers) are common, they suffer from low compliance—elderly users often forget to wear them or find them uncomfortable. Computer vision offers a non-intrusive alternative, but there is a major technical hurdle: computational cost.

State-of-the-art object detection models like YOLOv3 are "heavyweight," requiring significant memory and high-end GPUs. Embedded devices—such as smart cameras or mobile phones—lack these resources. Previous "Tiny" versions of these models often sacrifice too much accuracy to achieve speed. This paper seeks the "Goldilocks" zone: a model small enough for an embedded chip but accurate enough to reliably distinguish a dangerous fall from a routine movement like squatting.

Methods

The authors propose a hybrid pipeline called OT-YOLOv3 (OpenCV + Tiny-YOLOv3). Their approach consists of two main phases:

  1. Smart Preprocessing (The "O"): Before the image ever hits the neural network, the system uses OpenCV to perform grayscale conversion, Gaussian blurring, and binarization. Crucially, they use contour extraction and affine transformations to correct the angle of the person in the frame. This "normalizes" the input, ensuring that a fall is recognizable regardless of the camera's shooting angle.
  2. Architectural Optimization (The "T"):
    • MobileNet Backbone: The authors replaced the standard feature extraction layers of Tiny-YOLOv3 with MobileNet. MobileNet uses depthwise separable convolutions, which drastically reduce the number of parameters and calculations without a massive hit to accuracy.
  3. Multi-scale Prediction: To better detect people at different distances from the camera, the model uses a multi-scale approach, predicting at both $13 \times 13$ and $26 \times 26$ resolutions.
  4. K-means Clustering: They used K-means to custom-calculate "anchor boxes" (prior boxes) specifically for the shapes of human bodies in various fall states, rather than using generic object anchors.

Datasets

The researchers utilized a self-built dataset of approximately 8,000 images, from which 3,000 high-quality samples were selected for the final experiment. The dataset is categorized into five distinct postures to minimize false positives:

  • Side fall
  • Lying fall
  • Prone fall (face down)
  • Squatting (a common "false alarm" for fall detectors)
  • Standing

Key Insights and Ideas

  • Preprocessing as a Shortcut: By using traditional CV techniques (affine transforms) to handle rotation, the neural network doesn't have to "learn" rotation invariance from scratch. This offloads complexity from the deep learning model to a simpler mathematical operation.
  • The Efficiency of Depthwise Separable Convolutions: The switch to MobileNet is the primary driver for the model's small footprint. It proves that for specific tasks like fall detection, a massive backbone is often overkill.
  • Memory vs. Speed Trade-off: Interestingly, while the model is much smaller (22MB vs 49MB for YOLOv3), its inference time is slightly slower than the original Tiny-YOLOv3. This is because the MobileNet backbone is deeper (more layers), even though it has fewer parameters. However, at 243.6 FPS, it remains well above the threshold for real-time performance.

Key Results

The OT-YOLOv3 model outperformed its predecessors across nearly every metric relevant to embedded deployment:

  • Accuracy (mAP): 90%, compared to 80% for YOLOv3 and 86% for Tiny-YOLOv3.
  • Model Size: Only 22MB (a 55% reduction compared to YOLOv3).
  • Recall Rate: 87%, which is vital for safety applications (minimizing missed falls).
  • Real-time Performance: Achieved a frame rate of 243.6 FPS on the test hardware (Ubuntu 16.04, NVIDIA GTX1080), proving it can easily handle high-speed video streams on less powerful hardware.

Limitations and Future Work

While the model is highly efficient, the authors note that the increased depth of the network adds some complexity to the running time compared to the "thinner" Tiny-YOLOv3.

Future Work: The authors suggest further refining the detection speed without compromising the 90% accuracy threshold. Additionally, while the paper focuses on the algorithm, the next logical step is testing the model on specific low-power ARM-based embedded boards (like a Raspberry Pi or Jetson Nano) to measure actual power consumption and thermal performance in a home environment.

Summary updated

Abstract

The challenges of the aging population is becoming more and more prominent worldwide. Among them, in the face of the elderly fall phenomenon, human fall detection technology research and development has practical application value. Because of a large number of network parameters in the field of fall detection and the limited computing power of embedded devices, which makes it difficult to run on the embedded platform, this paper proposes an OT-YOLOV3 (OpenCV+Tiny-YOLOV3) fall detection method. In this method, Gaussian processing and other operations are used to preprocess the fallen image to avoid the influence of the angle change of the image on the recognition result. Then, the feature extraction network in Tiny-YOLOV3 was replaced by the MobileNet network to increase the number of network layers and reduce the number of parameters and calculations in the model. At the same time, the multi-scale prediction method was used to improve detection accuracy. Experimental results show that the accuracy of the proposed model is 10% higher than that of the YOLOV3 (You Only Look Once Version three) model, 4% higher than that of the Tiny-YOLOV3 model, 3% higher than that of the YOLOV3 model, 3% higher than that of Tiny-YOLOV3 model, and the model size is only 45% of that of YOLOV3 model and 65% of Tiny-YOLOV3. Compared with YOLOV3 and Tiny-YOLOV3 processing methods, the drop recognition effect is significantly improved and the model memory is reduced, which meets the requirements of real-time and efficient detection for embedded devices.
BibTeX
@article{ma2022fall,
  author = {Xuepei Ma and Xiaohong Wang and Kun Zhang},
  title = {{Fall Detection Method for Embedded Devices}},
  journal = {Journal of Imaging Science and Technology},
  year = {2022},
  doi = {10.2352/j.imagingsci.technol.2022.66.4.040407},
}
Figure