An Elderly Care System Based on Multiple Information Fusion

Zhiwei He, Dongwei Lu, Yuxiang Yang, Mingyu GaoJournal of Healthcare Engineering 2018 · DOI

TL;DR

This paper presents a novel elderly care system that fuses data from multiple sensors (video, sound, infrared, pulse) to monitor the well-being of elderly individuals living alone. The system aims to provide timely alerts to relatives in case of emergencies like falls, while respecting privacy by not continuously streaming video.

What Problem Does This Paper Address?

The paper tackles the growing challenge of caring for an aging population, particularly those living alone in "empty nest" situations. Traditional care methods are often insufficient due to family members' busy schedules, and existing technological solutions have limitations. Wearable sensors can be inconvenient, audio-based systems struggle with environmental noise, and vision-based systems raise privacy concerns. The authors aim to develop a comprehensive, privacy-preserving system that accurately monitors daily life and health status, providing crucial alerts when unexpected events occur.

Methods

The core of the system is a multi-information fusion approach, with video processing as a central component. The system comprises four main parts:

  • Information Acquisition Boards: These boards, equipped with infrared, sound, laser, and pulse sensors, are strategically placed in key areas like the gate, toilet, and bedroom. They collect data on activities such as long toilet stays, leaving home, and sleep patterns.
  • Main Control Board: This board, powered by a DSP+ARM dual-core processor (OMAP L138), processes the data from the acquisition boards. It performs video analysis for fall detection and integrates all sensor inputs to assess the elderly person's status.
  • Server: This component stores the collected data in a database.
  • Client: This includes a mobile app and a PC interface that allows relatives to monitor the elderly person's real-time and historical living status.

Key algorithmic contributions include:

  • Video Analysis-Based Falling-Down Detection: This involves three steps:
  • Moving Human Being Detection: An improved background subtraction method is used, incorporating background modeling and updating to extract moving individuals.
  • Shadow Removal: The HSV color space is utilized to distinguish shadows from actual foreground objects, enhancing the accuracy of human detection.
  • Falling-Down Feature Extraction: The system uses the minimum circumscribed rectangle around the detected human body. Features like aspect ratio (K), slope of the centroid (S), and the center of gravity in the x-axis direction (Xmid) are combined to reliably detect falls.
  • Multi-Information Fusion: The system integrates data from various sensors to achieve higher accuracy and robustness compared to single-sensor approaches. For example, sleep abnormality is detected by combining sound and infrared sensor data.

Datasets

Not discussed in the paper. The system appears to be evaluated using real-world experimental setups rather than pre-existing datasets.

Key Insights and Ideas

  • The power of multi-sensor fusion: By combining diverse data streams (visual, auditory, physiological), the system achieves a more comprehensive and reliable understanding of the elderly person's state than any single sensor could provide.
  • Privacy-preserving video analysis: The approach of capturing video only when a fall is suspected, rather than continuous streaming, is a crucial step towards user acceptance and privacy.
  • Robust fall detection through combined features: Relying on a single feature for fall detection can be problematic. The paper's approach of combining aspect ratio, centroid slope, and x-axis center of gravity offers a more robust solution.
  • Addressing environmental challenges: The shadow removal technique is vital for improving the accuracy of visual detection in varying lighting conditions.

Key Results

The system was tested for eight functions, achieving high accuracy rates:

  • Out: 100% accuracy
  • Out without back: 100% accuracy
  • At home: 100% accuracy
  • Toilet abnormality: 98% accuracy
  • Sleeping: 99% accuracy
  • Sleeping abnormality: 97.33% accuracy
  • Getting up: 100% accuracy
  • Falling-down: 94.6% accuracy

These results indicate that the system meets its design requirements for real-time monitoring and emergency notification.

Limitations and Future Work

  • Limitations:
    • The paper acknowledges that while the system is robust, privacy concerns with continuous video monitoring are addressed by only capturing fall events. However, the initial setup and placement of sensors might still require some user involvement.
  • The accuracy of fall detection, while high at 94.6%, still leaves room for improvement.
  • Future Work:
    • The authors suggest integrating additional wearable sensors, such as ECG sensors, to gather even more detailed information about the elderly person's health status. This could lead to a more comprehensive and proactive care system.

Summary updated

Abstract

With the development of social economy in the 21st century, and the rising of medical level, the aging of population have become a global trend. However lots of elderly people are in "empty nest" state. In order to solve the problem of high risk of daily life in this group, this paper proposed a method to integrate the information of video images, sound, infrared, pulse, and other information into the elderly care system. The whole system consists of four major components, that is, the main control board, the information acquisition boards, the server, and the client. The control board receives, processes and analyzes the data collected by the information acquisition boards, and uploads necessary information to the server, which are to be saved to the database. When something unexpected occurs to the elderly, the system will notify the relatives through the GPRS (general packet radio service) module. The system also provides an interface for the relatives to inquire the living status of the elderly through an app. The system can monitor the living status for the elderly with the characteristics of quick response, high accuracy, and low cost and can be widely applied to the elderly care at home.
BibTeX
@article{he2018elderly,
  author = {Zhiwei He and Dongwei Lu and Yuxiang Yang and Mingyu Gao},
  title = {{An Elderly Care System Based on Multiple Information Fusion}},
  journal = {Journal of Healthcare Engineering},
  year = {2018},
  doi = {10.1155/2018/4098237},
}
Figure