Engagement with consumer smartwatches for tracking symptoms of individuals living with multiple long-term conditions (multimorbidity): A longitudinal observational study

Syed Mustafa Ali, David Selby, Khalid Kazi, Katherine Dempsey, Elaine Mackey, Nicola Small, Sabine N van der Veer, Brian McMillan, Peter Bower, Benjamin Brown, John McBeth, William G DixonJournal of Multimorbidity and Comorbidity 2021 · DOI

TL;DR

This study explored the feasibility and engagement of using consumer smartwatches for individuals with multiple long-term conditions (MLTC-M) to track their symptoms over 90 days. The findings suggest that this approach is viable, with engagement levels comparable to studies focusing on single conditions, even with a higher daily data entry burden.

What Problem Does This Paper Address?

Managing multiple long-term conditions (MLTC-M) is a growing challenge, particularly for older adults. Individuals with MLTC-M often experience a complex and accumulating set of symptoms that can fluctuate over time. Traditional research methods, often cross-sectional or using infrequent measurements, struggle to capture the dynamic nature of these symptoms. Consumer technology, specifically smartwatches, offers a promising avenue for longitudinal symptom tracking by combining passive sensor data with active self-reporting. However, there's a lack of research on how individuals with MLTC-M, who may have a higher symptom burden and potentially lower digital literacy, engage with such technology for symptom tracking over an extended period. This paper aims to fill that gap by investigating user engagement with a smartwatch application designed for this population.

Methods

The study employed a prospective observational design called "Watch Your Steps." Participants with MLTC-M were loaned Fossil® Sport smartwatches pre-loaded with a custom study app. The app prompted participants to complete multiple survey questions and active tasks daily for 90 days. The data collection system was co-designed with patients, clinicians, and researchers to balance the relevance of symptom questions with the burden of reporting. Participants were prompted to answer core symptom questions, organ-specific questions tailored to their conditions, and engage in active tasks like sit-to-stand, walk, and tap tests. Engagement was measured by daily completion rates of scheduled questions and tasks. The study also collected data on unscheduled responses and conducted an end-of-study questionnaire to assess the usability and acceptability of the smartwatch app.

Datasets

The study utilized data collected from 53 participants living with MLTC-M over a 90-day period. This dataset comprises daily survey responses, active task completion data, and unscheduled responses recorded via the smartwatch application. No external datasets were used for training or evaluation.

Key Insights and Ideas

  • Feasibility in a Complex Population: The study demonstrates that smartwatches can be a feasible tool for symptom tracking even in individuals managing multiple chronic conditions, a population often excluded from digital health research.
  • Engagement Levels are Promising: Despite the significant daily data entry burden (over 20 responses per day), engagement levels were comparable to studies with healthier populations or those with single conditions. This suggests that with appropriate design, smartwatches can be effective for this demographic.
  • Heterogeneous Engagement: Engagement patterns were not uniform. Older participants (70-79 years) and those with more than three disease areas showed higher engagement, while younger participants and those with fewer conditions were less consistently engaged.
  • Symptom Prioritization: Participants found tracking fatigue, pain, and sleep disturbance most useful, highlighting the importance of tailoring symptom collection to what matters most to patients.
  • Usability is Key: The smartwatch app was generally found to be easy to navigate and use, with participants agreeing on the ease of understanding response scales and entering symptoms.

Key Results

  • Participant Demographics: 53 participants consented, with a near-even split between male (49%) and female (49%) participants. The majority were White (85%) and aged between 50-69 (52%).
  • Completion Rates: The overall completion rate for scheduled symptom questions was 45% (IQR 23-67%). Participants aged 70-79 had the highest completion rate (73%, IQR 55-82%).
  • Daily Engagement: Approximately one-third of participants engaged with the app nearly every day. Over three-quarters (77%) remained in the study for the full 90 days, though some engagement was sporadic.
  • Active Task Completion: None of the participants completed all assigned active tasks. The tap test was completed most often, followed by the sit-to-stand and walk tests.
  • Unscheduled Responses: All participants provided at least one unscheduled response, with some providing a very large number, indicating flexibility in data entry beyond prompts.
  • Time of Day Preferences: Participants found prompts around 20:00 most convenient, and this time also saw higher completion rates for both prompted and unprompted responses.
  • Usability: 86% of participants found the app easy to navigate, and 86% found the response scale easy to understand. 80% found it easy to enter symptoms.

Limitations and Future Work

The authors acknowledge several limitations:

  • Self-Selection Bias: Participants self-selected to join the study, which may lead to a more motivated cohort with potentially higher engagement than an unselected group.
  • Age Distribution: The study population was younger than the typical MLTC-M population, which might influence engagement patterns.
  • Study Duration: The 90-day study period limits inferences about engagement beyond this timeframe, as mHealth app engagement tends to decay over time.

Future work suggested includes:

  • Personalized Data Collection: Developing more flexible and personalized data collection schedules that reflect individual conditions, perceived symptom priorities, and lifestyles.
  • Incentives and Feedback: Exploring the impact of adding incentives, such as real-time feedback on tracked symptoms, to further enhance engagement.
  • Integration with EHRs: Investigating the integration of patient-reported symptoms from smartwatches into electronic health records to support clinical care and shared decision-making.
  • Longer-Term Studies: Conducting longer-term studies to understand sustained engagement and the potential utility of symptom tracking over extended periods.

Summary updated

Abstract

It was feasible for people living with MLTC-M to report multiple symptoms per day over 3 months. User engagement appeared as good as other mobile health studies that recruited people with single health conditions, despite the higher daily data entry burden.
BibTeX
@article{ali2021engagement,
  author = {Syed Mustafa Ali and David Selby and Khalid Kazi and Katherine Dempsey and Elaine Mackey and Nicola Small and Sabine N van der Veer and Brian McMillan and Peter Bower and Benjamin Brown and John McBeth and William G Dixon},
  title = {{Engagement with consumer smartwatches for tracking symptoms of individuals living with multiple long-term conditions (multimorbidity): A longitudinal observational study}},
  journal = {Journal of Multimorbidity and Comorbidity},
  year = {2021},
  doi = {10.1177/26335565211062791},
}
Figure