An Automated, Online Feasibility Randomized Controlled Trial of a Just-In-Time Adaptive Intervention for Smoking Cessation (Quit Sense)

Felix Naughton, Aimie Hope, Chloë Brown, Kelly Grant, Garry Barton, Caitlin Notley, Cecilia Mascolo, Tim Coleman, Lee Shepstone, Stephen Sutton, A Toby Prevost, David Crane, Felix Greaves, Juliet HighNicotine 2023 · DOI

TL;DR

This paper presents a feasibility trial of "Quit Sense," an automated, smartphone-based intervention designed to help smokers quit by providing just-in-time support based on their learned smoking cues. The study demonstrates that this automated approach is feasible, cost-effective, and shows promising early evidence of increased biochemically verified abstinence compared to usual care.

What Problem Does This Paper Address?

Smoking remains a major global health crisis, with millions of premature deaths annually. A significant challenge in smoking cessation is managing "situational triggers" or cues that lead to lapses and subsequent relapse. These cues can be proximal (e.g., seeing someone smoke) or distal (e.g., being in a familiar smoking environment). Existing cessation methods, like medication or standard text message support, often fail to address these immediate, context-specific cravings effectively. The paper addresses the need for a rapid, accessible, and personalized intervention that can help smokers manage these cue-induced cravings in real-time.

Methods

The study employed a two-arm feasibility randomized controlled trial (RCT) with an automated online recruitment and intervention delivery system. Participants were randomized 1:1 to either "usual care" (referral to the NHS SmokeFree website) or "usual care" plus an invitation to install the Quit Sense app.

Quit Sense is a "Just-In-Time Adaptive Intervention" (JITAI) that utilizes passive measurement. It learns a user's smoking habits and locations through self-reported smoking events and geofencing. When a user enters a previously identified smoking location, the app can trigger "Geofence-Triggered Support" (GTS) messages designed to help manage cravings. The intervention progresses through three stages: training the app, a 28-day abstinence challenge, and a maintenance phase.

Key methodological aspects include:

  • Automated Procedures: Most trial procedures, including recruitment, randomization, and follow-up communication (except for manual follow-up for non-responders and saliva sample handling), were automated to reduce costs and researcher time.
  • Passive Measurement JITAI: Quit Sense is novel in its use of passive measurement (geofencing) to trigger adaptive support, differentiating it from active measurement JITAIs.
  • Feasibility Focus: The trial was designed to estimate parameters for a definitive evaluation, focusing on recruitment rates, engagement, and preliminary outcome data.
  • Biochemical Verification: Abstinence was verified using cotinine assessment from saliva samples, a gold standard for confirming smoking cessation.

Datasets

Not discussed in the paper. The study involved recruiting participants via online advertisements on platforms like Facebook and Google.

Key Insights and Ideas

  • Feasibility of Automated Trials: The study strongly supports the feasibility of running automated online RCTs for smoking cessation interventions, demonstrating cost-effectiveness and high participant engagement.
  • App Adoption and Engagement: When offered, a significant majority of smokers (75%) installed the Quit Sense app, and about half (51%) engaged with it for more than a week, suggesting good initial uptake and moderate sustained use.
  • Potential for Increased Abstinence: Preliminary evidence suggests Quit Sense may increase biochemically verified abstinence rates at 6 months compared to usual care, indicating its potential effectiveness.
  • Low Saliva Return Rates are a Challenge: The low and imbalanced return rate of saliva samples for cotinine verification is a significant limitation, leading to imprecision in effect size estimates and highlighting the need for improved strategies in future trials.
  • Mechanisms of Action Not Yet Evident: At the 6-week follow-up, no significant differences were found in hypothesized mechanisms of action (e.g., self-efficacy, urge strength), suggesting that any observed benefits of Quit Sense might be more related to sustained abstinence rather than immediate changes in these psychological factors.

Key Results

  • Recruitment: The trial successfully recruited 209 participants, with a cost per recruit of £19.20.
  • Follow-up Rates: 6-month follow-up completion rates for self-reported outcomes were 77% (95% CI 71%, 82%).
  • Saliva Sample Return: Viable saliva sample return rate for biochemical validation was low at 39% (95% CI 24%, 54%).
  • App Usage: 75% (95% CI 67%, 83%) of Quit Sense participants installed the app, and 51% engaged for more than one week.
  • Abstinence Rates (6-month, biochemically verified):
    • Quit Sense: 11.5% (12/104)
    • Usual Care: 2.9% (3/105)
    • Adjusted Odds Ratio (OR): 4.57 (95% CI 1.23, 16.94)
  • Abstinence Rates (6-month, self-reported): 77% (160/209) overall.
  • Recommendation: 67% of Quit Sense users would recommend the app to a friend trying to quit.
  • Ease of Use: Most users found the app easy to use.

Limitations and Future Work

Limitations: * Low Saliva Return Rate: The primary limitation is the low and imbalanced saliva sample return rate, which significantly impacts the precision of the abstinence outcome. This was potentially exacerbated by the COVID-19 pandemic and the low £5 incentive. * Sample Diversity: The trial did not include older age groups (participants were up to 61 years old) and struggled to reach the target proportion of the lowest socioeconomic status category. * COVID-19 Impact: The trial was conducted during the pandemic, which may have affected participants' routines, movement, and exposure to smoking locations, potentially influencing app effectiveness and geofencing accuracy. * Potential for Interviewer Effect: Process evaluation interviews conducted at 6 weeks might have acted as an intervention, with more intervention participants interviewed than control participants. * Measurement Error: Geofencing accuracy can lead to measurement error, potentially causing false negatives where support is not delivered.

Future Work: * Increase Saliva Return Rates: Future trials should consider higher incentives for saliva returns and explore strategies to improve sample diversity. * Optimize Engagement: Further research is needed to investigate approaches to optimally increase engagement with smoking cessation apps. * Expand Recruitment Strategies: Efforts are needed to broaden recruitment to include older age groups and ensure better representation of lower socioeconomic status individuals. * Refine JITAI Design: Future work could explore how to better capture and utilize mechanisms of action to enhance intervention effectiveness. * Definitive Trial: The findings strongly support the need for a larger, definitive RCT to confirm the effectiveness of Quit Sense.

Summary updated

Abstract

Running a primarily automated trial to initially evaluate Quit Sense was feasible, resulting in modest recruitment costs and researcher time, and high trial engagement. When invited, as part of trial participation, to install a smoking cessation app, most participants are likely to do so, and, for those using Quit Sense, an estimated one-half will engage with it for more than 1 week. Evidence that Quit Sense may increase verified abstinence at 6-month follow-up, relative to usual care, was generated, although low saliva return rates to verify smoking status contributed to considerable imprecision in the effect size estimate.
BibTeX
@inproceedings{naughton2023automated,
  author = {Felix Naughton and Aimie Hope and Chloë Brown and Kelly Grant and Garry Barton and Caitlin Notley and Cecilia Mascolo and Tim Coleman and Lee Shepstone and Stephen Sutton and A Toby Prevost and David Crane and Felix Greaves and Juliet High},
  title = {{An Automated, Online Feasibility Randomized Controlled Trial of a Just-In-Time Adaptive Intervention for Smoking Cessation (Quit Sense)}},
  booktitle = {Nicotine},
  year = {2023},
  doi = {10.1093/ntr/ntad032},
}
Figure