Promoting Psychological Resilience and Well-Being in Youth With a Smartphone-Based Ecological Momentary mHealth Intervention: Secondary Analysis of a Micro-Randomized Trial (Preprint)

Eva Wierzba, Anita Schick, Christian Rauschenberg, Janik Fechtelpeter, Selina Hiller, Christian Götzl, Daniel Durstewitz, Silvia Krumm, Georgia Koppe, Ulrich Reininghaus2025 · DOI

TL;DR

This study investigated whether immediately engaging with a smartphone-based mental health intervention component (an "ecological momentary intervention" or EMI) could lead to short-term improvements in young people's mood and stress levels. The findings suggest that, contrary to expectations, simply initiating an EMI component didn't directly impact immediate well-being outcomes, though changes in resilience were linked to well-being.

What Problem Does This Paper Address?

Young people are increasingly facing mental health challenges, exacerbated by recent crises like the COVID-19 pandemic. While digital interventions offer a promising avenue for accessible mental health support, understanding how they work is crucial for optimizing their effectiveness. Specifically, this paper delves into the concept of "proximal effects" – the immediate impact of engaging with a specific intervention component. The authors hypothesize that by using smartphone-based tools to deliver "ecological momentary interventions" (EMIs) designed to boost resilience, they could see an instant positive shift in users' mood and stress levels. This is important because if we can pinpoint these immediate effects, we can better design interventions that lead to longer-term improvements in mental well-being.

Methods

The researchers conducted a secondary analysis of data from a "microrandomized trial" (MRT) involving a 30-day smartphone-based digital training called AI4U. This training aimed to promote psychological resilience and well-being in young people (aged 14-25).

The core methodology involved:

  • Ecological Momentary Assessment (EMA): Participants received up to six prompts per day to report on their momentary mental well-being (positive affect, negative affect, and stress) and resilience.
  • Ecological Momentary Interventions (EMIs): Some EMA prompts triggered the delivery of short, guided exercises (e.g., mindfulness, positive imagery, compassion-focused techniques) designed to boost resilience.
  • Microrandomization: Participants were randomly assigned to receive either an EMI component or a control condition at specific points, allowing for a within-subject comparison.
  • Multilevel Modeling: This statistical technique was used to analyze the nested data structure (time points within participants) and examine the "proximal effects" – how initiating an EMI at one time point (t<sub>n-1</sub>) influenced well-being outcomes at the next assessment (t<sub>n</sub>).
  • Moderation and Mediation Analysis: The study also explored whether the level of well-being at the time of EMI initiation influenced its effect (moderation) and whether changes in resilience explained any observed effects (mediation).

Datasets

The study utilized data collected from a convenience sample of 170 participants (aged 14-25) who completed the AI4U training. This data comprised:

  • Sociodemographic information: Collected via online questionnaires.
  • Baseline psychological distress: Measured using the Kessler Psychological Distress Scale (K10).
  • Ecological Momentary Assessment (EMA) data: Collected up to six times daily for 30 days, capturing momentary positive affect, negative affect, stress, and resilience.
  • EMI initiation data: Recorded when participants actively engaged with an EMI component triggered by an EMA prompt.

No new datasets were introduced or made publicly available as part of this secondary analysis.

Key Insights and Ideas

  • The "Moment" Matters, But Not Always as Expected: The core idea is that interventions delivered "just in time" should have an immediate impact. However, this study found that simply initiating an EMI component didn't reliably lead to an immediate change in positive affect, negative affect, or stress. This challenges the direct, immediate proximal effect hypothesis for this specific intervention.
  • Resilience is Key, But Its Role is Complex: While changes in resilience were indeed associated with improvements in well-being (more resilience meant better mood and less stress), this change in resilience didn't appear to be the mediating factor explaining why initiating an EMI might work. This suggests that while resilience is important, the link between EMI initiation and well-being might not be solely through an immediate boost in resilience.
  • Context is Crucial for Digital Interventions: The authors highlight that for digital interventions to be effective, participant engagement (adherence) is paramount. Low adherence to EMA prompts and EMI components could be masking potential proximal effects. This underscores the challenge of designing interventions that maintain user engagement over time.
  • The "Control" Group Might Be Active: A thought-provoking point is that the act of completing EMA prompts itself might have a positive effect on well-being by increasing self-awareness. This could potentially "mask" or obscure the specific effects of the EMI components, making it harder to detect their unique impact.

Key Results

  • No Direct Proximal Effects Found: Initiating an EMI component at time point t<sub>n-1</sub> did not significantly predict changes in positive affect, negative affect, or stress at the subsequent time point t<sub>n</sub>. The confidence intervals for these effects included zero.
  • Moderation Effects Were Weak: The study found no strong evidence that the level of well-being (high vs. low positive affect, negative affect, or stress) at the time of EMI initiation significantly altered the effect of initiating the EMI. While some small effects were observed, they were not consistently significant or robust.
  • Resilience Changes Linked to Well-being, But Not as a Mediator: Changes in momentary resilience were positively associated with increases in positive affect and decreases in negative affect and stress. However, these changes in resilience did not mediate the effect of EMI initiation on well-being outcomes.
  • Sample Characteristics: The analytic sample consisted of 170 participants, predominantly female (73.5%), with a mean age of 20.41 years.

Limitations and Future Work

The authors acknowledge several limitations:

  • Secondary Analysis: The study was a secondary analysis, meaning the original trial was not specifically powered to test these hypotheses. While sample size considerations were made, the power for these specific secondary analyses might still be limited.
  • Time Lag in EMA: The time between an EMA prompt and the subsequent EMI initiation, and then to the next EMA, was not fixed and could be several hours. This temporal gap means the observed "proximal effect" might not be truly immediate and could be influenced by other factors. Future studies should aim for EMA prompts immediately following EMI components.
  • Adherence and Fidelity: The high variability in EMA completion rates and the potential for participants to not fully adhere to EMI instructions (or to perform exercises independently) could have masked or attenuated any observed effects. Future research needs to better assess and account for adherence and fidelity.
  • EMI Component Specificity: Not all EMI components are designed for immediate effects. Some are more psychoeducational. Future work could investigate the proximal effects of specific types of EMI components.
  • Limited Measurement: The use of single or few items to measure complex constructs like resilience might not capture the full picture, potentially limiting the ability to detect subtle changes or effects.

Future work should focus on:

  • Designing studies with tighter temporal proximity between EMI delivery and EMA assessment.
  • Developing more robust measures of adherence and fidelity.
  • Investigating the differential effects of various EMI component types.
  • Exploring the potential "masking" effect of EMA itself on intervention effects.
  • Expanding the understanding of how proximal effects translate into distal outcomes.

Summary updated

Abstract

<sec> <title>BACKGROUND</title> Young individuals have been facing a multitude of crises in the past years, which may be associated with negative mental health outcomes. Interventions to mitigate the negative impact and promote mental well-being are necessary. Ecological momentary interventions (EMIs) may be a promising tool for promoting mental well-being as they allow to target resilience and other protective factors in daily life. </sec> <sec> <title>OBJECTIVE</title> In this secondary analysis of a micro-randomized trial, we explored proximal effects of a compassion-focused smartphone-based digital training for young people applying principles and techniques of EMI (the AI4U training) on momentary outcomes of mental well-being. </sec> <sec> <title>METHODS</title> Participants aged 14 to 25 years completed up to six ecological momentary assessments (EMA) per day to measure their momentary mental well-being (ie, positive affect, negative affect, and stress) during the 30-day AI4U training phase. Some EMA prompts triggered EMI components to promote their momentary resilience and well-being. Proximal effects of initiating EMI components on outcomes assessed at the next time point were analyzed using multilevel modelling. Moderation and mediation analyses were applied to investigate the potential moderating effect of momentary affect and stress at the time of EMI initiation and to explore change in momentary resilience as a mediator of the effect of EMI initiation on changes in momentary affect and stress. </sec> <sec> <title>RESULTS</title> 170 individuals completed 13059 EMA prompts and initiated 6667 EMI components. No evidence was found that momentary outcomes of mental well-being at a time point differed depending on whether an EMI component was initiated at the previous time point vs. when no EMI component was initiated (positive affect: b=0.00, CI -0.04 to 0.04; negative affect: b=-0.01, CI -0.05 to 0.03; stress: b=0.01, CI -0.03 to 0.05). There was no strong difference in the magnitude of this effect when momentary mental well-being at the time of EMI initiation was high vs. low (positive affect: b=0.07, 95% CI=-0.00 to 0.15; negative affect: b=-0.01, CI=-0.09 to 0.06; stress: b=0.07, CI=-0.01 to 0.15). Changes in momentary resilience did not mediate the effect of EMI component initiation on changes in momentary mental well-being (positive affect: b=0.01, CI=-0.01 to 0.02; negative affect: b=0.00, CI=-0.01 to 0.00; stress: b=0.00; CI=0.00 to 0.00). </sec> <sec> <title>CONCLUSIONS</title> This secondary analysis investigated potential mechanisms of how a digital training leads to long-term improvement of distal outcomes. The analysis contributes to the research in the field by serving as a basis for future investigations on the momentary effects of EMI components. </sec>
BibTeX
@misc{wierzba2025promoting,
  author = {Eva Wierzba and Anita Schick and Christian Rauschenberg and Janik Fechtelpeter and Selina Hiller and Christian Götzl and Daniel Durstewitz and Silvia Krumm and Georgia Koppe and Ulrich Reininghaus},
  title = {{Promoting Psychological Resilience and Well-Being in Youth With a Smartphone-Based Ecological Momentary mHealth Intervention: Secondary Analysis of a Micro-Randomized Trial (Preprint)}},
  year = {2025},
  doi = {10.2196/preprints.85552},
}
Figure