Preventive digital mental health interventions for children and young people: a review of the design and reporting of research

Aislinn D. Bergin, Elvira Perez Vallejos, E. Bethan Davies, David Daley, Tamsin Ford, Gordon Harold, Sarah Hetrick, Megan Kidner, Yunfei Long, Sally Merry, Richard Morriss, Kapil Sayal, Edmund Sonuga-Barke, Jo Robinson, John B. Torous, Chris Hollis

TL;DR

Digital health interventions (DHIs) hold immense promise for preventing mental health issues in young people, but current research often falls short in reporting crucial design and implementation details. This review highlights a significant gap between the development of DHIs and their successful adoption into real-world practice, emphasizing the need for more comprehensive reporting and research focused on younger and underserved populations.

What Problem Does This Paper Address?

The paper addresses a critical challenge in the field of digital mental health: the limited real-world implementation of preventive interventions for children and young people. Despite the growing prevalence of mental health problems in this demographic and the potential of digital tools to offer scalable solutions, many DHIs struggle to transition from research settings to widespread use. The authors identify that this gap is largely due to insufficient reporting on key aspects of DHI design, development, and evaluation, which hinders understanding of what makes these interventions effective and adoptable in diverse contexts. Specifically, the paper aims to review existing evidence-based DHIs for prevention and early intervention, and to assess how well research literature describes factors essential for real-world implementation.

Methods

This study employed a scoping review methodology, following the frameworks proposed by Arksey and O'Malley and informed by PRISMA guidelines. The researchers conducted a comprehensive search of five electronic databases (ACMDL, PubMed, PsycInfo, Embase, and Cochrane Library) for full-text English publications from 2013 onwards. They also followed up on studies from a previous systematic review to identify interventions that had undergone further research. The data extraction process involved a detailed chart, iteratively developed and refined, covering 34 categories from demographic information to key elements of prevention, implementation, and user involvement. The extracted data was then organized into four main categories: study characteristics, user characteristics, usability and engagement, and implementation.

Datasets

Not discussed in the paper. The review analyzed existing published research on digital health interventions, rather than using specific datasets for training or evaluation.

Key Insights and Ideas

  • The "Implementation Gap": A significant disconnect exists between the development of promising DHIs and their actual uptake and sustained use in real-world settings. This isn't just about technical feasibility but also about how well interventions are designed to fit into existing systems and user lives.
  • Underrepresentation of Younger Children: The review found a strong bias towards adolescent populations, with very few interventions targeting children aged 10 years and younger. This leaves a substantial age group underserved by digital preventive mental health tools.
  • Co-design is Crucial, but Underreported: While user involvement, particularly co-design with young people, is recognized as vital for creating acceptable and effective DHIs, its reporting in research is inconsistent and often lacking. This oversight limits our understanding of how to best involve users in the development process.
  • "Universal" Prevention Dominates, but Specific Needs Remain: The majority of interventions focused on universal prevention, aiming to reach broad populations. However, there's a need for more targeted interventions for selective and indicated prevention, addressing specific risk factors or early signs of distress.
  • Reporting Standards Need Improvement: The current reporting of DHI research lacks standardization, making it difficult to compare interventions, assess their effectiveness, and understand implementation challenges. Key details like financial costs, specific levels of human support, and detailed user engagement metrics are often missing.
  • Accessibility and Sustainability are Major Hurdles: Many interventions are not publicly available, are restricted by country or language, or have unclear access costs, severely limiting their potential for widespread dissemination and long-term sustainability.

Key Results

  • The review identified 21 distinct interventions from 30 publications.
  • These interventions employed universal (n=12), selective (n=3), and indicated (n=15) approaches to prevention.
  • The majority of interventions targeted adolescents, with only two studies including children aged ≤10 years.
  • Limited reporting was found regarding user co-design involvement in intervention development.
  • Barriers and facilitators to implementation varied across delivery settings.
  • Only a minority of studies reported on the financial costs associated with delivering the intervention.
  • A significant number of studies (n=15) did not report participant characteristics known to be risk factors for mental health disorders.
  • Only 38% (n=8/21) of the identified interventions were publicly available.

Limitations and Future Work

The authors acknowledge several limitations. The review did not include grey literature, meaning some co-design and involvement efforts might have gone unreported. The lack of a standardized DHI taxonomy makes it challenging to identify common core components and compare interventions across different clinical, technical, and evaluative mechanisms.

Future work should focus on:

  • Research with Younger Children: Prioritizing the development and evaluation of DHIs for younger children and those from underserved backgrounds.
  • Enhanced Reporting: Encouraging researchers to report comprehensive details on user co-design, the type and level of human support provided, financial costs, and intervention availability.
  • Implementation Science: Conducting more research that explicitly addresses real-world implementation challenges and opportunities within diverse settings and technologies.
  • Standardized Taxonomy: Developing a common taxonomy for reporting DHI components to improve clarity and comparability.
  • Sustainability: Exploring models for funding and disseminating DHIs to ensure their long-term availability and impact.
  • Ethical Considerations: Further investigating ethical issues, particularly consent processes for remote delivery and addressing potential negative impacts or exclusion of certain populations.

Summary updated

Abstract

Digital health interventions (DHIs) have frequently been highlighted as one way to respond to increasing levels of mental health problems in children and young people. Whilst many are developed to address existing mental health problems, there is also potential for DHIs to address prevention and early intervention. However, there are currently limitations in the design and reporting of the development, evaluation and implementation of preventive DHIs that can limit their adoption into real-world practice. This scoping review aimed to examine existing evidence-based DHI interventions and review how well the research literature described factors that researchers need to include in their study designs and reports to support real-world implementation. A search was conducted for relevant publications published from 2013 onwards. Twenty-one different interventions were identified from 30 publications, which took a universal (n = 12), selective (n = 3) and indicative (n = 15) approach to preventing poor mental health. Most interventions targeted adolescents, with only two studies including children aged ≤10 years. There was limited reporting of user co-design involvement in intervention development. Barriers and facilitators to implementation varied across the delivery settings, and only a minority reported financial costs involved in delivering the intervention. This review found that while there are continued attempts to design and evaluate DHIs for children and young people, there are several points of concern. More research is needed with younger children and those from poorer and underserved backgrounds. Co-design processes with children and young people should be recognised and reported as a necessary component within DHI research as they are an important factor in the design and development of interventions, and underpin successful adoption and implementation. Reporting the type and level of human support provided as part of the intervention is also important in enabling the sustained use and implementation of DHIs.
BibTeX
@article{bergin2020preventive,
  author = {Aislinn D. Bergin and Elvira Perez Vallejos and E. Bethan Davies and David Daley and Tamsin Ford and Gordon Harold and Sarah Hetrick and Megan Kidner and Yunfei Long and Sally Merry and Richard Morriss and Kapil Sayal and Edmund Sonuga-Barke and Jo Robinson and John B. Torous and Chris Hollis},
  title = {{Preventive digital mental health interventions for children and young people: a review of the design and reporting of research}},
  journal = {Npj Digit. Medicine},
  year = {2020},
  doi = {10.1038/s41746-020-00339-7},
}
Figure