Measuring Online Wellbeing: A Scoping Review of Subjective Wellbeing Measures

Zhen Xin Ong, Liz Dowthwaite, Elvira Pérez Vallejos, Mat Rawsthorne, Yunfei LongFrontiers in Psychology 2021 · DOI

Abstract

With the increasing importance of the internet to our everyday lives, questions are rightly being asked about how its use affects our wellbeing. It is important to be able to effectively measure the effects of the online context, as it allows us to assess the impact of specific online contexts on wellbeing that may not apply to offline wellbeing. This paper describes a scoping review of English language, peer-reviewed articles published in MEDLINE, EMBASE, and PsychInfo between 1st January 2015 and 31st December 2019 to identify what measures are used to assess subjective wellbeing and in particular to identify any measures used in the online context. Two hundred forty studies were identified; 160 studies were removed by abstract screening, and 17 studies were removed by full-text screening, leaving 63 included studies. Fifty-six subjective wellbeing scales were identified with 18 excluded and 38 included for further analysis. Only one study was identified researching online wellbeing, and no specific online wellbeing scale was found. Therefore, common features of the existing scales, such as the number and type of questions, are compared to offer recommendations for building an online wellbeing scale. Such a scale is recommended to be between 3 and 20 questions, using mainly 5-point Likert or Likert-like scales to measure at least positive and negative affect, and ideally life satisfaction, and to use mainly subjective evaluation. Further research is needed to establish how these findings for the offline world effectively translate into an online measure of wellbeing.

Introduction

As our lives increasingly migrate online, researchers and policymakers face a significant challenge: quantifying how digital environments—ranging from social media platforms to remote work tools—affect our mental state. A critical issue addressed in this research is the potential for "skeuomorphism" in psychology, where researchers rely on ornamental versions of offline tools to measure online experiences. This approach risks missing the unique nuances of digital interaction, such as the specific nature of social support on social media compared to face-to-face interactions.

This paper addresses two primary gaps: the lack of a validated, widely accepted scale specifically designed for digital contexts, and the conceptual risk of assuming that offline wellbeing measures translate perfectly to the online world.

Methodology

The authors conducted a scoping review following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. The search targeted peer-reviewed articles published between 2015 and 2019 across three major databases: MEDLINE, EMBASE, and PsychInfo.

PRISMA Flow Diagram illustrating the study selection process from initial identification to final synthesis.

Unlike a meta-analysis, this review focused on the structure and application of the measurement tools themselves. The final synthesis included 63 studies, from which 38 distinct Subjective Wellbeing (SWB) scales were analyzed. Key metrics for analysis included scale length, question type (e.g., Likert scales), measured components (positive affect, negative affect, life satisfaction), and the timeframe for reflection (e.g., "past week" vs. "in general").

Key Results and Insights

The review revealed a startling "online void": out of the hundreds of papers screened, only one study specifically investigated wellbeing in an online context, and zero specific online wellbeing scales were identified. Most researchers currently rely on established offline benchmarks such as the Warwick-Edinburgh Mental Wellbeing Scale (WEMWBS) and the Personal Wellbeing Index (PWI).

Structural analysis of the 38 analyzed scales showed that 92.1% utilized Likert or Likert-like measures, with a median length of 10 questions. Scoring methods varied significantly; while 39.5% of scales used positive scoring (where higher scores indicate better wellbeing), 21.1% incorporated reverse scoring for negative items to mitigate response biases like "straight-lining."

Table detailing the distribution of scoring systems and reverse scoring practices across the analyzed wellbeing scales.

Based on these findings, the authors propose a blueprint for a future Online Wellbeing Scale (OWS). They recommend that such a scale should:

  • Consist of 3 to 20 items to balance depth with respondent fatigue.
  • Utilize 5-point Likert scales for optimal granularity.
  • Measure both positive and negative affect as independent dimensions.
  • Prioritize subjective evaluation over objective metrics (like screen time), which often correlate poorly with actual felt wellbeing.

Discussion and Future Work

A primary limitation of this review is the search strategy, which focused on titles and may have missed studies where wellbeing was a secondary measure. Additionally, the exclusion of gray literature and the rapid evolution of technology—such as the rise of VR and AR—mean that static scales may quickly become obsolete.

There is an urgent need for the development and validation of a dedicated Online Wellbeing Scale. Future research must determine how "hedonic balance" (the ratio of positive to negative emotions) shifts in digital spaces compared to physical ones to ensure we can accurately assess the impact of our increasingly digital lives.

Summary updated

Abstract

With the increasing importance of the internet to our everyday lives, questions are rightly being asked about how its' use affects our wellbeing. It is important to be able to effectively measure the effects of the online context, as it allows us to assess the impact of specific online contexts on wellbeing that may not apply to offline wellbeing. This paper describes a scoping review of English language, peer-reviewed articles published in MEDLINE, EMBASE, and PsychInfo between 1st January 2015 and 31st December 2019 to identify what measures are used to assess subjective wellbeing and in particular to identify any measures used in the online context. Two hundred forty studies were identified; 160 studies were removed by abstract screening, and 17 studies were removed by full-text screening, leaving 63 included studies. Fifty-six subjective wellbeing scales were identified with 18 excluded and 38 included for further analysis. Only one study was identified researching online wellbeing, and no specific online wellbeing scale was found. Therefore, common features of the existing scales, such as the number and type of questions, are compared to offer recommendations for building an online wellbeing scale. Such a scale is recommended to be between 3 and 20 questions, using mainly 5-point Likert or Likert-like scales to measure at least positive and negative affect, and ideally life satisfaction, and to use mainly subjective evaluation. Further research is needed to establish how these findings for the offline world effectively translate into an online measure of wellbeing.
BibTeX
@inproceedings{ong2021measuring,
  author = {Zhen Xin Ong and Liz Dowthwaite and Elvira Pérez Vallejos and Mat Rawsthorne and Yunfei Long},
  title = {{Measuring Online Wellbeing: A Scoping Review of Subjective Wellbeing Measures}},
  booktitle = {Frontiers in Psychology},
  year = {2021},
  doi = {10.3389/fpsyg.2021.616637},
}
Figure