Analyzing Trends of Loneliness Through Large-Scale Analysis of Social Media Postings: Observational Study

Keren Mazuz, Elad Yom-TovJMIR Mental Health 2020 · OpenReview

TL;DR

This study leverages large-scale analysis of Reddit posts from a loneliness forum to understand the temporal trends and correlates of loneliness. The researchers developed a predictive model to assess loneliness from text, revealing significant associations between increasing loneliness and engagement with forums related to suicide, depression, and illicit drug use. This work highlights the potential of social media data for studying hard-to-reach populations and understanding complex mental health phenomena.

What Problem Does This Paper Address?

Loneliness is a growing public health concern, often described as an epidemic. While its impact on mental and physical well-being is well-documented, understanding its determinants and temporal dynamics, especially in the context of digital behavior, remains challenging. Traditional methods for studying loneliness often rely on self-reported assessments, which can be difficult to obtain from anonymous online communities. This paper aims to bridge this gap by exploring whether loneliness can be reliably assessed from social media postings and to analyze the temporal trends and associated behaviors of individuals expressing loneliness online.

Methods

The core of this study involved analyzing posts from the r/lonely subreddit on Reddit.

  • Loneliness Assessment: The researchers first investigated if crowdsourced workers could accurately assess loneliness from text. Seven workers were asked to rate 236 randomly selected posts using the short-form UCLA Loneliness Scale (ULS-6). This established a baseline for human assessment.
  • Predictive Modeling: Based on the crowdsourced ratings, a predictive model was built to estimate loneliness scores from the text of the posts. This model utilized word features (unigrams, bigrams, trigrams) and sentiment analysis from the NLTK package, trained using a random forest algorithm.
  • Temporal Trend Analysis: The developed model was then applied to a large dataset of 19,668 posts from 11,054 users. The temporal trends of loneliness scores were analyzed, and users were clustered based on their posting behavior across various subreddits to identify common interests and associated behaviors.
  • Correlation Analysis: The study examined the correlation between loneliness trends and activity in other subreddits, particularly those related to mental health outcomes like suicide and depression, as well as other detrimental behaviors.

Datasets

  • Reddit Loneliness Forum Data: The primary dataset consisted of 19,668 posts from 11,054 users collected from the r/lonely subreddit between January 1, 2015, and December 31, 2018.
  • Associated Subreddit Data: Posts from other subreddits made by users who also posted in r/lonely were also collected (406,714 posts in total) to analyze broader online behavior.
  • Crowdsourced Labels: A subset of 236 posts was manually labeled by seven crowdsourced workers using the ULS-6 scale to train and validate the predictive model.

Key Insights and Ideas

  • Loneliness is Assessable from Text: The study demonstrates that individuals can, to a reasonable degree, assess loneliness from the text of social media posts, even without knowing the author. This opens up new avenues for studying this phenomenon in online environments.
  • Digital Footprints Reflect Mental State: The research highlights that online activity, particularly in specialized forums, can serve as a valuable indicator of an individual's mental state and potential risks.
  • Loneliness is Multidimensional and Correlated: Loneliness is not an isolated experience. The study reveals strong associations between loneliness and engagement with forums related to suicide, depression, and substance use, suggesting a complex interplay of these issues.
  • Temporal Dynamics Matter: The trajectory of loneliness over time appears to be significant. Both increasing loneliness and, interestingly, a decrease in loneliness scores (potentially due to cathartic effects) were associated with higher risks of posting in suicide-related forums.
  • Diverse User Base: Clustering users based on their subreddit activity revealed that individuals expressing loneliness come from diverse backgrounds and have varied interests, underscoring the pervasive nature of the issue.

Key Results

  • Crowdsourced Agreement: Crowdsourced workers showed moderate agreement in assessing loneliness (interclass correlation = 0.19).
  • Model Accuracy: The predictive model for loneliness scores showed a Pearson correlation of 0.36 with crowdsourced estimates and 0.48 with self-reported scores from a small sample, indicating moderate validity.
  • Association with Suicide: Increases in loneliness were strongly associated with postings in a suicidality-related forum (hazard ratio 1.19).
  • Association with Other Behaviors: Loneliness was also associated with other detrimental behaviors, including depression and illicit drug use.
  • Clustering Insights: Analysis of user clusters revealed that individuals in certain clusters were significantly more likely to post in subreddits related to depression, drugs, and suicide watch.

Limitations and Future Work

  • Limitations:
    • The annotator agreement and classification accuracy of the predictive model were not exceptionally high, suggesting room for improvement.
  • The study used a "black box" model, making it difficult to fully understand the specific reasons behind the model's associations.
  • The study focused on a single subreddit (r/lonely), which might not represent all forms of online loneliness expression.
  • Future Work:
    • Future research could directly compare crowdsourced assessments with the original poster's self-assessment.
  • Improving the assessment model through advanced language processing or incorporating demographic data is suggested.
  • The authors propose developing interventions based on these findings, potentially within online forums, to reduce loneliness and its associated risks.
  • Further exploration of cultural differences, internet addiction, and the impact of visual content (pictures/videos) in online loneliness is recommended.

Summary updated

Abstract

Background: Loneliness has become a public health problem described as an epidemic, and it has been argued that digital behavior such as social media posting affects loneliness.Objective: The aim of this study is to expand knowledge of the determinants of loneliness by investigating online postings in a social media forum devoted to loneliness. Specifically, this study aims to analyze the temporal trends in loneliness and their associations with topics of interest, especially with those related to mental health determinants.Methods: We collected a total of 19,668 postings from 11,054 users in the loneliness forum on Reddit. We asked seven crowdsourced workers to imagine themselves as writing 1 of 236 randomly chosen posts and to answer the short-form UCLA Loneliness Scale. After showing that these postings could provide an assessment of loneliness, we built a predictive model for loneliness scores based on the posts’ text and applied it to all collected postings. We then analyzed trends in loneliness postings over time and their correlations with other topics of interest related to mental health determinants.Results: We found that crowdsourced workers can estimate loneliness (interclass correlation=0.19) and that predictive models are correlated with reported loneliness scores (Pearson r=0.38). Our results show that increases in loneliness are strongly associated with postings to a suicidality-related forum (hazard ratio 1.19) and to forums associated with other detrimental behaviors such as depression and illicit drug use. Clustering demonstrates that people who are lonely come from diverse demographics and from a variety of interests.Conclusions: The results demonstrate that it is possible for unrelated individuals to assess people’s social media postings for loneliness. Moreover, our findings show the multidimensional nature of online loneliness and its correlated behaviors. Our study shows the advantages of studying a hard-to-reach population through social media and suggests new directions for future studies.JMIR Ment Health 2020;7(4):e17188doi:10.2196/17188
BibTeX
@inproceedings{mazuz2020analyzing,
  author = {Keren Mazuz and Elad Yom-Tov},
  title = {{Analyzing Trends of Loneliness Through Large-Scale Analysis of Social Media Postings: Observational Study}},
  booktitle = {JMIR Mental Health},
  year = {2020},
  url = {https://openreview.net/forum?id=BZBN15v7xL},
}
Figure