COVID-19 vaccine perceptions: An observational study on Reddit

Navin Kumar, Isabel Corpus, Meher Hans, Nikhil Harle, Nan Yang, Curtis McDonald, Shinpei Nakamura Sakai, Kamila Janmohamed, Weiming Tang, Jason L. Schwartz, S. Mo Jones-Jang, Koustuv Saha, Shahan Ali Memon, Chris T. Bauch, Munmun De Choudhury, Orestis Papakyriakopoulos, Joseph D. Tucker, Abhay Goyal, Aman Tyagi, Kaveh Khoshnood, Saad B. OmermedRxiv 2021 · DOI

Abstract

As COVID-19 vaccinations accelerated globally in 2020, skeptical narratives proliferated across social media. This study utilizes Reddit data to quantitatively examine vaccine perceptions over time, specifically focusing on how scientific announcements influenced the spread of misinformation. By analyzing 266,840 posts through structural topic modeling and social network analysis, we identify a "success paradox" where positive clinical news triggered spikes in misinformation. Furthermore, we map the migration of skeptical content from mainstream subreddits to fringe communities. These findings suggest that public health communication must adapt to the specific mechanics of online information flow to effectively counter vaccine hesitancy.

Introduction

The rapid development of COVID-19 vaccines was a landmark achievement in modern medicine, yet its success was shadowed by a parallel "infodemic." Vaccine hesitancy remains a significant barrier to achieving population-level immunity. While previous research has often captured static snapshots of sentiment, this study investigates the dynamic relationship between real-world clinical milestones and online discourse. By leveraging Reddit's unique structure of specialized communities (subreddits), researchers can track not just what is being said, but how information migrates between different ideological echo chambers.

Methodology

The researchers employed a multi-stage computational approach to analyze a massive corpus of Reddit data:

  1. Data Acquisition: Using the Pushshift API and the Python Reddit API Wrapper (PRAW), the team collected 266,840 posts containing COVID-19 and vaccine-related keywords between January 1 and December 14, 2020.
  2. Structural Topic Modeling (STM): Unlike traditional modeling, STM incorporates metadata as covariates. The researchers used daily COVID-19 case/death counts, S&P 500 scores, and a timeline of vaccine-related events to determine how external "shocks" influenced the prevalence of 20 distinct discussion topics.
  3. Social Network Analysis (SNA): To visualize information flow, subreddits were treated as nodes. A connection (edge) was established when a post was shared between two communities. A fast-greedy algorithm was used to identify clusters and track the trajectory of posts from their origin to their eventual amplification.

Key Insights: The Success Paradox and Information Migration

The Success Paradox

One of the study's most striking findings is the "success paradox." Counter-intuitively, positive scientific news—specifically Pfizer’s announcement of 90% vaccine efficacy—was associated with a significant increase in vaccine misinformation and conspiracy theories. For communities predisposed to skepticism, positive milestones are often re-framed as evidence of a coordinated "agenda" or an acceleration of perceived threats (e.g., "the microchip plan is accelerating").

Conversely, trial setbacks, such as the temporary halt of the Johnson & Johnson trials, were associated with a reduction in active misinformation discussion. However, these halts were linked to an increase in general suspicion regarding federal policies and scientific leadership, suggesting that while setbacks may quiet the "conspiracy mill" temporarily, they erode the foundational trust required for public health initiatives.

The Mainstream-to-Fringe Pipeline

The Social Network Analysis revealed a distinct "scouting" pattern. Skeptical or controversial information often originates in mainstream, evidence-based subreddits like r/Coronavirus. Users from fringe communities, such as r/conspiracy or r/LockdownSkepticism, monitor these mainstream hubs to find content they can re-contextualize for their own audiences. This suggests that echo chambers are not isolated islands but are actively fed by mainstream news sources, which are then distorted to fit skeptical narratives.

The Influence of Hyperactive Users

The discourse is heavily influenced by a small minority of "hyperactive" users. The study found that the top 10 most active users posted with extreme frequency. While the majority of these users shared evidence-based information, approximately 40% were dedicated to spreading skepticism. This highlights how a few loud voices can disproportionately shape the perceived consensus within a digital community.

Results and Discussion

The analysis identified three dominant themes in the discourse: the severity of the pandemic (10.36%), hope for a swift resolution (9.41%), and suspicion of science and media (8.61%).

The impact of specific events was clear:

  • Pfizer Efficacy Announcement: Correlated with a decrease in evidence-based discussion and a spike in conspiracy-related topics.
  • J&J Trial Halt: Correlated with a rise in suspicion of leadership but a temporary lull in active misinformation.
  • Network Centrality: r/Coronavirus (with 2.4 million users at the time) acted as the primary hub for information, serving as the source for many posts that were later amplified in skeptical subreddits.

Conclusion and Future Directions

These findings have significant implications for public health communication. Understanding that positive news can trigger defensive misinformation spikes allows authorities to prepare "pre-bunking" strategies. Furthermore, recognizing the "scouting" behavior of skeptical users suggests that interventions—such as verified tags or expert rebuttals—should be placed directly within mainstream threads that are likely to be reposted.

While the study is limited by Reddit’s demographic biases (skewing younger and more male) and its observational nature, it provides a crucial roadmap for how social media can be monitored to improve vaccine perceptions. Future research should focus on real-time interventions that disrupt the pipeline between mainstream information and fringe misinformation.

Summary updated

Abstract

Abstract Objectives As COVID-19 vaccinations accelerate in many countries, narratives skeptical of vaccination have also spread through social media. Open online forums like Reddit provide an opportunity to quantitatively examine COVID-19 vaccine perceptions over time. We examine COVID-19 misinformation on Reddit following vaccine scientific announcements. Methods We collected all posts on Reddit from January 1 2020 - December 14 2020 (n=266,840) that contained both COVID-19 and vaccine-related keywords. We used topic modeling to understand changes in word prevalence within topics after the release of vaccine trial data. Social network analysis was also conducted to determine the relationship between Reddit communities (subreddits) that shared COVID-19 vaccine posts, and the movement of posts between subreddits. Results There was an association between a Pfizer press release reporting 90% efficacy and increased discussion on vaccine misinformation. We observed an association between Johnson and Johnson temporarily halting its vaccine trials and reduced misinformation. We found that information skeptical of vaccination was first posted in a subreddit (r/Coronavirus) which favored accurate information and then reposted in subreddits associated with antivaccine beliefs and conspiracy theories (e.g. conspiracy, LockdownSkepticism). Conclusions Our findings can inform the development of interventions where individuals determine the accuracy of vaccine information, and communications campaigns to improve COVID-19 vaccine perceptions. Such efforts can increase individual- and population-level awareness of accurate and scientifically sound information regarding vaccines and thereby improve attitudes about vaccines. Further research is needed to understand how social media can contribute to COVID-19 vaccination services. Funding Study was funded by the Yale Institute for Global Health and the Whitney and Betty MacMillan Center for International and Area Studies at Yale University. The funding bodies had no role in the design, analysis or interpretation of the data in the study.
BibTeX
@misc{kumar2021covid,
  author = {Navin Kumar and Isabel Corpus and Meher Hans and Nikhil Harle and Nan Yang and Curtis McDonald and Shinpei Nakamura Sakai and Kamila Janmohamed and Weiming Tang and Jason L. Schwartz and S. Mo Jones-Jang and Koustuv Saha and Shahan Ali Memon and Chris T. Bauch and Munmun De Choudhury and Orestis Papakyriakopoulos and Joseph D. Tucker and Abhay Goyal and Aman Tyagi and Kaveh Khoshnood and Saad B. Omer},
  title = {{COVID-19 vaccine perceptions: An observational study on Reddit}},
  year = {2021},
  doi = {10.1101/2021.04.09.21255229},
  howpublished = {medRxiv},
}
Figure