Comparative Effectiveness of the Bivalent (Original/Omicron BA.4/BA.5) mRNA COVID-19 Vaccines mRNA-1273.222 and BNT162b2 Bivalent in Adults in the United States

Hagit Kopel, Văn Hùng Nguyễn, Cathérine Boileau, Alina Bogdanov, Isabelle Winer, Thiérry Ducruet, Ni Zeng, Mac Bonafede, Daina B. Esposito, David Martin, Andrew Rosen, Nicolas Van de Velde, Sten H. Vermund, Stefan Gravenstein, James A. MansimedRxiv 2023 · DOI

TL;DR

This retrospective cohort study of over 2.7 million U.S. adults found that Moderna’s bivalent booster (mRNA-1273.222) was significantly more effective than Pfizer-BioNTech’s (BNT162b2) at preventing COVID-19-related hospitalizations and outpatient visits during the Omicron BA.4/BA.5 wave. The relative advantage of the Moderna vaccine was most pronounced in adults aged 65 and older.

What Problem Does This Paper Address?

As the SARS-CoV-2 virus evolved, the original monovalent vaccines saw a decline in effectiveness, particularly against the highly transmissible Omicron variants. In late 2022, "bivalent" boosters—which target both the original strain and the Omicron BA.4/BA.5 subvariants—were deployed to broaden protection.

While both Moderna and Pfizer-BioNTech produced bivalent mRNA vaccines, clinicians and policy-makers lacked direct, head-to-head "real-world" evidence comparing their effectiveness. This paper addresses that gap by evaluating which vaccine provided superior protection against severe (hospitalization) and moderate (outpatient) COVID-19 outcomes in a massive, diverse U.S. population.

Methods

The researchers conducted a retrospective cohort study using a robust Real-World Evidence (RWE) approach. Key methodological features include:

  • Data Integration: The study linked primary care Electronic Health Records (EHR) with pharmacy and medical claims data to create a comprehensive view of patient health and vaccination status.
  • Propensity Score Weighting: To ensure a fair comparison, the authors used Inverse Probability of Treatment Weighting (IPTW). This adjusted for baseline differences between the two vaccine groups, such as age, sex, race, geography, and pre-existing health conditions.
  • Cox Regression Models: These were used to estimate adjusted hazard ratios (HR), which were then converted into Relative Vaccine Effectiveness (rVE).
  • Negative Control: To check for "healthy user bias" or residual confounding, the researchers analyzed hospitalization risk within the first 7 days after vaccination (before the vaccine is expected to work). The lack of difference in this window suggested the groups were well-balanced.

Datasets

The study utilized a nationwide U.S. dataset merging two primary sources:

  1. Veradigm EHR dataset: Includes data from Allscripts and Practice Fusion platforms.
  2. Komodo dataset: Provides comprehensive pharmacy and medical claims.
  3. Study Population: A total of 2,748,358 eligible adults (1,049,575 Moderna recipients and 1,698,783 Pfizer recipients) vaccinated between August 2022 and February 2023.

Key Insights and Ideas

  • The "Moderna Advantage": Consistent with previous studies of monovalent vaccines, the Moderna bivalent booster showed a statistically significant edge over Pfizer in preventing both hospitalization and outpatient visits.
  • Age-Dependent Benefits: The relative effectiveness of Moderna increased with age. This is critical because older adults face the highest risk of severe outcomes and often exhibit "immunosenescence" (a waning immune response to vaccination).
  • Biological Plausibility: The authors suggest several reasons for the difference, including Moderna’s higher mRNA dosage (50 mcg vs. 30 mcg) and clinical data showing that Moderna tends to elicit higher antibody titers, more robust T-cell responses, and higher levels of mucosal-protective IgA.
  • Durability: The differences between the vaccines were evident within weeks of administration and persisted throughout the six-month follow-up period.

Key Results

The study calculated the Relative Vaccine Effectiveness (rVE), representing the additional protection offered by Moderna compared to Pfizer:

  • Overall Hospitalization (Primary Outcome): Moderna was 9.8% (95% CI: 2.6%–16.4%) more effective than Pfizer.
  • Overall Outpatient Visits: Moderna was 5.1% (95% CI: 3.2%–6.9%) more effective.
  • Adults ≥ 65 Years: The gap widened significantly in seniors, with Moderna showing 13.5% higher effectiveness against hospitalization and 10.7% higher effectiveness against outpatient visits.
  • Sensitivity Analysis: Results remained consistent even when the "cohort entry date" was shifted or when "open" claims data were used, reinforcing the reliability of the findings.

Limitations and Future Work

  • Observational Nature: Despite rigorous statistical adjustments, unmeasured confounding factors (like individual masking behavior or exposure levels) could still influence results.
  • Short Follow-up: The study only tracked outcomes for up to 6 months. Long-term comparative durability remains to be seen.
  • Variant Evolution: The study focused on the BA.4/BA.5 period. Effectiveness against newer subvariants (like XBB or JN.1) requires ongoing evaluation.
  • Population Bias: The study only included individuals with at least one healthcare contact in the prior year, potentially biasing the sample toward a more "at-risk" or health-seeking population rather than the general healthy public.
  • Funding: It is worth noting that the study was supported by Moderna Inc., and several authors are Moderna employees.

Summary updated

Abstract

Abstract Background The emergence of Omicron variants coincided with declining vaccine-induced protection against SARS-CoV-2 infection and other COVID-19-related outcomes. Two bivalent mRNA vaccines, mRNA-1273.222 (Moderna) and BNT162b2 Bivalent (Pfizer-BioNTech) were developed to provide greater protection against the predominate circulating variants by including the mRNA that encodes both the ancestral (original) strain and BA.4/BA.5. We estimated their relative vaccine effectiveness (rVE) in preventing COVID-19-related outcomes in the US. Methods We conducted a retrospective cohort study using a US nationwide dataset linking primary care electronic health records (EHR) and pharmacy/medical claims data. The adult study population (aged ≥18 years) received either mRNA-1273.222 or BNT162b2 Bivalent vaccination between August 31, 2022, and February 28, 2023. We used a propensity score weighting based on the inverse probability of treatment to adjust for the baseline differences in age, sex, race, ethnicity, geographic region, vaccination week, and health status between groups. Outcomes evaluated were rVE of the two bivalent mRNA vaccines against COVID-19-related hospitalizations (primary outcome) and outpatient visits (secondary). We weighted the vaccine groups prior to analysis and estimated adjusted hazard ratios (HR) using multivariable Cox regression models. We calculated rVE as (1−HR) × 100. Results We evaluated outcomes for 1,034,538 mRNA-1273.222 and 1,670,666 BNT162b2 Bivalent vaccine recipients. The adjusted rVE of mRNA-1273.222 versus BNT162b2 Bivalent vaccines against COVID-19-related hospitalization was 9.8% (95% confidence interval: 2.6%–16.4%). The adjusted rVE against COVID-19-related outpatient visits was 5.1% (95% CI: 3.2%–6.9%). When evaluated by age group, the incremental relative effectiveness was greater. Among adults ≥ 65, rVE against COVID-19-related hospitalizations and outpatient visits was 13.5% (95% CI: 5.5%–20.8%) and 10.7% (8.2%–13.1%), respectively. Conclusion We found greater effectiveness of mRNA-1273.222 compared with the BNT162b2 Bivalent vaccine in preventing COVID-19-related hospitalizations and outpatient visits, with increased benefits in older adults.
BibTeX
@misc{kopel2023comparative,
  author = {Hagit Kopel and Văn Hùng Nguyễn and Cathérine Boileau and Alina Bogdanov and Isabelle Winer and Thiérry Ducruet and Ni Zeng and Mac Bonafede and Daina B. Esposito and David Martin and Andrew Rosen and Nicolas Van de Velde and Sten H. Vermund and Stefan Gravenstein and James A. Mansi},
  title = {{Comparative Effectiveness of the Bivalent (Original/Omicron BA.4/BA.5) mRNA COVID-19 Vaccines mRNA-1273.222 and BNT162b2 Bivalent in Adults in the United States}},
  year = {2023},
  doi = {10.1101/2023.07.12.23292576},
  howpublished = {medRxiv},
}
Figure