Network meta-analysis made simple: a composite likelihood approach

Yu‐Lun Liu, Bingyu Zhang, Haitao Chu, Yong ChenmedRxiv 2024 · DOI

TL;DR

Network meta-analysis (NMA) often struggles because researchers rarely report how different treatment arms within a single study correlate, leading to biased results. This paper introduces a composite likelihood-based approach that bypasses the need for these missing correlations, offering a computationally efficient and robust method that scales linearly with the number of treatments.

What Problem Does This Paper Address?

In evidence-based medicine, a "pairwise" meta-analysis compares two treatments (A vs. B). However, clinicians often need to choose between many options (A, B, C, and D). Network Meta-Analysis (NMA) solves this by synthesizing data from multiple studies to compare all treatments simultaneously, even if they were never compared head-to-head in a single trial.

The "achilles heel" of NMA is the within-study correlation. In a three-arm trial (comparing A, B, and C), the estimate of A vs. B is mathematically correlated with the estimate of A vs. C because they share the same participants in group A. Unfortunately, these correlations are almost never reported in published literature. Ignoring them can lead to "noisy" estimates and inaccurate standard errors, while trying to estimate them often requires complex Bayesian models that become incredibly slow as the number of treatments increases.

Methods

The authors propose a frequentist approach using composite likelihood.

  1. Composite Likelihood: Instead of trying to model the full, complex joint distribution of all treatment comparisons (which requires knowing those pesky correlations), the method uses a "pseudo-likelihood." It treats the comparisons as if they were independent during the initial estimation phase.
  2. Sandwich Variance Estimator: To fix the fact that the comparisons aren't actually independent, the authors employ a "sandwich-type" robust variance estimator. This mathematical "correction" accounts for the underlying dependence and potential model misspecification, ensuring the final standard errors and confidence intervals are valid.
  3. Linear Scalability: Unlike state-of-the-art R packages (like gemtc or netmeta) where computational time can explode exponentially as more treatments or studies are added, the proposed algorithm's complexity grows linearly.
  4. Small-Sample Corrections: Since sandwich estimators can be biased when the number of studies is small (e.g., fewer than 15), the authors integrated Kenward-Roger (KC) and Mancl-DeRouen (MD) corrections to maintain accuracy in sparse networks.

Datasets

The researchers validated their method using:

  • Extensive Simulations: 1,000 simulated NMA datasets with varying numbers of studies (5 to 50) and different levels of within-study correlation.
  • Glaucoma Application: A massive network of 125 trials involving 14 active drugs and a placebo (22,656 participants) measuring intraocular pressure (IOP).
  • Chronic Prostatitis Application: A smaller network of 19 trials comparing 5 treatment regimens (1,669 participants) using the NIH-CPSI symptom score.

Key Insights and Ideas

  • The "Correlation-Free" Advantage: The biggest "aha" moment is that you don't actually need the within-study correlation matrix to get an unbiased estimate of treatment effects. By using composite likelihood, you can treat the missing data as a nuisance and still arrive at the correct answer.
  • Information Orthogonality: The paper demonstrates that the estimates for treatment effects ($\mu$) and between-study heterogeneity ($\tau^2$) are "information orthogonal." This means that even if your estimate of the variance is slightly off, it has a limited impact on the accuracy of your treatment effect estimates.
  • Robustness to Misspecification: Because the sandwich estimator is "robust," the method works well even if the researcher makes wrong assumptions about the structure of the correlations between studies.

Key Results

  • Speedup: In the glaucoma dataset, the proposed method was significantly faster than existing R packages. As the number of treatments increased to 15, the computational time for the proposed method remained nearly flat, while others began to climb steeply.
  • Statistical Validity: In simulations, the method produced approximately unbiased estimates. With the KC or MD corrections, the 95% confidence interval coverage remained near the nominal 95% level, even with as few as 5 to 10 studies.
  • Clinical Findings:
    • In the Glaucoma study, the method identified bimatoprost as the most effective drug (SUCRA score of 98.7%).
  • In the Chronic Prostatitis study, the method revealed that antibiotics alone were significantly more efficacious than previously thought—a result that standard NMA methods had missed because they couldn't properly handle the within-study dependencies.

Limitations and Future Work

  • Contrast-Based Focus: The current method is designed for "contrast-based" models (comparing differences between arms). While the authors mention it could be extended to "arm-based" models (looking at absolute effects in each arm), that wasn't the focus of this paper.
  • Small Sample Sensitivity: While the KC and MD corrections help, the sandwich estimator still performs best when there are at least a moderate number of studies. In extremely sparse networks (e.g., only 2 or 3 studies), any frequentist method will struggle.
  • Univariate Limitation: The paper focuses on a single continuous outcome. Future work could extend this composite likelihood approach to multivariate outcomes (e.g., looking at both efficacy and side effects simultaneously).

Summary updated

Abstract

Network meta-analysis, also known as mixed treatments comparison meta-analysis or multiple treatments meta-analysis, extends conventional pairwise meta-analysis by simultaneously synthesizing multiple interventions in a single integrated analysis. Despite the growing popularity of network metaanalysis within comparative effectiveness research, it comes with potential challenges. For example, within-study correlations among treatment comparisons are rarely reported in the published literature. Yet, these correlations are pivotal for valid statistical inference. As demonstrated in earlier studies, ignoring these correlations can inflate mean squared errors of the resulting point estimates and lead to inaccurate standard error estimates. This paper introduces a composite likelihood-based approach that ensures accurate statistical inference without requiring knowledge of the within-study correlations. The proposed method is computationally robust and efficient, with substantially reduced computational time compared to the state-of-the-science methods implemented in <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mtext>R</mml:mtext></mml:math> packages. The proposed method was evaluated through extensive simulations and applied to two important applications including a network meta-analysis comparing interventions for primary open-angle glaucoma, and another comparing treatments for chronic prostatitis and chronic pelvic pain syndrome.
BibTeX
@misc{liu2024network,
  author = {Yu‐Lun Liu and Bingyu Zhang and Haitao Chu and Yong Chen},
  title = {{Network meta-analysis made simple: a composite likelihood approach}},
  year = {2024},
  doi = {10.1101/2024.06.19.24309163},
  howpublished = {medRxiv},
}

Loading related content...

Figure