A stochastic second-order generalized estimating equations approach for estimating intraclass correlation coefficient in the presence of informative missing data

Tom Chen, Eric Tchetgen Tchetgen, Rui WangarXiv 2018 · DOI · arXiv

Abstract

In cluster randomized trials (CRTs), accounting for the correlation among outcomes within the same cluster is essential for valid statistical inference. While first-order generalized estimating equations (GEE) provide consistent estimates for treatment effects, estimating the Intraclass Correlation Coefficient (ICC) itself requires second-order equations (GEE2), which are often computationally prohibitive and sensitive to missing data. This paper presents a novel framework that combines "doubly robust" estimating equations with a stochastic algorithm (SGEE2). By modeling the correlation among missingness indicators and utilizing a parallelized stochastic solver, this approach achieves consistent ICC estimation even under model misspecification, while reducing computation time by up to 90% for large datasets.

Introduction

Cluster Randomized Trials (CRTs) are a cornerstone of public health and social science research, where interventions are delivered to entire groups—such as schools, villages, or clinics—rather than individuals. This design inherently introduces a "clustering effect," where individuals within a group tend to be more similar to one another than to individuals in other groups. This similarity is quantified by the Intraclass Correlation Coefficient (ICC).

Accurate ICC estimation is critical for trial design, particularly for determining sample sizes and ensuring adequate statistical power. However, researchers frequently encounter two significant obstacles: informative missing data and computational instability. Standard methods often fail when data is not missing completely at random or when cluster sizes are large enough to cause traditional deterministic solvers to crash. This paper addresses these challenges by introducing robust estimators and a high-performance stochastic algorithm.

Methodology

The authors propose a dual-layered solution that addresses both the statistical bias introduced by missing data and the numerical challenges of solving complex estimating equations.

1. Robust Statistical Estimators: IPW-GEE2 and DR-GEE2

To handle missing data that is related to observed covariates (Restricted Missing at Random, or rMAR), the paper introduces two advanced estimators:

  • IPW-GEE2 (Inverse Probability Weighting): This method weights observations by the inverse of their probability of being observed. A significant innovation in this work is the modeling of correlation among missingness indicators. In clustered settings, the reason for a missing value is often shared among neighbors or household members; failing to account for this correlation can lead to biased ICC estimates.
  • DR-GEE2 (Doubly Robust): This estimator provides a statistical "safety net" by combining an outcome model with a propensity (missingness) model. The ICC estimate remains consistent as long as at least one of these two models is correctly specified, offering protection against partial model misspecification.

2. Computational Innovation: Stochastic GEE2 (SGEE2)

Traditional GEE2 solvers, such as Fisher scoring, are deterministic and often struggle with large clusters due to the memory-intensive nature of calculating high-dimensional gradients. The authors developed SGEE2, inspired by the mini-batch stochastic gradient descent techniques used in machine learning.

Instead of processing the entire cluster at once, SGEE2 samples subsets of individuals within clusters (stratified sampling). This "noise" in the algorithm actually serves as a feature: it allows the solver to "jump" out of local minima or areas of mathematical instability that typically cause deterministic solvers to diverge. To further enhance reliability, Par-SGEE2 parallelizes the process, running multiple independent chains and averaging the results to ensure convergence.

Empirical Evaluation

The framework was validated using both simulated environments and a real-world application:

  • Simulated Data: Using random-intercept models and Parzen’s method, the authors generated complex binary outcomes with known ICCs. These simulations tested the estimators under various missing-data scenarios, confirming that modeling the correlation of missingness is essential for accuracy.
  • Bangladeshi Sanitation Data: The researchers re-analyzed a study by Guiteras et al. (2015) involving 4,768 individuals across 100 clusters. The original study examined how marketing interventions influenced the adoption of hygienic latrines.

Key Findings

  • Efficiency and Scalability: For large clusters (e.g., 300 individuals), SGEE2 achieved an approximately 90% reduction in run-time compared to standard GEE2 solvers.
  • Improved Convergence: The stochastic approach reduced numerical errors and divergence issues by up to 80% in complex scenarios where traditional methods failed to provide a solution.
  • Scientific Impact: In the Bangladeshi sanitation analysis, the DR-GEE2 method identified a significant treatment effect (log OR = 0.46, p < 0.01) that was overlooked by simpler models. This demonstrates that properly accounting for missingness and correlation can fundamentally change the scientific conclusions of a trial.

Discussion and Limitations

While the proposed methods offer a significant leap forward, some limitations remain. The statistical theory underlying these estimators relies on a large number of clusters; when the number of clusters is small (e.g., $I=30$), association parameters may still exhibit bias. Additionally, the current framework assumes "Restricted Missing at Random" (rMAR). While more flexible than many standard approaches, it does not yet account for "Missing Not at Random" (MNAR) scenarios where missingness depends on the unobserved outcomes themselves.

Finally, while the R implementation of SGEE2 is highly efficient for large clusters, it does not yet match the raw speed of C-optimized packages like geepack for smaller, simpler datasets. Future work will focus on optimizing the software implementation and extending the framework to non-random missingness patterns.

Summary updated

Abstract

Design and analysis of cluster randomized trials must take into account correlation among outcomes from the same clusters. When applying standard generalized estimating equations (GEE), the first-order (e.g. treatment) effects can be estimated consistently even with a misspecified correlation structure. In settings for which the correlation is of interest, one could estimate this quantity via second-order generalized estimating equations (GEE2). We build upon GEE2 in the setting of missing data, for which we incorporate a "second-order" inverse-probability weighting (IPW) scheme and "second-order" doubly robust (DR) estimating equations that guard against partial model misspecification. We highlight the need to model correlation among missing indicators in such settings. In addition, the computational difficulties in solving these second-order equations have motivated our development of more computationally efficient algorithms for solving GEE2, which alleviates reliance on parameter starting values and provides substantially faster and higher convergence rates than the more widely used deterministic root-solving methods.
BibTeX
@misc{chen2018stochastic,
  author = {Tom Chen and Eric Tchetgen Tchetgen and Rui Wang},
  title = {{A stochastic second-order generalized estimating equations approach for estimating intraclass correlation coefficient in the presence of informative missing data}},
  year = {2018},
  eprint = {1804.05923},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1804.05923},
}
Figure