Generalized least squares can overcome the critical threshold in respondent-driven sampling

Sébastien Roch, Karl Rohe

TL;DR

Respondent-Driven Sampling (RDS) is great for reaching hard-to-reach populations, but standard estimators can become highly unreliable when participants refer many others. This paper introduces Generalized Least Squares (GLS) estimators that significantly reduce variance in RDS, ensuring confidence intervals remain stable even in challenging network structures.

What Problem Does This Paper Address?

Respondent-Driven Sampling (RDS) is a powerful technique for sampling hidden or marginalized populations (like those at risk for HIV) by leveraging peer referrals. However, a key challenge arises when participants refer a large number of contacts. Under standard sampling methods, the variance of estimates typically decreases proportionally to the inverse of the sample size ($O(n^{-1})$). But in RDS, when referral rates are high, this desirable decay in variance can break down, leading to much wider confidence intervals and less reliable estimates. This paper aims to solve this problem by developing new statistical estimators that can effectively handle the complex dependencies introduced by high referral rates in RDS.

Methods

The core of this paper is the development and analysis of Generalized Least Squares (GLS) estimators for RDS. The authors first establish theoretically that GLS can indeed overcome the variance inflation problem, showing that the variance of their GLS estimator decays as $O(n^{-1})$, even with high referral rates.

To make GLS practical, they derive two classes of feasible GLS (fGLS) estimators:

  1. Degree Corrected Stochastic Blockmodel (DC-SBM) based: This approach uses a model for the underlying social network structure to estimate the necessary covariance components for GLS. It leverages the idea that participants with similar demographic characteristics might form "blocks" within the network.
  2. Rank-two model based: This class of estimators assumes a simpler structure for the network's spectral properties, which can lead to more efficient estimation in certain scenarios.

A key innovation is the ability to estimate the spectral properties of the population network from the sampled RDS data itself. This is crucial because the covariance matrix needed for GLS is typically unknown and depends on this network structure. The paper also introduces diagnostic plots to help researchers identify when fGLS estimators are likely to provide significant benefits.

Datasets

The paper uses two primary datasets for evaluation:

  • National Longitudinal Study of Adolescent Health (Add Health): This dataset provides social network information for a large sample of adolescents, allowing for realistic simulations of the RDS process.
  • Colorado Springs Project 90 network: This is another real-world social network dataset used for simulations, particularly for larger sample sizes.

The authors do not introduce a new benchmark dataset but rather use these existing, well-studied social network datasets to rigorously test their proposed methods.

Key Insights and Ideas

  • GLS is a game-changer for high-referral RDS: The theoretical results clearly show that GLS estimators can restore the desirable $O(n^{-1})$ variance decay, making confidence intervals much more stable and reliable, even when standard estimators fail.
  • Network structure can be learned from RDS data: A surprising and powerful insight is that the spectral properties of the underlying social network—information typically requiring full network observation—can be estimated from RDS samples. This opens doors for more sophisticated network-aware statistical methods.
  • DC-SBM provides a flexible framework: Using the DC-SBM allows for the construction of fGLS estimators that can adapt to different community structures within the population, making them robust to various network configurations.
  • Diagnostic plots are essential for practical application: The proposed diagnostic plots are a valuable tool, enabling researchers to quickly assess whether their outcome variable is correlated with the network structure and thus whether fGLS is likely to improve their estimates.

Key Results

  • Theoretical variance reduction: The paper proves that the variance of the GLS estimator decays at the desired $O(n^{-1})$ rate, overcoming the critical threshold problem in RDS.
  • Simulation performance: Simulations on real-world social networks (Add Health, Colorado Springs Project 90) demonstrate that the proposed SBM-fGLS estimators achieve substantially smaller Root Mean Squared Errors (RMSE) compared to traditional estimators like Volz-Heckathorn (VH), especially for "hard-to-estimate" quantities.
  • Robustness: The fGLS estimators show significant benefits even when the underlying network model is misspecified or when preferential recruitment (where participants are more likely to refer others with similar characteristics) is present. In some cases, fGLS with 500 samples outperformed VH with 1000 samples.
  • Diagnostic plot effectiveness: The diagnostic plots accurately identify variables for which fGLS provides the most benefit, correlating well with the observed RMSE reductions.

Limitations and Future Work

  • Model misspecification: While the fGLS estimators are shown to be robust to some degree of model misspecification (e.g., rank-two vs. SBM), the performance can still be affected. The paper notes that the SBM-fGLS estimator performs best when the blocks are correctly specified.
  • Computational complexity: Estimating the covariance matrix for GLS can be computationally intensive, especially for very large networks.
  • Practical implementation: While the paper provides diagnostic tools, further work might be needed to refine the practical implementation and interpretation of these diagnostics in diverse RDS studies.
  • Future directions: The authors suggest exploring more general network models beyond rank-two and DC-SBM, as well as investigating the performance of these estimators in settings with even more complex network structures and sampling designs. They also highlight the potential for using the estimated spectral properties of the network for other statistical tasks beyond variance reduction.

Summary updated

Abstract

To sample marginalized and/or hard-to-reach populations, respondent-driven sampling (RDS) and similar techniques reach their participants via peer referral. Under a Markov model for RDS, previous research has shown that if the typical participant refers too many contacts, then the variance of common estimators does not decay like [Formula: see text], where n is the sample size. This implies that confidence intervals will be far wider than under a typical sampling design. Here we show that generalized least squares (GLS) can effectively reduce the variance of RDS estimates. In particular, a theoretical analysis indicates that the variance of the GLS estimator is [Formula: see text] We then derive two classes of feasible GLS estimators. The first class is based upon a Degree Corrected Stochastic Blockmodel for the underlying social network. The second class is based upon a rank-two model. It might be of independent interest that in both model classes, the theoretical results show that it is possible to estimate the spectral properties of the population network from a random walk sample of the nodes. These theoretical results point the way to entirely different classes of estimators that account for the network structure beyond node degree. Diagnostic plots help to identify situations where feasible GLS estimators are more appropriate. The computational experiments show the potential benefits and also indicate that there is room to further develop these estimators in practical settings.
BibTeX
@inproceedings{roch2018generalized,
  author = {Sébastien Roch and Karl Rohe},
  title = {{Generalized least squares can overcome the critical threshold in respondent-driven sampling}},
  booktitle = {Proceedings of the National Academy of Sciences},
  year = {2018},
  doi = {10.1073/pnas.1706699115},
}

Loading related content...

Figure