Controlling False Discovery Rate Using Gaussian Mirrors

Xin Xing, Zhigen Zhao, Jun S. Liu

TL;DR

The Gaussian Mirror (GM) method provides a robust way to select important variables in linear regression while strictly controlling the False Discovery Rate (FDR). By creating "mirror" versions of each predictor through random Gaussian perturbations, the method generates test statistics that are naturally symmetric for irrelevant variables, allowing for more powerful discovery in datasets with highly correlated features where traditional methods like "knockoffs" often struggle.

What Problem Does This Paper Address?

In modern data science—from genomics to finance—we often face the "needle in a haystack" problem: identifying a few truly influential variables among thousands of candidates. While we want to find as many "needles" as possible, we must also control the False Discovery Rate (FDR)—the expected proportion of our discoveries that are actually just noise.

The challenge is that in real-world data, predictors (covariates) are rarely independent. They are often highly correlated. Existing gold-standard methods, such as the Knockoff Filter, attempt to solve this by creating "fake" variables that mimic the correlation structure of the original data. However, when correlations are dense and high, creating these knockoffs becomes mathematically difficult and often results in a massive loss of "power" (the ability to actually find the true variables).

Methods

The core innovation is the Gaussian Mirror construction. For each predictor variable $x_j$, the authors create a pair of mirror variables:

  1. $x_j^+ = x_j + c_j z_j$
  2. $x_j^- = x_j - c_j z_j$

Where $z_j$ is a randomly generated Gaussian noise vector and $c_j$ is a carefully chosen scalar.

The "Mirror" Logic: The researchers then run a regression (like OLS or Lasso) using these mirror variables. They define a mirror statistic, $M_j$, based on the estimated coefficients ($\hat{\beta}_j^+$ and $\hat{\beta}_j^-$): $$M_j = |\hat{\beta}_j^+ + \hat{\beta}_j^-| - |\hat{\beta}_j^+ - \hat{\beta}_j^-|$$

  • For a "Null" variable (noise): The sum and the difference of the mirror coefficients should behave similarly. The distribution of $M_j$ will be symmetric around zero.
  • For a "Relevant" variable (signal): The sum will capture the signal, while the difference will cancel it out, making $M_j$ a large positive value.

Because the null statistics are symmetric, the researchers can estimate the number of false positives simply by counting how many $M_j$ values fall below a negative threshold. This allows them to set a data-driven threshold that guarantees FDR control.

For high-dimensional cases ($p > n$), the paper introduces a post-selection adjustment strategy. They first use Lasso to narrow down the candidates and then apply the GM method to the selected set, using a debiasing technique to maintain the required symmetry.

Datasets

The authors evaluated the GM method using:

  • Extensive Simulations: Testing various correlation structures (Power decay, constant positive correlation, and constant partial correlation) and non-Gaussian distributions (T-distribution and Bi-modal).
  • GWAS Tomato Dataset: A real-world population genetics dataset consisting of 292 tomato accessions characterized by over 11,000 Single Nucleotide Polymorphisms (SNPs). This provided a "realistic" design matrix where predictors take discrete values {0, 1, 2}, testing the method's robustness beyond pure Gaussian assumptions.

Key Insights and Ideas

  • Symmetry as a Proxy for Truth: The most elegant idea here is using the symmetry of noise to threshold the signal. If you know that "garbage" variables produce a symmetric bell curve of scores, any "bump" on the far right of that curve is likely a real discovery.
  • Overcoming the "Knockoff" Bottleneck: Unlike the Knockoff Filter, which requires the "fake" variables to be exchangeable with the originals (a very strict requirement that fails under high correlation), GM only requires a "mild assumption" on covariate dependence. This makes it much more effective in dense, highly-correlated datasets.
  • Computational Efficiency: The GM algorithm is "separable"—you can calculate the mirror statistics for different variables in parallel. This makes it highly scalable for GPU-based infrastructures.
  • Stability: The authors argue that adding small perturbations (the mirrors) leads to conclusions that are more stable, aligning with the "stability" framework in modern statistical theory.

Key Results

  • Superior Power: In simulations with high correlation ($\kappa = 0.8$), the GM method maintained high discovery power while the Knockoff Filter's power dropped to near zero.
  • FDR Control: Across all settings (low-dim, high-dim, and non-Gaussian), the GM method successfully controlled the FDR at the target level (e.g., 10%), whereas marginal Benjamini-Hochberg (BH) methods often failed significantly.
  • Real-World Performance: On the tomato GWAS data, GM successfully identified relevant SNPs while other methods were either overly conservative (finding nothing) or failed to control false discoveries due to the complex correlation between genetic markers.
  • Neural Network Extension: The authors demonstrated that the GM framework (termed NGM) can be extended to non-linear models like Neural Networks, outperforming existing benchmarks like DeepPINK.

Limitations and Future Work

  • Asymptotic Guarantees: The theoretical proof for FDR control is asymptotic, meaning it holds as the number of variables $p$ goes to infinity. Performance in very small-scale datasets might vary.
  • Choice of Perturbation Scale ($c_j$): While the paper provides an explicit formula for $c_j$ in linear models, choosing the optimal scale for more complex, non-linear models (like deep learning) remains an area for further empirical refinement.
  • Generalization: While the paper touches on Neural Networks, the primary focus is linear regression. Future work could explore more formal extensions to generalized linear models (GLMs) and other machine learning architectures.

Summary updated

Abstract

Simultaneously, finding multiple influential variables and controlling the false discovery rate (FDR) for linear regression models is a fundamental problem. We here propose the Gaussian Mirror (GM) method, which creates for each predictor variable a pair of mirror variables by adding and subtracting a randomly generated Gaussian perturbation, and proceeds with a certain regression method, such as the ordinary least-square or the Lasso (the mirror variables can also be created after selection). The mirror variables naturally lead to test statistics effective for controlling the FDR. Under a mild assumption on the dependence among the covariates, we show that the FDR can be controlled at any designated level asymptotically. We also demonstrate through extensive numerical studies that the GM method is more powerful than many existing methods for selecting relevant variables subject to FDR control, especially for cases when the covariates are highly correlated and the influential variables are not overly sparse.
BibTeX
@article{xing2021controlling,
  author = {Xin Xing and Zhigen Zhao and Jun S. Liu},
  title = {{Controlling False Discovery Rate Using Gaussian Mirrors}},
  journal = {Journal of the American Statistical Association},
  year = {2021},
  doi = {10.1080/01621459.2021.1923510},
}

Loading related content...

Figure