Marginal asymptotics for the “large $p$, small $n$” paradigm: With applications to microarray data

Michael R. Kosorok, Shuangge Ma

TL;DR

This paper develops a theoretical framework for analyzing high-dimensional data (many features, few samples) common in fields like genomics. It proves that even with a vast number of features, statistical tests can remain reliable, paving the way for more robust analysis of complex datasets.

What Problem Does This Paper Address?

In many modern scientific fields, especially genomics, we encounter datasets with a massive number of features (e.g., thousands of genes) but a relatively small number of observations (e.g., a few dozen patients). This is known as the "large $p$, small $n$" paradigm. A key challenge here is performing multiple hypothesis tests (one for each gene, for instance) without inflating the false discovery rate (FDR). While FDR methods are useful, their validity relies on the p-values of non-differentially expressed genes behaving uniformly. This uniformity is hard to guarantee when the number of tests ($p$) is extremely large, potentially leading to erratic p-values. This paper tackles the question of whether reliable statistical inference is still possible in this extreme scenario, particularly when $p$ grows much faster than $n$.

Methods

The authors employ sophisticated mathematical tools from probability theory and statistics. They focus on "marginal asymptotics," meaning they analyze the behavior of statistics for individual genes (features) as the number of samples ($n$) grows, while the number of genes ($p$) grows much faster. Key techniques include:

  • Maximal inequalities: These provide bounds on the maximum deviation of a random variable from its expected value across a set of possibilities.
  • Brownian bridge approximation: This is a powerful tool for approximating the behavior of empirical distribution functions, which are fundamental in statistical testing.
  • Hungarian construction: A method used to establish relationships between different probabilistic objects, crucial for proving consistency.

They extend existing results for mean-based tests to include median-based tests and distribution-free tests, demonstrating the broad applicability of their framework. They also investigate the impact of normalization procedures, a common preprocessing step in microarray analysis.

Datasets

The paper uses simulated data for its primary evaluation. It also references real-world microarray datasets, specifically mentioning the "Estrogen data" from West et al. (2001) and Spang et al. (2001) for illustration.

Key Insights and Ideas

  • Surprising Uniformity: The most striking finding is that even when the number of genes ($p$) grows almost exponentially with the number of samples ($n$), marginal p-values can still maintain uniform distributions. This is counterintuitive given the vast number of tests.
  • Robustness to Dependence: The theoretical results hold even when genes exhibit complex dependencies among themselves, which is a realistic scenario in biological data.
  • Normalization's Impact: The paper shows that their asymptotic results are largely unaffected by normalization processes, provided the normalization is sufficiently accurate. This is crucial for practical applications where normalization is standard.
  • Broad Applicability: The framework extends to various statistical tests, including mean, median, and distribution-free tests, making it a versatile tool.

Key Results

The paper establishes theoretical guarantees for the uniform consistency of estimators for marginal distribution functions, sample means, and sample medians under the "large $p$, small $n$" paradigm. Crucially, it demonstrates the uniform validity of marginal p-values derived from asymptotic approximations, even when $p$ grows much faster than $n$ (e.g., $\log p_n = o(n^{1/2})$ or $o(n^{1/3})$). This means that FDR methods can be reliably applied in these high-dimensional settings. Simulation studies and data analyses support these theoretical findings, showing that the proposed methods perform well in practice, especially with larger sample sizes.

Limitations and Future Work

  • Sample Size Guidelines: The authors acknowledge that the developed asymptotics are not yet precise enough to provide concrete sample size recommendations for specific microarray experiments. Developing such guidelines would be a valuable future research direction, likely requiring assumptions about gene dependencies.
  • Simulation Scope: The simulation studies, while supportive, were limited in scope. More thorough simulations are needed to fully explore the impact of marginal distribution assumptions and normalization on the asymptotics.
  • Gene Interdependence: A strength of the paper is its generality, avoiding assumptions on gene interdependence. However, future work might benefit from exploring specific dependency structures to refine sample size guidelines.

Summary updated

Abstract

The “large $p$, small $n$” paradigm arises in microarray studies, image analysis, high throughput molecular screening, astronomy, and in many other high dimensional applications. False discovery rate (FDR) methods are useful for resolving the accompanying multiple testing problems. In cDNA microarray studies, for example, $p$-values may be computed for each of $p$ genes using data from $n$ arrays, where typically $p$ is in the thousands and $n$ is less than 30. For FDR methods to be valid in identifying differentially expressed genes, the $p$-values for the nondifferentially expressed genes must simultaneously have uniform distributions marginally. While feasible for permutation $p$-values, this uniformity is problematic for asymptotic based $p$-values since the number of $p$-values involved goes to infinity and intuition suggests that at least some of the $p$-values should behave erratically. We examine this neglected issue when $n$ is moderately large but $p$ is almost exponentially large relative to $n$. We show the somewhat surprising result that, under very general dependence structures and for both mean and median tests, the $p$-values are simultaneously valid. A small simulation study and data analysis are used for illustration.
BibTeX
@article{kosorok2007marginal,
  author = {Michael R. Kosorok and Shuangge Ma},
  title = {{Marginal asymptotics for the “large $p$, small $n$” paradigm: With applications to microarray data}},
  journal = {The Annals of Statistics},
  year = {2007},
  doi = {10.1214/009053606000001433},
}
Figure