Test for bandedness of high-dimensional covariance matrices and bandwidth estimation

Yumou Qiu, Song Xi Chen

Abstract

Motivated by the latest effort to employ banded matrices to estimate a high-dimensional covariance $\Sigma$, we propose a test for $\Sigma$ being banded with possible diverging bandwidth. The test is adaptive to the “large $p$, small $n$” situations without assuming a specific parametric distribution for the data. We also formulate a consistent estimator for the bandwidth of a banded high-dimensional covariance matrix. The properties of the test and the bandwidth estimator are investigated by theoretical evaluations and simulation studies, as well as an empirical analysis on a protein mass spectroscopy data.

Introduction

In modern data science—ranging from genomics to high-frequency finance—researchers frequently encounter "high-dimensional" datasets where the number of variables ($p$) far exceeds the number of observations ($n$). In such "large $p$, small $n$" scenarios, the standard sample covariance matrix is often an unreliable estimator of the true underlying relationships. To mitigate this, researchers often impose structural assumptions, such as "banding" or "tapering."

A banded covariance matrix assumes that variables only correlate with their immediate neighbors in a sequence (e.g., genes located near each other on a chromosome or observations close in time). However, two critical challenges remain: first, verifying whether the bandedness assumption actually holds for a given dataset; and second, determining the optimal "bandwidth" ($k$)—the specific cutoff point beyond which correlations are assumed to be zero.

This paper introduces a robust, nonparametric framework to address both challenges, providing a formal hypothesis test for bandedness and a novel estimator for the bandwidth itself.

Methodology

The $W_{nk}$ Test Statistic

The authors propose a nonparametric test statistic, $W_{nk}$, designed to evaluate the null hypothesis that a covariance matrix is banded at a specific width $k$. The statistic is constructed using unbiased estimators of the sums of squares of the matrix's sub-diagonals.

Key technical features of this approach include:

  • Nonparametric Flexibility: Unlike previous methods that relied on multivariate normal (Gaussian) distributions, this test does not assume a specific parametric form. This makes it significantly more applicable to real-world data that may exhibit heavy tails or skewness.
  • Asymptotic Normality: The authors demonstrate that $W_{nk}$ follows a normal distribution as both $p$ and $n$ grow, provided the bandwidth $k$ does not grow too rapidly ($k = o(p^{1/4})$). This allows for reliable p-value calculation even in extremely high-dimensional settings.

Bandwidth Estimation as Change-Point Detection

If a matrix is found to be banded, the next step is identifying the correct bandwidth. The authors introduce two estimation strategies. The first is a threshold-based estimator, while the second—and more sophisticated—approach treats bandwidth selection as a change-point detection problem.

By using a nonparametric regression technique (LOESS), the method identifies the specific point where the "signal" or "energy" in the sub-diagonals effectively drops to zero. This transition point serves as a consistent estimator for the true bandwidth $k_0$.

Empirical Results and Simulations

Simulation Studies

The method was rigorously tested using synthetic datasets following both Normal and standardized Gamma distributions. Even in extreme cases (e.g., $n=20$ with $p=600$), the test maintained a stable false-positive rate near the 5% nominal level.

A significant finding was that the power of the test—its ability to correctly reject a false hypothesis—is primarily driven by the sample size ($n$) and the strength of the correlation signal, rather than the total number of variables ($p$). Furthermore, when compared to existing "coherence statistics," the proposed test showed significantly less size distortion in high-dimensional contexts.

Application to Protein Mass Spectroscopy

The authors applied their methodology to a prostate cancer study involving protein intensities across 218 dimensions for 157 healthy patients and 167 cancer patients.

The results revealed a striking structural difference between the two groups:

  • Healthy Group: The test suggested the covariance matrix was likely banded, with an estimated bandwidth of $k \approx 127$.
  • Cancer Group: The test indicated much higher dependencies, with an estimated bandwidth of $k = 215$.

This suggests that the presence of cancer may fundamentally alter the "connectedness" or regulatory structure of protein expressions, moving the system away from a localized banded structure toward a more complex, global dependency network.

Discussion and Limitations

While the proposed method is a significant advancement, it has specific constraints:

  1. Variable Ordering: Bandedness assumes a meaningful sequence of variables. If the variables are arbitrarily ordered, the banded structure may be masked. The authors suggest that combining this test with variable-ordering algorithms could be a fruitful area for future research.
  2. Scale Invariance: The current test is designed for covariance matrices and is invariant under location shifts. However, it is not invariant under variable-specific scaling. Developing a theoretically justified version for correlation matrices remains a valuable future direction.

In conclusion, this research provides a powerful set of tools for structural discovery in high-dimensional data, allowing researchers to move beyond simple assumptions and statistically verify the underlying architecture of their variables.

Summary updated

Abstract

Motivated by the latest effort to employ banded matrices to estimate a high-dimensional covariance $\Sigma$, we propose a test for $\Sigma$ being banded with possible diverging bandwidth. The test is adaptive to the “large $p$, small $n$” situations without assuming a specific parametric distribution for the data. We also formulate a consistent estimator for the bandwidth of a banded high-dimensional covariance matrix. The properties of the test and the bandwidth estimator are investigated by theoretical evaluations and simulation studies, as well as an empirical analysis on a protein mass spectroscopy data.
BibTeX
@article{qiu2012test,
  author = {Yumou Qiu and Song Xi Chen},
  title = {{Test for bandedness of high-dimensional covariance matrices and bandwidth estimation}},
  journal = {The Annals of Statistics},
  year = {2012},
  doi = {10.1214/12-aos1002},
}
Figure