Sieve empirical likelihood ratio tests for nonparametric functions

Jianqing Fan, J. ZhangTU/e 2005 · DOI

TL;DR

This paper introduces a new statistical testing method called Sieve Empirical Likelihood Ratio (SELR) tests. SELR tests are designed to be more flexible than previous methods by not requiring assumptions about the exact distribution of errors, making them applicable to a wider range of nonparametric problems, including those with unknown heteroscedasticity.

What Problem Does This Paper Address?

Statistical hypothesis testing is crucial for drawing conclusions from data. Traditional methods often rely on strong assumptions about the underlying data-generating process, particularly the distribution of errors. While generalized likelihood ratio (GLR) tests have been developed for nonparametric settings, they still require specifying a parametric family for the error distributions. This limitation restricts their applicability, especially when dealing with complex models where error distributions are unknown or heteroscedastic (meaning the variance of errors changes depending on other variables). This paper addresses this gap by proposing SELR tests, which relax these assumptions and offer a more robust and adaptive approach to nonparametric hypothesis testing.

Methods

The core of this paper is the development of Sieve Empirical Likelihood Ratio (SELR) tests. The approach builds upon existing generalized likelihood ratio methods but replaces the assumption of a known parametric error distribution with a "sieve" approach. This involves constructing empirical likelihoods based on conditional estimating equations, which are less restrictive than specifying the entire error distribution. The method uses local linear approximations to estimate nonparametric functions and then constructs a sieve empirical log-likelihood. The key innovation is the use of empirical likelihood in a nonparametric setting, allowing for the estimation of infinite-dimensional parameters. The authors demonstrate that these SELR statistics asymptotically follow a rescaled chi-squared distribution, a phenomenon known as the Wilks phenomenon, which simplifies hypothesis testing by making the distribution independent of nuisance parameters.

Datasets

Not discussed in the paper. The paper focuses on theoretical development and uses simulated data for its evaluation.

Key Insights and Ideas

  • Relaxing Error Distribution Assumptions: The most significant insight is the development of a testing procedure that doesn't require knowing the exact parametric form of the error distribution. This is a major step towards more general and practical nonparametric inference.
  • The Wilks Phenomenon in a Broader Context: The paper shows that the Wilks phenomenon (asymptotic null distributions being independent of nuisance parameters and following a chi-squared distribution) extends to the more relaxed setting of SELR tests, even with unknown and heteroscedastic errors. This is crucial for practical hypothesis testing as it simplifies the computation of p-values.
  • Adaptability to Heteroscedasticity: A key advantage of SELR tests is their ability to automatically adapt to unknown and heteroscedastic error distributions, a limitation of previous GLR methods.
  • Optimal Power: The proposed SELR tests achieve the optimal rate of convergence for nonparametric hypothesis testing, meaning they are as powerful as theoretically possible under the given conditions.
  • Conditional Estimating Equations: The method relies on specifying conditional estimating equations, which are more flexible and easier to formulate than specifying the entire distribution of stochastic errors.

Key Results

  • Asymptotic Distribution: The proposed SELR statistics are shown to follow asymptotically rescaled chi-squared distributions, with scale constants and degrees of freedom independent of nuisance parameters.
  • Asymptotic Power: The tests achieve the optimal rate of convergence for nonparametric hypothesis testing.
  • Simulation Studies: Empirical studies demonstrate that the SELR test sizes are adaptive to conditional variance functions, unlike traditional F-type tests. The power of the SELR test is shown to be competitive, and in cases of high heteroscedasticity, it significantly outperforms F-type tests.

Limitations and Future Work

  • Technical Derivations: The authors note that the technical derivations for SELR tests are "very involved."
  • Bandwidth Choice: The SELR test's performance depends on the choice of bandwidth, and while methods for choosing it are discussed, it remains a practical consideration.
  • Practical Implementation: The paper suggests using bootstrap methods for computing p-values due to the potentially slow convergence of null distributions.
  • Future Work: The paper opens avenues for applying SELR tests to more general nonparametric models and exploring their properties further. The authors also suggest that bias reduction techniques might be necessary for certain parametric null hypotheses.

Summary updated

Abstract

Generalized likelihood ratio statistics have been proposed in Fan, Zhang and Zhang [Ann. Statist. 29 (2001) 153-193] as a generally applicable method for testing nonparametric hypotheses about nonparametric functions. The likelihood ratio statistics are constructed based on the assumption that the distributions of stochastic errors are in a certain parametric family. We extend their work to the case where the error distribution is completely unspecified via newly proposed sieve empirical likelihood ratio (SELR) tests. The approach is also applied to test conditional estimating equations on the distributions of stochastic errors. It is shown that the proposed SELR statistics follow asymptotically rescaled χ^2-distributions, with the scale constants and the degrees of freedom being independent of the nuisance parameters. This demonstrates that the Wilks phenomenon observed in Fan, Zhang and Zhang [Ann. Statist. 29 (2001) 153-193] continues to hold under more relaxed models and a larger class of techniques. The asymptotic power of the proposed test is also derived, which achieves the optimal rate for nonparametric hypothesis testing. The proposed approach has two advantages over the generalized likelihood ratio method: it requires one only to specify some conditional estimating equations rather than the entire distribution of the stochastic error, and the procedure adapts automatically to the unknown error distribution including heteroscedasticity. A simulation study is conducted to evaluate our proposed procedure empirically.
BibTeX
@inproceedings{fan2005sieve,
  author = {Jianqing Fan and J. Zhang},
  title = {{Sieve empirical likelihood ratio tests for nonparametric functions}},
  booktitle = {TU/e},
  year = {2005},
  doi = {10.48550/arxiv.math/0503667},
}
Figure