Conditional quantile processes based on series or many regressors

Alexandre Belloni, Victor Chernozhukov, Denis Chetverikov, Iván Fernández‐ValJournal of Econometrics 2011

TL;DR

This paper introduces a powerful new framework for analyzing the entire conditional quantile function, even with a massive number of regressors. It develops novel statistical tools for robust inference, allowing researchers to understand how covariates affect outcomes across the entire distribution, not just the average.

What Problem Does This Paper Address?

Traditional regression methods often focus on the conditional mean, which can mask important variations in how covariates affect outcomes. Quantile regression offers a more nuanced view by analyzing the entire conditional distribution. However, extending these methods to handle a vast number of regressors (the "many regressors" problem) and to perform inference on the entire conditional quantile function (not just a single quantile) has been a significant challenge. This paper tackles this by developing a unified "QR-series" framework that can handle both scenarios, providing a flexible and powerful tool for analyzing complex relationships in data.

Methods

The core of the paper is the QR-series framework. This approach approximates the conditional quantile function using a linear combination of "series terms" (like polynomials or splines) with coefficients that depend on the quantile. The key innovation lies in developing high-quality inferential procedures for these series estimators. This involves:

  • Couplings: Constructing two processes on the same probability space that are very close to each other. One is the process of interest (the estimated quantile function), and the other has a known distribution. This allows approximating the distribution of the former by simulating the latter.
  • Four Resampling Methods: Based on these couplings, the authors develop four methods (pivotal, gradient bootstrap, Gaussian, and weighted bootstrap) for robust inference.
  • Unified Framework: The methods are designed to work for both the nonparametric setting (where the number of regressors is fixed) and the many-regressors setting, providing a unified approach.
  • Linear Functionals: The framework is extended to perform inference on various linear functionals of the conditional quantile function, such as derivatives and average derivatives.

Datasets

The paper uses a dataset on household gasoline consumption from a survey conducted by Statistics Canada between October 1994 and September 1996. This dataset is also used in Yatchew and No (1987).

Key Insights and Ideas

  • Beyond the Mean: The QR-series framework allows for a much richer understanding of how variables influence outcomes by looking at the entire distribution, not just the average. This is crucial for understanding heterogeneity.
  • Taming Many Regressors: The series approximation elegantly handles the "curse of dimensionality" that arises with many regressors, making complex models tractable.
  • Robust Inference: The development of multiple resampling methods (bootstraps) provides a flexible toolkit for researchers to perform reliable statistical inference, even in challenging high-dimensional settings.
  • Optimality: The paper demonstrates that QR-series estimators, particularly those using B-splines, achieve the fastest possible convergence rates in both L2 and sup norms, a significant theoretical result.

Key Results

  • Uniform Convergence Rates: The paper derives uniform rates of convergence for the QR-series coefficient process and for estimators of linear functionals, holding uniformly in both the quantile index and covariate values.
  • Fastest Possible Rates: For the nonparametric model, QR-series estimators based on polynomials and B-splines achieve the fastest possible L2 and sup norm convergence rates, respectively.
  • Feasible Inference: The proposed resampling methods (pivotal, gradient bootstrap, Gaussian, weighted bootstrap) provide valid and feasible inference procedures for the entire conditional quantile function and its linear functionals.
  • Empirical Application: The methods are applied to estimate the price elasticity of gasoline demand, demonstrating their practical utility and providing confidence bands that reveal significant price sensitivity.

Limitations and Future Work

  • Sparse Models: The paper acknowledges that it does not directly deal with sparse models where only a subset of series terms are truly important. While the provided methods can be useful for analyzing such problems, rigorous inference in the presence of model selection mistakes is left for future research.
  • Non-linear/Non-smooth Functionals: The current results focus on linear functionals. The authors note that their findings on the QR-series coefficient process are useful for extending to non-linear/non-smooth functionals, suggesting a path for future work.
  • Computational Performance: While the paper focuses on theoretical properties, practical implementation and computational efficiency of the proposed methods, especially for very high-dimensional settings, could be an area for further investigation.

Summary updated

Abstract

Quantile regression (QR) is a principal regression method for analyzing the impact of covariates on outcomes. The impact is described by the conditional quantile function and its functionals. In this paper we develop the nonparametric QR-series framework, covering many regressors as a special case, for performing inference on the entire conditional quantile function and its linear functionals. In this framework, we approximate the entire conditional quantile function by a linear combination of series terms with quantile-specific coefficients and estimate the function-valued coefficients from the data. We develop large sample theory for the QR-series coefficient process, namely we obtain uniform strong approximations to the QR-series coefficient process by conditionally pivotal and Gaussian processes. Based on these two strong approximations, or couplings, we develop four resampling methods (pivotal, gradient bootstrap, Gaussian, and weighted bootstrap) that can be used for inference on the entire QR-series coefficient function. We apply these results to obtain estimation and inference methods for linear functionals of the conditional quantile function, such as the conditional quantile function itself, its partial derivatives, average partial derivatives, and conditional average partial derivatives. Specifically, we obtain uniform rates of convergence and show how to use the four resampling methods mentioned above for inference on the functionals. All of the above results are for function-valued parameters, holding uniformly in both the quantile index and the covariate value, and covering the pointwise case as a by-product. We demonstrate the practical utility of these results with an empirical example, where we estimate the price elasticity function and test the Slutsky condition of the individual demand for gasoline, as indexed by the individual unobserved propensity for gasoline consumption.
BibTeX
@article{belloni2011conditional,
  author = {Alexandre Belloni and Victor Chernozhukov and Denis Chetverikov and Iván Fernández‐Val},
  title = {{Conditional quantile processes based on series or many regressors}},
  journal = {Journal of Econometrics},
  year = {2011},
}
Figure