Tail density estimation for exploratory data analysis using kernel methods

Boris Béranger, Tarn Duong, Sarah Perkins‐Kirkpatrick, Scott A. SissonJournal of Nonparametric Statistics 2018 · DOI · arXiv

Abstract

Accurately modeling the upper tail behavior of random processes is critical for risk assessment and predictive modeling in various scientific domains. While nonparametric density estimation is a staple of exploratory data analysis (EDA), standard methods often struggle with the sparsity and boundary conditions inherent in extremal data. This paper introduces a transformation-based kernel density estimator (TKDE) designed to handle heavy-tailed and bounded data. By utilizing a logarithmic mapping, the TKDE mitigates common issues such as spurious bumps and boundary bias. We provide theoretical foundations through closed-form expressions for asymptotic bias and variance and demonstrate the estimator's efficacy through numerical studies and an analysis of global climate model performance.

Introduction

In statistical analysis, "moderate extremes" refer to values that are rare but still within the observable range of a dataset. Understanding these values is vital for predicting high-impact events like heatwaves, floods, or financial market crashes. The standard tool for visualizing such data is Kernel Density Estimation (KDE). However, KDE faces two significant challenges in the context of extremes:

  1. Spurious Bumps: In heavy-tailed distributions, data points in the tail are sparse and far apart. Standard KDE applies a fixed smoothing parameter (bandwidth), which often results in artificial "wiggles" or bumps in the tail where the density should be smooth.
  2. Boundary Bias: When analysis is restricted to data above a specific threshold (truncation), standard KDE performs poorly near that boundary, frequently underestimating the density.

While parametric models like the Generalised Pareto Distribution (GPD) are often used for extremes, they rely on strict mathematical assumptions. If these assumptions are violated, the resulting model is biased. The proposed TKDE offers a nonparametric alternative that allows the data to "speak for itself" while avoiding the traditional pitfalls of KDE.

Methodology

The Transformation Kernel Density Estimator (TKDE)

The TKDE follows a three-step procedure to improve estimation in the tail region:

  1. Transformation: The original data $X$ is mapped to a new space $Y$ using a monotonic function, specifically $t(x) = \log(x - u_0)$. This transformation "compresses" the distances between extreme values, bringing sparse tail observations closer together.
  2. Estimation: A standard KDE is applied to the transformed data $Y$ in this unbounded space. Because the data is more regularly distributed in the transformed space, traditional smoothing techniques are significantly more effective.
  3. Back-transformation: The resulting density estimate is mapped back to the original scale to provide the final tail density estimate.

Theoretical Properties

A key contribution of this work is the derivation of closed-form expressions for the asymptotic bias and variance of the TKDE. Unlike standard KDE, where bias can explode near boundaries or in sparse regions, the TKDE's bias and variance vanish as one moves further into the tail. Furthermore, the authors provide a framework for optimal bandwidth selection performed directly on the transformed data, ensuring the smoothing is appropriate for the distribution's shape.

Experimental Evaluation

Numerical Simulations

The method was tested against synthetic datasets including univariate samples (Gumbel, Fréchet, and GPD) and bivariate samples (Bilogistic and Hüsler-Reiss models). In these simulations, the TKDE consistently achieved lower $L_2$ error compared to both histograms and standard KDEs. Notably, even when the underlying data followed a GPD—the ideal scenario for parametric models—the TKDE performed comparably, highlighting its robustness as a general-purpose tool.

Climate Model Analysis

The TKDE was applied to a real-world dataset of daily maximum and minimum temperatures in Sydney, Australia (1911–2005). The goal was to evaluate how well 22 different Global Climate Models (GCMs) from the CMIP5 ensemble could replicate observed extremes.

The analysis revealed that while many GCMs accurately capture maximum temperature distributions, they frequently underestimate the magnitude of extreme minimum temperatures (nighttime heat). The TKDE allowed for a clear ranking of these models, identifying MPI-ESM-MR and CNRM-CMS as the most accurate at reproducing Sydney's observed temperature extremes.

Discussion and Insights

Decoupling the Threshold

Traditional extreme value methods are often highly sensitive to the choice of a threshold $u$. The TKDE approach is more robust because it estimates the density of the entire dataset first and applies the thresholding logic afterward. This decoupling makes the exploratory process less dependent on arbitrary threshold selection.

Visualization for EDA

The authors emphasize that for exploratory data analysis, smooth visualizations are superior to histograms, which are often sensitive to bin placement and appear "blocky." The TKDE provides a continuous, interpretable curve that facilitates better qualitative and quantitative understanding of extremal behavior.

Limitations

Despite its advantages, the TKDE is subject to the "curse of dimensionality," with performance degrading as the number of dimensions increases beyond univariate or bivariate analysis. Additionally, while the Gaussian kernel was used successfully here, further research could explore optimizing the specific choice of kernel and transformation function for different data types.

Conclusion

The Transformation Kernel Density Estimator provides a robust, nonparametric framework for tail density estimation. By addressing the inherent weaknesses of standard KDE through logarithmic mapping, it offers a powerful tool for researchers in climate science, finance, and other fields where understanding moderate extremes is essential for risk management and model validation.

Summary updated

Abstract

It is often critical to accurately model the upper tail behaviour of a random process. Nonparametric density estimation methods are commonly implemented as exploratory data analysis techniques for this purpose and can avoid model specification biases implied by using parametric estimators. In particular, kernel-based estimators place minimal assumptions on the data, and provide improved visualisation over scatterplots and histograms. However kernel density estimators can perform poorly when estimating tail behaviour above a threshold, and can over-emphasise bumps in the density for heavy tailed data. We develop a transformation kernel density estimator which is able to handle heavy tailed and bounded data, and is robust to threshold choice. We derive closed form expressions for its asymptotic bias and variance, which demonstrate its good performance in the tail region. Finite sample performance is illustrated in numerical studies, and in an expanded analysis of the performance of global climate models.
BibTeX
@article{beranger2018tail,
  author = {Boris Béranger and Tarn Duong and Sarah Perkins‐Kirkpatrick and Scott A. Sisson},
  title = {{Tail density estimation for exploratory data analysis using kernel methods}},
  journal = {Journal of Nonparametric Statistics},
  year = {2018},
  doi = {10.1080/10485252.2018.1537442},
}
Figure