MMDCopula: Robust Estimation of Copulas by Maximum Mean Discrepancy

Alexis Derumigny, Pierre Alquier, Jean‐David Fermanian, Badr-Eddine Chérief-AbdellatifOpenalex Unknown 2020 · DOI · OpenAlex

Abstract

The MMDCopula R package provides functions for the robust estimation of parametric families of copulas using minimization of the Maximum Mean Discrepancy (MMD). This implementation follows the research of Alquier, Chérief-Abdellatif, Derumigny, and Fermanian (2022), offering a stable alternative to traditional likelihood-based methods that are often sensitive to outliers.

Introduction

In multivariate statistics, copulas are indispensable for modeling the dependency structure between variables independently of their marginal distributions. While Maximum Likelihood Estimation (MLE) is the standard fitting approach, its statistical efficiency is compromised by its extreme sensitivity to outliers. Even a small number of anomalous data points can significantly skew parameter estimates.

MMDCopula addresses this vulnerability by implementing a framework for robust estimation. By minimizing the MMD distance instead of maximizing likelihood, the package provides practitioners with tools that remain resilient to data noise and slight model misspecifications.

The MMD Estimation Framework

The core innovation of this package is the use of Maximum Mean Discrepancy (MMD) as an objective function. MMD is a kernel-based distance measure between probability distributions. Rather than maximizing the probability of the data, MMDCopula minimizes the MMD between the empirical distribution of observed data and the theoretical parametric copula.

BiCopEstMMD: The core function for MMD-based copula estimation.

Technical Implementation

To find the parameter that minimizes the MMD criterion, the package employs several advanced techniques:

  • Stochastic Gradient Descent (SGD): The optimization is performed via an SGD algorithm, ensuring computational efficiency even for large datasets.
  • Kernel Variety: Users can select from various kernels (Gaussian, Exponential, Inverse-multiquadric) to capture different dependency features.
  • Quasi-Monte Carlo (QMC) Integration: The package supports QMC sequences (e.g., Sobol, Halton) for accurate gradient estimation, often converging faster than standard Monte Carlo methods.
Technical parameters for the stochastic gradient descent algorithm in MMDCopula.

Practical Application and Datasets

While MMDCopula is a software tool rather than an experimental study, its documentation validates the methodology using both simulated and real-world data:

  • Simulated Data: Parameters are validated against ground truths generated via the VineCopula package.
  • Financial Data: The daxreturns dataset (German stock index returns) is used to demonstrate the estimator's performance on actual market data.

Key Insights: Why MMD?

The shift from likelihood to MMD offers several advantages:

  1. Robustness by Design: The MMD criterion is naturally less sensitive to extreme values in the tails compared to log-likelihood.
  2. Global Feature Capture: By mapping distributions into a Reproducing Kernel Hilbert Space (RKHS), MMD captures complex global differences that point-wise likelihoods might miss.
  3. Workflow Integration: The package mirrors the interface of the popular VineCopula package, allowing researchers to easily swap MLE for MMD estimation.
  4. Confidence Intervals: Through functions like BiCopConfIntMMD, the package provides reliable confidence intervals using subsampling and bootstrap techniques.

Performance and Robustness

The practical utility of MMD estimation is most evident in "dirty" data scenarios. In comparisons where a small percentage of observations are replaced with extreme outliers, MLE estimates often shift drastically. In contrast, the MMD estimator remains remarkably close to the true parameter. Furthermore, the use of SGD and QMC allows for rapid convergence, making the method viable for iterative modeling tasks.

Limitations and Future Work

Despite its strengths, MMDCopula has specific constraints:

  • Bivariate Focus: The current version focuses on bivariate copulas. While these are building blocks for higher-dimensional models like Vines, direct high-dimensional MMD estimation is not yet the primary focus.
  • Parameter Optimization: The optimization is primarily tuned for single-parameter families; complex multi-parameter families like the Student-t may require more careful configuration.
  • Computational Cost: Kernel-based methods are generally more intensive than MLE. Users with massive datasets must balance speed and precision by tuning parameters like ndrawings and niter.

This summary is based on the MMDCopula package documentation and the research by Alquier et al. (2022).

Summary updated

Abstract

Provides functions for the robust estimation of parametric families of copulas using minimization of the Maximum Mean Discrepancy, following the article Alquier, Chérief-Abdellatif, Derumigny and Fermanian (2022) &lt;<a href="https://doi.org/10.1080%2F01621459.2021.2024836" target="_top">doi:10.1080/01621459.2021.2024836</a>&gt;.
BibTeX
@inproceedings{derumigny2020mmdcopula,
  author = {Alexis Derumigny and Pierre Alquier and Jean‐David Fermanian and Badr-Eddine Chérief-Abdellatif},
  title = {{MMDCopula: Robust Estimation of Copulas by Maximum Mean Discrepancy}},
  booktitle = {Openalex Unknown},
  year = {2020},
  doi = {10.32614/cran.package.mmdcopula},
}
Figure