Statistical inference for linear mediation models with high-dimensional mediators and application to studying stock reaction to COVID-19 pandemic

Xu Guo, Runze Li, Jingyuan Liu, Mudong Zeng

TL;DR

This paper introduces a highly efficient statistical framework for mediation analysis when the number of potential mediators is larger than the sample size. By leveraging a "partial penalized least squares" approach and a clever estimation trick—calculating the indirect effect as the difference between total and direct effects—the authors provide faster, more accurate inference tools that reveal how specific financial metrics bridged the gap between industry sectors and stock returns during the COVID-19 pandemic.

What Problem Does This Paper Address?

Mediation analysis is the "how" and "why" of statistics. It investigates how an exposure variable ($X$) affects an outcome ($Y$) through intermediate variables called mediators ($M$). For example, how does a company's sector ($X$) affect its stock return ($Y$)? Perhaps through its liquidity or profitability ($M$).

The challenge arises in the "Big Data" era. We often have hundreds or thousands of potential mediators (high-dimensionality), but only a limited number of observations. Traditional methods like Structural Equation Modeling (SEM) fail here because they rely on inverting covariance matrices that become "rank-deficient" (mathematically unstable) when the number of variables exceeds the number of samples. While some recent "debiased" methods exist, they are often computationally expensive and can suffer from "variance inflation"—essentially making the estimates noisier in an attempt to remove bias.

Methods

The authors propose a High-Dimensional Mediation Model (HDMM) using two primary innovations:

  1. The "Difference" Estimation Strategy: Instead of trying to estimate a massive, complex matrix of relationships between all mediators and the exposure, they observe that the indirect effect ($\beta$) is simply the Total Effect ($\gamma$) minus the Direct Effect ($\alpha_1$). They estimate the total effect via standard least squares and the direct effect using their new PPLS method.
  2. Partial Penalized Least Squares (PPLS): In high-dimensional settings, statisticians use "penalties" (like Lasso or SCAD) to assume most variables have zero effect (sparsity). The authors' "partial" approach is surgical: they apply the penalty only to the high-dimensional mediators ($\alpha_0$) while leaving the low-dimensional direct effect ($\alpha_1$) unpenalized. This preserves the "local power" of the test, making it easier to detect real effects.

They complement these estimators with two new hypothesis tests: a Wald test for the indirect effect and an F-type test for the direct effect, both of which follow well-understood $\chi^2$ distributions.

Datasets

The paper validates its approach using two main sources:

  • Monte Carlo Simulations: Synthetic datasets where the ground truth is known, used to compare the new method against the "Oracle" (a theoretical perfect model) and the current state-of-the-art (Zhou et al., 2020).
  • Real-World Financial Data: Data from 490 S&P 500 companies during the initial COVID-19 crash (February to April 2020). The dataset included 550 financial metrics (mediators) scraped from Yahoo Finance, including growth rates and balance sheet ratios from 2015–2019.

Key Insights and Ideas

  • Efficiency over Debiasing: Most high-dimensional tools use a "debiasing" step to allow for traditional p-value calculation. The authors show that by not penalizing the direct effect in the first place, they avoid the variance inflation that debiasing causes. Their method is essentially as accurate as an "Oracle" model that already knows which mediators are important.
  • Computational Speedup: Because the algorithm (using a Local Linear Approximation) converges extremely quickly, it is roughly 1,000 times faster than competing debiased Lasso methods.
  • Random vs. Fixed Design: Many previous models assumed mediators were "fixed" (like pre-set dosages in a lab). This paper correctly treats mediators as "random" variables (like fluctuating stock metrics), which is much more realistic for social and natural sciences.

Key Results

  • Simulation Performance: The proposed Wald test showed significantly higher statistical power and lower bias than existing methods, especially when the direct effect was non-zero.
  • The COVID-19 "Winners": In the empirical study, the Healthcare and Technology sectors had the strongest positive direct effects on stock returns during the pandemic.
  • Identified Mediators: Out of 550 metrics, the model identified six key mediators that explained how sectors influenced returns:
  • Return on Assets (ROA) and Gross Margin (Profitability).
  • Operating Income Growth (Efficiency).
  • Quick Ratio Growth (Liquidity).
  • Debt to Assets (Solvency - negative impact).
  • Receivables Turnover (Collection efficiency - negative impact).
  • Significance: Both the direct effects of the sectors and the indirect effects through these operation metrics were found to be highly statistically significant ($p < 10^{-9}$).

Limitations and Future Work

  • Linearity Assumption: The model assumes the relationships between $X, M,$ and $Y$ are linear. In highly volatile markets or complex biological systems, these relationships might be non-linear or involve complex interactions.
  • Sparsity Dependency: The method relies on the "sparsity assumption"—that only a small fraction of the 550 mediators are actually "active." If the true effect is spread thinly across hundreds of mediators, penalized methods may struggle.
  • Future Directions: The authors suggest extending this framework to non-linear mediation models and exploring different error distributions (beyond the heavy-tailed $t$-distributions tested here).

Summary updated

Abstract

Mediation analysis draws increasing attention in many scientific areas such as genomics, epidemiology and finance. In this paper, we propose new statistical inference procedures for high dimensional mediation models, in which both the outcome model and the mediator model are linear with high dimensional mediators. Traditional procedures for mediation analysis cannot be used to make statistical inference for high dimensional linear mediation models due to high-dimensionality of the mediators. We propose an estimation procedure for the indirect effects of the models via a partial penalized least squares method, and further establish its theoretical properties. We further develop a partial penalized Wald test on the indirect effects, and prove that the proposed test has a $χ^2$ limiting null distribution. We also propose an $F$-type test for direct effects and show that the proposed test asymptotically follows a $χ^2$-distribution under null hypothesis and a noncentral $χ^2$-distribution under local alternatives. Monte Carlo simulations are conducted to examine the finite sample performance of the proposed tests and compare their performance with existing ones. We further apply the newly proposed statistical inference procedures to study stock reaction to COVID-19 pandemic via an empirical analysis of studying the mediation effects of financial metrics that bridge company's sector and stock return.
BibTeX
@article{guo2022statistical,
  author = {Xu Guo and Runze Li and Jingyuan Liu and Mudong Zeng},
  title = {{Statistical inference for linear mediation models with high-dimensional mediators and application to studying stock reaction to COVID-19 pandemic}},
  journal = {Journal of Econometrics},
  year = {2022},
  doi = {10.1016/j.jeconom.2022.03.001},
}

Loading related content...

Figure