Variable prioritization in nonlinear black box methods: A genetic association case study

Lorin Crawford, Seth Flaxman, Daniel E. Runcie, Mike WestThe Annals of Applied Statistics 2019 · DOI · arXiv

Introduction

In the era of high-throughput biology, researchers often face a fundamental trade-off between the interpretability of linear models and the predictive power of nonlinear "black box" algorithms. While linear models provide clear coefficients for individual genetic variants, they frequently fail to capture epistasis—the complex, nonlinear interactions between genes that drive many phenotypes. Conversely, nonparametric methods like Gaussian Process (GP) regression and neural networks excel at modeling these interactions but offer little insight into which specific variables are driving the predictions.

This paper introduces RelATive cEntrality (RATE), a novel framework designed to open these black boxes. RATE provides a way to rank variable importance that accounts for both direct effects and the intricate network of covarying relationships within the data.

Methodology: The RATE Framework

The authors propose a two-step approach to derive interpretable importance measures from any Bayesian nonlinear model.

1. The Effect Size Analog ($\tilde{\beta}$)

Because nonlinear models do not possess standard regression coefficients, the authors project the estimated nonlinear function back onto the original input space. This creates a vector of "analog" effect sizes ($\tilde{\beta}$) that represent the contribution of each variable in a format comparable to traditional linear weights.

2. RelATive cEntrality (RATE)

To prioritize these variables, the framework employs Kullback-Leibler Divergence (KLD) to measure "information shift." By calculating the divergence between the full posterior distribution and a distribution where a specific variable's effect is nullified, the method quantifies how much information is lost.

A variable is considered "central" if its removal causes a significant shift in the system's entropy. The RATE score is a normalized value between 0 and 1, calculated as the KLD of a single variable divided by the sum of KLDs for all variables. The authors establish a natural significance threshold at $1/p$ (where $p$ is the number of variables); a score above this threshold indicates the variable is more influential than a random uniform contributor.

Empirical Evaluation

The efficacy of RATE was tested across simulated environments and two distinct biological datasets.

Simulated Data

In simulations featuring high levels of interaction effects and varying heritability, RATE consistently outperformed standard linear scans (SCANONE), Lasso, and Elastic Net. The method demonstrated a superior Area Under the Curve (AUC) in identifying true causal variants, particularly when those variants operated through complex interactions rather than simple additive effects.

Arabidopsis thaliana QTL Mapping

Applying RATE to a study of 403 Arabidopsis thaliana plants, the authors focused on metabolic traits within biosynthetic pathways. RATE successfully identified key genes, such as ALDH6B2 and GSTU20, which are known members of these pathways but are frequently missed by traditional linear models due to their interactive nature.

Heterogeneous Stock Mice GWAS

In a large-scale genome-wide association study (GWAS) of approximately 2,000 mice, RATE was used to analyze traits like body weight and HDL cholesterol. The method highlighted the Smarca1 gene as a primary driver. While standard GWAS methods often struggle to prioritize Smarca1, RATE identified it as highly central, suggesting its influence is mediated through nonlinear properties that linear scans overlook.

Key Insights and Discussion

A significant contribution of this work is the shift from "marginal" importance to "central" importance. Traditional variable selection often looks for the direct impact of $X$ on $Y$. RATE, however, identifies variables that may have small marginal effects but are crucial "mediators" or hubs within a network of interactions.

Furthermore, the method is model-agnostic. While the paper focuses on Gaussian Processes, RATE can be applied to any model capable of producing uncertainty intervals (e.g., Bayesian Neural Networks or frequentist models via bootstrapping). The inclusion of Shannon entropy also allows for the calculation of an "Effective Sample Size" (ESS), helping researchers determine if a model has identified a sparse set of truly important variables or if the signal is too diffused to be reliable.

Limitations and Future Directions

Despite its power, RATE faces computational challenges. The current implementation scales cubically ($O(p^3)$) with the number of features, which may necessitate a pre-filtering step when applied to human GWAS datasets containing millions of SNPs. Additionally, while RATE identifies that a variable is important due to interactions, it does not yet characterize the nature of those interactions (e.g., synergistic vs. inhibitory). Future work may involve extending these centrality measures to frequentist frameworks and improving the scalability for ultra-high-dimensional data.

Summary updated

Abstract

The central aim in this paper is to address variable selection questions in nonlinear and nonparametric regression. Motivated by statistical genetics, where nonlinear interactions are of particular interest, we introduce a novel and interpretable way to summarize the relative importance of predictor variables. Methodologically, we develop the “RelATive cEntrality” (RATE) measure to prioritize candidate genetic variants that are not just marginally important, but whose associations also stem from significant covarying relationships with other variants in the data. We illustrate RATE through Bayesian Gaussian process regression, but the methodological innovations apply to other “black box” methods. It is known that nonlinear models often exhibit greater predictive accuracy than linear models, particularly for phenotypes generated by complex genetic architectures. With detailed simulations and two real data association mapping studies, we show that applying RATE enables an explanation for this improved performance.
BibTeX
@article{crawford2019variable,
  author = {Lorin Crawford and Seth Flaxman and Daniel E. Runcie and Mike West},
  title = {{Variable prioritization in nonlinear black box methods: A genetic association case study}},
  journal = {The Annals of Applied Statistics},
  year = {2019},
  doi = {10.1214/18-aoas1222},
}

Loading related content...

Figure