A Penalized Multi-trait Mixed Model for Association Mapping in Pedigree-based GWAS

Jin Liu, Can Yang, Xingjie Shi, Cong Li, Jian Huang, Hongyu Zhao, Shuangge MaarXiv 2013 · DOI · arXiv

Abstract

In genome-wide association studies (GWAS), identifying genetic markers associated with complex traits requires statistical tools that can account for both complicated sample dependence structures and high-dimensional data. While linear mixed models (LMMs) excel at handling sample relatedness, and penalization methods are effective for variable selection, traditional approaches often analyze traits marginally. This study introduces Penalized-MTMM, a penalized multivariate linear mixed model designed for the simultaneous analysis of multiple highly correlated traits. By accounting for within-trait and between-trait variance components, the model improves selection and prediction performance. Validated through simulation and Genetic Analysis Workshop (GAW) 18 data, the proposed method demonstrates superior accuracy in identifying genetic associations compared to uni-trait models.

Introduction

Genome-wide association studies (GWAS) have become a cornerstone of modern genomics, yet they face significant statistical hurdles. Two primary challenges involve sample relatedness—common in pedigree-based studies where family members share genetic backgrounds—and pleiotropy, where a single genetic variant influences multiple physical traits.

Standard GWAS methodologies often analyze traits in isolation. However, when traits are highly correlated (such as systolic and diastolic blood pressure), marginal analysis ignores the shared information between them, leading to a loss of statistical power. To address this, we propose the Penalized Multi-trait Mixed Model (Penalized-MTMM), which integrates multivariate linear mixed models with advanced penalization techniques to identify genetic markers across multiple traits simultaneously.

The Problem: Relatedness and Pleiotropy

In pedigree-based data, the assumption of independent and identically distributed (i.i.d.) samples is violated. If not corrected, this dependence structure can lead to inflated false-positive rates. Linear Mixed Models (LMMs) typically address this by treating sample relatedness as a random effect.

Simultaneously, many traits share genetic roots. Analyzing these traits independently fails to "borrow strength" across the dataset. Furthermore, GWAS often presents a "high-dimensional" challenge where the number of genetic markers ($p$) significantly exceeds the number of samples ($n$). This necessitates penalization—a method to shrink the effects of irrelevant markers to zero, leaving only the most significant predictors.

Methodology

The Penalized-MTMM Framework

The Penalized-MTMM architecture is built upon three primary pillars:

  1. Multivariate Linear Mixed Model: Unlike standard LMMs, this framework handles multiple traits simultaneously. It utilizes a variance-covariance matrix to account for both within-trait and between-trait correlations, as well as the kinship structure of the pedigree.
  2. AI-REML Estimation: The model employs the "Average Information - Restricted Maximal Likelihood" (AI-REML) method. This approach is used to estimate the complex variance components efficiently, ensuring the model remains computationally feasible despite the added complexity of multiple traits.
  3. Advanced Penalization (MCP): To perform variable selection in high-dimensional space, the model uses the Minimax Concave Penalty (MCP). Two specific variations are offered:
  4. Group MCP: Assumes a "homogeneity" structure, where a gene or marker is expected to affect all traits in the model consistently.
  5. Sparse Group MCP: Assumes "heterogeneity," allowing a gene to be associated with a subset of the traits, providing greater flexibility for complex biological pathways.

SNP Collapsing

To improve the detection of rare variants, individual SNPs are grouped into gene-level "genetic scores" using a weighted-sum method. This reduces the dimensionality of the data and increases the signal-to-noise ratio for gene-based association mapping.

Experimental Validation

Simulation Studies

The researchers tested the model using 400 subjects and 5,000 genes across six correlation scenarios. In these simulations, Penalized-MTMM consistently outperformed uni-trait penalized LMMs, showing a higher Area Under the Curve (AUC) in ROC plots, indicating more robust gene discovery.

Real-World Application: GAW 18

The model was applied to data from the Genetic Analysis Workshop (GAW) 18, featuring 849 Mexican American individuals from 20 large pedigrees. The analysis focused on two highly correlated traits: Systolic Blood Pressure (SBP) and Diastolic Blood Pressure (DBP).

Key Results and Insights

Improved Prediction Accuracy

The Penalized-MTMM demonstrated a clear advantage in prediction performance, measured by the Pearson correlation between predicted values and observed observations:

  • Systolic Blood Pressure (SBP): The MTMM achieved a correlation of 0.152, compared to 0.125 for the uni-trait model.
  • Diastolic Blood Pressure (DBP): The MTMM achieved a correlation of 0.186, compared to 0.146 for the uni-trait model.

Gene Discovery

The model identified several candidate genes, including OGDH and EXOSC2, which showed high Observed Occurrence Indices. These findings suggest these genes are robust candidates for the regulation of blood pressure, a discovery made possible by the model's ability to clean background "polygenic noise" while focusing on large-effect markers.

Discussion and Future Directions

The primary advantage of the Penalized-MTMM lies in its ability to "borrow strength" across traits. By modeling the correlation between SBP and DBP, the framework can identify weak genetic signals that might be missed in a marginal analysis.

While the current study focused on two traits, the authors suggest that the benefits of Sparse Group MCP will become even more pronounced in studies involving four or more traits, where the patterns of association are likely to be more complex. Future work may also extend this framework to longitudinal data, where traits are measured repeatedly over time, further enhancing the model's utility in clinical and epidemiological research.

Summary updated

Abstract

In genome-wide association studies (GWAS), penalization is an important approach for identifying genetic markers associated with trait while mixed model is successful in accounting for a complicated dependence structure among samples. Therefore, penalized linear mixed model is a tool that combines the advantages of penalization approach and linear mixed model. In this study, a GWAS with multiple highly correlated traits is analyzed. For GWAS with multiple quantitative traits that are highly correlated, the analysis using traits marginally inevitably lose some essential information among multiple traits. We propose a penalized-MTMM, a penalized multivariate linear mixed model that allows both the within-trait and between-trait variance components simultaneously for multiple traits. The proposed penalized-MTMM estimates variance components using an AI-REML method and conducts variable selection and point estimation simultaneously using group MCP and sparse group MCP. Best linear unbiased predictor (BLUP) is used to find predictive values and the Pearson's correlations between predictive values and their corresponding observations are used to evaluate prediction performance. Both prediction and selection performance of the proposed approach and its comparison with the uni-trait penalized-LMM are evaluated through simulation studies. We apply the proposed approach to a GWAS data from Genetic Analysis Workshop (GAW) 18.
BibTeX
@misc{liu2013penalized,
  author = {Jin Liu and Can Yang and Xingjie Shi and Cong Li and Jian Huang and Hongyu Zhao and Shuangge Ma},
  title = {{A Penalized Multi-trait Mixed Model for Association Mapping in Pedigree-based GWAS}},
  year = {2013},
  eprint = {1305.4413},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1305.4413},
}
Figure