DECODE: A De ep-learning Framework for Co n de nsing Enhancers and Refining Boundaries with Large-scale Functional Assays

Zhanlin Chen, Jing Zhang, Jason Liu, Yi Dai, Donghoon Lee, Martin Renqiang Min, Min Xu, Mark GersteinbioRxiv 2021 · DOI

TL;DR

This paper introduces DECODE, a novel deep learning framework that significantly improves enhancer prediction by not only identifying their presence but also precisely defining their boundaries. By leveraging large-scale functional assay data and a weakly supervised object detection approach, DECODE generates more accurate and compact enhancer annotations, leading to enhanced downstream analyses like disease variant mapping.

What Problem Does This Paper Address?

Identifying regulatory elements like enhancers is crucial for understanding gene regulation, genome evolution, and the impact of genetic variations on diseases. However, existing methods for enhancer prediction face several limitations:

  • Low Resolution: Many methods provide binary predictions within broad genomic regions, failing to pinpoint precise enhancer boundaries. This results in annotations that include non-functional regions, introducing noise and reducing the statistical power for downstream analyses.
  • Limited Training Data: Previous supervised methods often relied on limited validated enhancer datasets, hindering model accuracy.
  • Lack of Interpretability: "Black-box" models make it difficult to understand why a region is predicted as an enhancer.
  • Poor Transferability: Models trained on one cell type often struggle to generalize to others.

These issues collectively limit our ability to accurately map regulatory elements and understand their functional significance, particularly in relation to genetic variations and disease.

Methods

DECODE employs a two-step deep learning approach:

  1. Deep Neural Network Binary Classifier:
    • Input: High-resolution epigenetic features (e.g., ATAC-seq, DNase-seq, ChIP-seq for various histone marks) from a 4kb genomic window.
  2. Architecture: A ResNet-inspired Convolutional Neural Network (CNN) designed to capture complex, non-linear interactions between epigenetic features. The model is trained on direct enhancer activity readouts from STARR-seq experiments.
  3. Output: A probability score indicating the likelihood of an enhancer being present in the input region.
  4. Weakly Supervised Object Detection for Boundary Refinement:
    • Technique: Gradient-weighted Class Activation Mapping (Grad-CAM) is used to extract interpretable visual explanations from the CNN's predictions.
  5. Feature-wise Grad-CAM: Identifies which epigenetic features are most important for enhancer prediction, offering biological insights.
  6. Position-wise Grad-CAM: Pinpoints the most salient genomic locations within the 4kb window that contribute to the positive enhancer prediction. This allows for precise boundary localization at a 10 bp resolution.
  7. Output: "Core enhancer" regions, which are significantly condensed versions of the initial predictions, with refined boundaries.

This two-step process allows DECODE to first accurately predict enhancers and then refine their annotations to a much higher resolution.

Datasets

  • Training Data:
    • Large-scale STARR-seq data from five human cell lines (HepG2, K562, A549, MCF-7, HCT116).
  • Chromatin accessibility data (ATAC-seq and/or DNase-seq).
  • ChIP-seq data for H3K27ac, H3K4me3, H3K4me1, and H3K9ac.
  • Negative regions were down-sampled from the background at a 1:10 positive to negative ratio.
  • Evaluation Data:
    • Transgenic mouse enhancer data from the VISTA enhancer database (used for benchmarking against state-of-the-art methods).
  • Epigenetic signal tracks for neural progenitor cells (NPCs) for a case study on psychiatric disorders.
  • GWAS summary statistics for four NPC-relevant traits (bipolar disorder, neuroticism, schizophrenia, and years of secondary education).

Key Insights and Ideas

  • Bridging Classification and Localization: The paper successfully combines a robust enhancer classification model with a novel object detection module for precise boundary refinement, addressing a key limitation of prior work.
  • Interpretability through Grad-CAM: Using Grad-CAM not only refines annotations but also provides valuable insights into which epigenetic features and genomic locations are most critical for enhancer identification, making the model more transparent.
  • The Power of Large-Scale Functional Data: Training on direct enhancer activity readouts (STARR-seq) proved more effective than relying solely on indirect epigenetic marks.
  • Compactness Enhances Power: The refined, compact enhancer annotations are shown to have a stronger regulatory impact, leading to increased statistical power in downstream analyses like GWAS variant enrichment.
  • Generalizability: The model demonstrates strong performance across different cell types, indicating its potential for broad applicability.

Key Results

  • Binary Classifier Performance: DECODE's binary classifier achieved high out-of-sample accuracy (auROC > 0.999, auPRC > 0.972) and demonstrated excellent transferability across cell lines.
  • Benchmarking: DECODE outperformed the state-of-the-art Matched-Filter method by 24% in terms of auPRC on transgenic mouse enhancer data.
  • Annotation Condensation: The object detection module condensed enhancer annotations to an average of 12.6% of their original size, while retaining key functional information.
  • Conservation: Refined core enhancer regions showed significantly higher cross-species conservation (median PhastCons score 0.117 vs. 0.092).
  • GWAS Enrichment: Compact DECODE annotations led to a 2- to 10-fold increase in GWAS enrichment for psychiatric and neurodevelopmental phenotypes compared to the original, broader annotations.
  • TSS Overlap: Refined regions showed a disproportionately large overlap (71%) with transcription start sites (TSS) despite their reduced size.

Limitations and Future Work

  • Data Availability: The performance of DECODE is dependent on the availability of relevant epigenetic data and functional assays for specific cell types.
  • Computational Resources: While GPU acceleration is mentioned, deep learning models can still be computationally intensive.
  • Future Work: The authors suggest that DECODE will benefit from the rapid development of novel functional characterization assays and the exponential growth of training data, which will further improve accuracy and performance. They also highlight the potential for DECODE to be applied to other regulatory elements beyond enhancers.

Summary updated

Abstract

Abstract Summary Mapping distal regulatory elements, such as enhancers, is the cornerstone for investigating genome evolution, understanding critical biological functions, and ultimately elucidating how genetic variations may influence diseases. Previous enhancer prediction methods have used either unsupervised approaches or supervised methods with limited training data. Moreover, past approaches have operationalized enhancer discovery as a binary classification problem without accurate enhancer boundary detection, producing low-resolution annotations with redundant regions and reducing the statistical power for downstream analyses (e.g., causal variant mapping and functional validations). Here, we addressed these challenges via a two-step model called DECODE. First, we employed direct enhancer activity readouts from novel functional characterization assays, such as STARR-seq, to train a deep neural network classifier for accurate cell-type-specific enhancer prediction. Second, to improve the annotation resolution (∼500 bp), we implemented a weakly-supervised object detection framework for enhancer localization with precise boundary detection (at 10 bp resolution) using gradient-weighted class activation mapping. Results Our DECODE binary classifier outperformed the state-of-the-art enhancer prediction methods by 24% in transgenic mouse validation. Further, DECODE object detection can condense enhancer annotations to only 12.6% of the original size, while still reporting higher conservation scores and genome-wide association study variant enrichments. Overall, DECODE improves the efficiency of regulatory element mapping with graphic processing units for deep-learning applications and is a powerful tool for enhancer prediction and boundary localization. Availability DEOCDE is available at decode.gersteinlab.org Contact [email protected]
BibTeX
@misc{chen2021decode,
  author = {Zhanlin Chen and Jing Zhang and Jason Liu and Yi Dai and Donghoon Lee and Martin Renqiang Min and Min Xu and Mark Gerstein},
  title = {{DECODE: A <i>De</i> ep-learning Framework for <i>Co</i> n <i>de</i> nsing Enhancers and Refining Boundaries with Large-scale Functional Assays}},
  year = {2021},
  doi = {10.1101/2021.01.27.428477},
  howpublished = {bioRxiv},
}
Figure