Prediction of TF-Binding Site by Inclusion of Higher Order Position Dependencies

Jiyun Zhou, Qin Lu, Ruifeng Xu, Lin Gui, Hongpeng Wang

Abstract

Accurately predicting Transcription Factor Binding Sites (TFBS) is essential for understanding gene regulation. Traditional models often rely on Position Weight Matrices (PWMs) that assume positional independence, failing to capture complex biological dependencies. We present CNN_TF, a dual-path Convolutional Neural Network framework that integrates raw DNA sequences with histone modification data to capture both low-order and higher-order position dependencies. Our results demonstrate that CNN_TF outperforms state-of-the-art methods by at least 5.3% in AUPR, highlighting the critical role of higher-order dependencies and the complementarity of sequence and chromatin features in TFBS prediction.

Introduction

Transcription Factors (TFs) are regulatory proteins that bind to specific DNA sequences to control gene expression. Mapping these binding sites (TFBS) is a fundamental task in genomics. Historically, Position Weight Matrices (PWMs) have been the standard for TFBS prediction. However, PWMs operate under the "low-order" assumption that each position in a binding site is independent. In reality, biological binding often involves "higher-order" dependencies, where nucleotides at distant positions influence binding affinity. While deep learning models like DeepBind and DeepSEA have made strides, they often struggle to extract these long-range dependencies from raw sequence data alone.

Methodology

The proposed CNN_TF architecture utilizes a dual-path approach to capture diverse genomic features.

Dual-Path Architecture

The model consists of two parallel Convolutional Neural Network (CNN) arms designed to extract complementary information:

  1. Sequence Arm (Low-Order): This path processes one-hot encoded 2,000-bp DNA segments. It focuses on local motifs and immediate neighbor dependencies.
  2. Histone Arm (Higher-Order): This path processes histone modification data, which naturally spans multiple positions and reflects the broader chromatin environment. By applying a CNN to these features (binned into 100-bp windows), the model extracts large-scale, higher-order dependencies.
The CNN_TF architecture featuring parallel sequence and histone processing arms.

The features extracted from both arms are concatenated into a "Combined features" vector and passed through a softmax classifier to predict TFBS presence.

Datasets and Benchmarking

The model was evaluated using mouse embryonic stem (mES) cells (13 TFs) and human cell lines (5 TFs across 5 cell types). CNN_TF was benchmarked against traditional classifiers (SVM, Random Forest), DNA shape-based models, and deep learning architectures like DeepSEA and DanQ.

Results

Performance Gains

CNN_TF demonstrated a significant performance boost, outperforming existing state-of-the-art methods by at least 5.3% in AUPR. In human cell-type tests, the model showed an average AUPR increase of 0.152 over DNA shape-based models. For specific TFs like CTCF, the model achieved a Positive Predictive Value (PPV) of 98.6%, a substantial improvement over older HMM-based methods.

Complementarity of Dependencies

A key finding of this study is the complementarity between low-order (sequence) and higher-order (histone) dependencies. In 12 out of 13 TFs tested in mouse cells, the combined model yielded superior results compared to using either feature set in isolation.

Comparison of AUPR across different ratios of negative to positive instances for low-order, higher-order, and combined models.

As shown in the figure above, the combined model consistently maintains higher AUPR even as the data becomes more imbalanced. Interestingly, higher-order dependencies alone outperformed low-order dependencies in 11 out of 13 TFs, suggesting that the broader genomic context is often more informative than the local motif sequence.

Discussion

CNN_TF effectively demonstrates that incorporating higher-order dependencies via histone modifications significantly enhances TFBS prediction. However, the model's reliance on histone data limits its application to cell types where such experimental data is available. Additionally, the use of fixed 100-bp windows for histone features may be a subject for future optimization. Future research could explore cross-cell-type prediction to mitigate data dependency and investigate Transformer-based architectures to capture even longer-range genomic dependencies.

Summary updated

Abstract

Most proposed methods for TF-binding site (TFBS) predictions only use low order dependencies for predictions due to the lack of efficient methods to extract higher order dependencies. In this work, we first propose a novel method to extract higher order dependencies by applying CNN on histone modification features. We then propose a novel TFBS prediction method, referred to as CNN_TF, by incorporating low order and higher order dependencies. CNN_TF is first evaluated on 13 TFs in the mES cell. Results show that using higher order dependencies outperforms low order dependencies significantly on 11 TFs. This indicates that higher order dependencies are indeed more effective for TFBS predictions than low order dependencies. Further experiments show that using both low order dependencies and higher order dependencies improves performance significantly on 12 TFs, indicating the two dependency types are complementary. To evaluate the influence of cell-types on prediction performances, CNN_TF was applied to five TFs in five cell-types of humans. Even though low order dependencies and higher order dependencies show different contributions in different cell-types, they are always complementary in predictions. When comparing to several state-of-the-art methods, CNN_TF outperforms them by at least 5.3 percent in AUPR.
BibTeX
@article{zhou2020prediction,
  author = {Jiyun Zhou and Qin Lu and Ruifeng Xu and Lin Gui and Hongpeng Wang},
  title = {{Prediction of TF-Binding Site by Inclusion of Higher Order Position Dependencies}},
  journal = {IEEE ACM Trans. Comput. Biol. Bioinform.},
  year = {2020},
  doi = {10.1109/tcbb.2019.2892124},
}
Figure