Improving drug–target affinity prediction by adaptive self-supervised learning

Qing Ye, Yaxin SunPeerJ 2025 · DOI

TL;DR

This paper introduces ASSLDTA, a novel framework for predicting drug-target affinity that tackles the challenges of sample mismatch and objective misalignment in existing self-supervised learning methods. By employing a two-stage feature extraction process, ASSLDTA effectively leverages unlabeled data to learn low-level fragment features and then uses labeled data to refine these into high-level features for accurate affinity prediction.

What Problem Does This Paper Address?

Predicting how strongly a drug molecule will bind to its target protein (drug-target affinity, or DTA) is crucial for drug discovery and development. While deep learning has accelerated this process, current self-supervised learning (SSL) methods face two main hurdles:

  1. Sample Mismatch: SSL typically trains on drug and target molecules independently. However, DTA prediction requires understanding the interaction between a drug and a target.
  2. Objective Mismatch: SSL objectives often focus on broad feature extraction, which doesn't always align with the biological principle of "induced fit" in drug binding, where precise local interactions are key. This can lead to SSL models missing critical fine-grained details.

The authors aim to bridge this gap by developing a method that can effectively learn from large amounts of unlabeled data while still capturing the specific, localized interactions relevant to DTA.

Methods

The core of the proposed solution is the Adaptive Self-Supervised Learning (ASSL) module integrated into the ASSLDTA framework. This approach uses a two-stage feature extraction process:

  1. Low-Level Feature Extraction (ASSL):
    • Instead of processing entire drug/target molecules, ASSL breaks them down into fixed-length fragments.
  2. It then trains RoBERTa models (a powerful language model) on these fragments. This is done using a "fill-masking" task, similar to how language models learn context.
  3. The key innovation here is training on fragments rather than whole molecules, which helps preserve crucial local information and addresses the "sample mismatch" by focusing on components that are more likely to be involved in binding.
  4. This stage aims to maximize the retention of original feature information from these fragments.
  5. High-Level Feature Extraction (Supervised):
    • The low-level features extracted by ASSL are then fed into a 2D Convolutional Neural Network (CNN). The 2D CNN is designed to highlight useful fragments and their relationships, effectively learning higher-level representations.
  6. Additionally, a Graph Convolutional Network (GCN) is used to extract graph-based features from the drug molecules, leveraging their inherent graph structure.
  7. Finally, these high-level features from the 2D CNN and GCN are concatenated and passed through a Fully Connected Neural Network (FCNN) to predict the final DTA score.

This two-stage design allows ASSL to leverage abundant unlabeled data for initial feature learning, while the supervised 2D CNN and GCN refine these features using limited labeled data, focusing on the critical aspects for DTA.

Datasets

The proposed ASSLDTA model was evaluated on several benchmark datasets:

  • Drug-Target Affinity (DTA) Datasets: Kiba, Davis, DTC, Metz, and Tox-Cast.
  • Compound-Protein Interaction (CPI) Datasets: Human, C.elegans, and BindingDB.

These datasets vary in size and complexity, allowing the authors to test the model's performance and generalization capabilities.

Key Insights and Ideas

  • Fragment-based SSL is key: Processing drugs and targets as collections of fragments, rather than whole entities, significantly improves the ability of SSL models (like RoBERTa) to capture relevant local features for DTA.
  • Bridging the objective gap: By focusing SSL on fragment reconstruction, the model learns representations that are more aligned with the "induced fit" principle of drug binding, overcoming the mismatch with broader SSL objectives.
  • Two-stage learning is synergistic: The combination of ASSL for low-level fragment features and supervised 2D CNN/GCN for high-level interaction features proves more effective than either approach alone.
  • GCN adds value for drug structure: While ASSL is the primary driver of improvement, incorporating GCNs to leverage the inherent graph structure of drug molecules further enhances performance.

Key Results

  • Superior Performance: ASSLDTA consistently outperformed various state-of-the-art methods across multiple DTA datasets (Kiba, Davis, DTC, Metz, Tox-Cast) and CPI datasets.
  • Significant Improvements: On the Kiba dataset, ASSLDTA achieved a CI of 0.908, MSE of 0.1600, r² of 0.7720, and AUPR of 0.8240, outperforming strong baselines like MAM and DGraphDTA. For example, its CI was 0.010 higher than 2DCNN-BERT and 0.004 higher than DGraphDTA.
  • Robustness: The model demonstrated good generalization ability, performing well on different datasets and tasks (DTA and CPI).
  • Effectiveness of ASSL: Ablation studies showed that the ASSL module was the most critical component, significantly boosting performance compared to methods relying solely on CNNs, GCNs, or other pre-trained models.
  • Parameter Sensitivity: The study found that ASSLDTA is not highly sensitive to parameter choices like K (number of fragments), suggesting its robustness.

Limitations and Future Work

  • Fragment Division: The authors acknowledge that precisely dividing core fragments remains a challenge. While their fragment-based approach is effective, a more sophisticated segmentation method could further improve feature extraction.
  • SSL Objective: While ASSL improves upon existing SSL methods, it doesn't directly address all inherent limitations of SSL for DTA. Future work could focus on designing new pre-training objectives specifically tailored to overcome these issues.
  • Segmentation Functionality: Designing methods to assign specific functions to each fragment could lead to more meaningful features extracted during pre-training.
  • Limited Improvement: While ASSLDTA shows significant gains, the authors note that the improvement is "limited," suggesting ongoing research is needed to push the boundaries further.

Summary updated

Abstract

Computational drug-target affinity prediction is important for drug screening and discovery. Currently, self-supervised learning methods face two major challenges in drug-target affinity prediction. The first difficulty lies in the phenomenon of sample mismatch: self-supervised learning processes drug and target samples independently, while actual prediction requires the integration of drug-target pairs. Another challenge is the mismatch between the broadness of self-supervised learning objectives and the precision of biological mechanisms of drug-target affinity (<i>i.e</i>., the induced-fit principle). The former focuses on global feature extraction, while the latter emphasizes the importance of local precise matching. To address these issues, an adaptive self-supervised learning-based drug-target affinity prediction (ASSLDTA) was designed. ASSLDTA integrates a novel adaptive self-supervised learning (ASSL) module with a high-level feature learning network to extract the feature. The ASSL leverages a large amount of unlabeled training data to effectively capture low-level features of drugs and targets. Its goal is to maximize the retention of original feature information, thereby bridging the objective gap between self-supervised learning and drug-target affinity prediction and alleviating the sample mismatch problem. The high-level feature learning network, on the other hand, focuses on extracting effective high-level features for affinity prediction through a small amount of labeled data. Through this two-stage feature extraction design, each stage undertakes specific tasks, fully leveraging the advantages of each model while efficiently integrating information from different data sources, providing a more accurate and comprehensive solution for drug-target affinity prediction. In our experiments, ASSLDTA is much better than other deep methods, and the result of ASSLDTA is significantly increased by learning adaptive self-supervised learning-based features, which validates the effectiveness of our ASSLDTA.
BibTeX
@inproceedings{ye2025improving,
  author = {Qing Ye and Yaxin Sun},
  title = {{Improving drug–target affinity prediction by adaptive self-supervised learning}},
  booktitle = {PeerJ},
  year = {2025},
  doi = {10.7717/peerj-cs.2622},
}
Figure