MRDPDA: A multi‐Laplacian regularized deepFM model for predicting piRNA‐disease associations

Yajun Liu, Fan Zhang, Yulian Ding, Rong Fei, Junhuai Li, Fang‐Xiang WuJournal of Cellular and Molecular Medicine 2024 · DOI

TL;DR

This paper introduces MRDPDA, a novel deep learning model that effectively predicts associations between piRNAs (small non-coding RNAs) and diseases. By integrating multiple data sources with a unique multi-Laplacian regularization technique within a deepFM framework, MRDPDA overcomes the challenge of limited piRNA-disease data, achieving state-of-the-art performance.

What Problem Does This Paper Address?

The paper tackles the challenge of predicting piRNA-disease associations (PDAs). While piRNAs are increasingly recognized for their roles in gene regulation and as potential biomarkers for various diseases, current computational methods struggle to accurately identify these associations. This is primarily due to the limited availability of experimental data for PDAs compared to other RNA types like miRNAs, circRNAs, and lncRNAs. Existing methods often rely on simple data fusion or struggle with the inherent imbalance and noise in the available datasets. The authors aim to develop a more robust and accurate method that can effectively leverage multiple, albeit limited, data sources to predict PDAs.

Methods

The core of MRDPDA is a deepFM (Deep Factorization Machine) model, a powerful architecture for capturing both low- and high-order feature interactions. What makes MRDPDA novel is its approach to integrating diverse piRNA and disease similarity information. Instead of simply averaging similarities, MRDPDA employs a multi-Laplacian regularization strategy. This means that each type of similarity (e.g., piRNA sequence local alignment, k-mer similarity, GIP kernel similarity, and disease semantic similarity, symptom similarity, GIP kernel similarity) is regularized independently using its own Laplacian matrix. This allows the model to learn more nuanced and effective embeddings for piRNAs and diseases.

Additionally, the authors propose a unified objective function that combines the embedding loss from these similarities, ensuring the learned embeddings are optimized for the prediction task. To address the issue of noisy and imbalanced data, they construct a balanced benchmark dataset from the piRPheno database and utilize a deep autoencoder to generate a reliable set of negative samples from unlabeled data.

Datasets

The study utilizes data from three primary piRNA-disease association (PDA) databases:

  • piRDisease 1.0: Used by previous studies, it contains 5002 associations between 4350 piRNAs and 21 diseases.
  • piRPheno 2.0: This is a manually curated database. The authors create a new benchmark dataset from piRPheno by removing duplicates, resulting in 4417 associations involving 462 piRNAs and 102 diseases. This dataset is highlighted as being more balanced.
  • MNDR 3.0: This database provides 11,981 associations with 10,149 piRNAs and 19 diseases.

For similarity calculations, piRNA sequences were sourced from piRBase V3.0. Disease information was gathered from MeSH and the Human symptoms-disease network.

Key Insights and Ideas

  • The power of multi-Laplacian regularization: The paper demonstrates that treating each data source's similarity independently with Laplacian regularization is more effective than simple averaging. This allows the model to capture richer, distinct patterns from each data modality.
  • Importance of reliable negative samples: Using a deep autoencoder to carefully select negative samples significantly improves model performance compared to using randomly selected unlabeled data. This highlights the impact of data quality and preprocessing on predictive accuracy.
  • DeepFM as a strong foundation: The deepFM architecture proves to be a robust choice for this task, effectively combining factorization machines for low-order interactions and multi-layer perceptrons for high-order feature learning.
  • Bridging the data gap: By integrating multiple limited datasets and employing advanced regularization and negative sample selection, MRDPDA offers a promising solution for predicting associations in data-scarce domains like PDAs.

Key Results

MRDPDA achieved state-of-the-art performance on the piRPheno benchmark dataset.

  • Five-fold Cross-Validation (5-CV): MRDPDA achieved the highest AUC of 95.33% and AUPR of 94.83%.
  • Independent Test: MRDPDA also showed superior performance, with the highest AUC.
  • Computational Efficiency: MRDPDA was the fastest among the compared methods, taking 141,202 ms for 5-CV, outperforming iPiDA-GCN, GAPDA-LGAT, and ETGPDA.
  • Case Studies: The model successfully identified known piRNA associations for Alzheimer's disease and Gastric cancer, with several predictions validated by literature mining, demonstrating its ability to predict associations for new diseases.

Limitations and Future Work

The authors acknowledge several limitations and suggest future directions:

  • Data Quality and Quantity: The current PDA datasets are still limited in size and suffer from strong inclusion relationships between diseases. They propose developing a PDA data management platform and exploring meta-learning approaches to train unified models across multiple datasets.
  • Algorithm Perspective: For future PDA prediction models, they suggest exploring ensemble learning strategies (like boosting) to combine multiple weak learners, especially once more data becomes available. They also aim to develop new prediction models that can handle the highly imbalanced nature of PDA data.

Summary updated

Abstract

PIWI-interacting RNAs (piRNAs) are a typical class of small non-coding RNAs, which are essential for gene regulation, genome stability and so on. Accumulating studies have revealed that piRNAs have significant potential as biomarkers and therapeutic targets for a variety of diseases. However current computational methods face the challenge in effectively capturing piRNA-disease associations (PDAs) from limited data. In this study, we propose a novel method, MRDPDA, for predicting PDAs based on limited data from multiple sources. Specifically, MRDPDA integrates a deep factorization machine (deepFM) model with regularizations derived from multiple yet limited datasets, utilizing separate Laplacians instead of a simple average similarity network. Moreover, a unified objective function to combine embedding loss about similarities is proposed to ensure that the embedding is suitable for the prediction task. In addition, a balanced benchmark dataset based on piRPheno is constructed and a deep autoencoder is applied for creating reliable negative set from the unlabeled dataset. Compared with three latest methods, MRDPDA achieves the best performance on the pirpheno dataset in terms of the five-fold cross validation test and independent test set, and case studies further demonstrate the effectiveness of MRDPDA.
BibTeX
@article{liu2024mrdpda,
  author = {Yajun Liu and Fan Zhang and Yulian Ding and Rong Fei and Junhuai Li and Fang‐Xiang Wu},
  title = {{MRDPDA: A multi‐Laplacian regularized deepFM model for predicting piRNA‐disease associations}},
  journal = {Journal of Cellular and Molecular Medicine},
  year = {2024},
  doi = {10.1111/jcmm.70046},
}
Figure