Machine Learning Based Drug Indication Prediction Using Linked Open Data

Remzi Çelebi, Özgün Erten, Michel DumontierSWAT4LS 2017

Introduction

Drug discovery is a notoriously slow and expensive process, often described as a "valley of death" where many promising compounds fail before reaching clinical application. Drug repositioning—identifying new therapeutic uses for existing, approved drugs—offers a more efficient alternative. Because the safety and toxicity profiles of these drugs are already established, repositioning can significantly reduce the time and cost associated with bringing a treatment to market.

However, computational drug repositioning faces two significant challenges: the fragmentation of biological data across isolated silos and the prevalence of evaluation bias in machine learning models. This paper presents a pipeline that addresses these issues by leveraging Linked Open Data (LOD) and implementing a rigorous "disjoint" evaluation scheme to ensure real-world predictive utility.

Methods

Data Integration and Feature Engineering

The authors utilized Semantic Web technologies to create a unified biological knowledge graph. By using SPARQL queries, they extracted data from Bio2RDF, an open-source project that integrates disparate databases such as DrugBank, KEGG, and SIDER into a single interoperable format following FAIR principles.

Knowledge graph representation of drug-related data integrated via Bio2RDF, showing connections between drugs, targets, and side effects.

This integrated data was converted into binary feature vectors for machine learning:

  • Chemical Structure: Represented by 166-bit MACCS fingerprints.
  • Drug Targets: Binary indicators for the presence or absence of specific protein targets.
  • Side Effects: Mapped to Unified Medical Language System (UMLS) identifiers.
  • Disease Descriptions: High-level concepts derived from the Medical Dictionary for Regulatory Activities (MedDRA).

Machine Learning and Evaluation Strategy

The study compared four classifiers: Logistic Regression (LR), K-Nearest Neighbors (KNN), Random Forest (RF), and the Gradient Boosting Classifier (GBC).

A central contribution of this work is the focus on "disjoint" evaluation. Traditional "pair-wise" cross-validation often allows a drug to appear in both the training and test sets (paired with different diseases), leading to data leakage. To simulate the challenge of predicting indications for entirely new drugs, the authors implemented drug-wise and disease-wise disjoint cross-validation.

Schematic of drug-wise and disease-wise disjoint cross-validation strategies used to prevent data leakage.

Key Results

Performance and the "Reality Gap"

The paper highlights a significant "reality gap" in drug repositioning research. When moving from standard pair-wise testing to drug-wise disjoint testing, performance decreased across all models. However, the Gradient Boosting Classifier (GBC) proved most robust, achieving an AUC of 0.88 on the unified gold standard dataset. When compared against the state-of-the-art SLAMS method in a drug-wise disjoint setting, the proposed GBC model achieved an AUC of 82.77%, significantly outperforming SLAMS' 67.82%.

Clinical Validation: Reboxetine Case Study

To validate the model's real-world predictive power, the authors conducted a case study on the antidepressant Reboxetine. The model predicted 17 potential new indications, including Narcolepsy (probability 0.82) and Parkinson’s Disease (probability 0.78). A subsequent literature review confirmed that Reboxetine is indeed being investigated or suggested for these specific conditions, providing strong external validation for the pipeline.

Discussion and Future Work

While the results are promising, the authors note limitations regarding "negative sample bias," where unknown drug-disease pairs are treated as negatives even if they might be successful undiscovered indications. Additionally, the text-mined nature of side-effect databases like SIDER can introduce noise. Future research will focus on incorporating more diverse data types from the LOD cloud, such as gene expression profiles and biological pathway information, to further refine prediction accuracy and reproducibility.

Summary updated

BibTeX
@inproceedings{celebi2017machine,
  author = {Remzi Çelebi and Özgün Erten and Michel Dumontier},
  title = {{Machine Learning Based Drug Indication Prediction Using Linked Open Data}},
  booktitle = {SWAT4LS},
  year = {2017},
}
Figure