Assessment of a probabilistic framework for combining structure- and ligand-based virtual screening

Simone Fulle, Stuart M. Armstrong, Paul W. Finn, Garrett M. MorrisJournal of Cheminformatics 2012 · DOI

Abstract

A wide variety of structure- and ligand-based virtual screening approaches have been developed to identify potential leads for drug discovery. Since each method possesses inherent strengths and weaknesses, combining the outcomes of different approaches is expected to decrease false positive predictions. However, reliably fusing information from disparate methods remains challenging, particularly for novel target structures where specific performance data is unavailable. This study assesses a probabilistic framework that combines structure- and ligand-based information by assigning probabilities of activity to molecules. Validated using docking methods (GOLD and AutoDock) and a ligand-based approach (ElectroShape), the study compares probabilistic fusion against standard rank fusion using the Directory of Useful Decoys (DUD).

Introduction

In the early stages of drug discovery, virtual screening (VS) serves as a critical filter to identify "lead" compounds from libraries containing millions of molecules. Traditionally, researchers rely on two distinct paradigms:

  1. Structure-Based Virtual Screening (SBVS): Utilizing protein-ligand docking to simulate how a molecule fits into a target's 3D binding pocket.
  2. Ligand-Based Virtual Screening (LBVS): Comparing new molecules to known active compounds based on shared chemical properties or shapes.

While both methods are powerful, they are prone to significant error rates. SBVS may prioritize molecules with high binding affinity but poor chemical feasibility, while LBVS may fail to identify novel chemical scaffolds. The central challenge in combining these methods lies in their incompatible scoring systems; docking energies cannot be directly averaged with molecular similarity percentages. This research evaluates a framework designed to bridge this gap through statistical probability.

Methodology

The researchers implemented a probabilistic framework, originally proposed by Swann et al. (2011), to integrate disparate data types. Unlike traditional "Rank Fusion," which simply averages a molecule's position across multiple lists, this framework assigns a probability that a molecule is active based on the distribution of scores from different screening tools.

The study utilized three primary computational tools:

  • GOLD & AutoDock: Industry-standard structure-based docking programs.
  • ElectroShape: An ultrafast ligand-based screening tool that incorporates 3D shape and lipophilicity.

To validate the framework, the team used the Directory of Useful Decoys (DUD), a benchmark dataset in chemoinformatics. The DUD contains "active" compounds for various proteins paired with "decoys"—molecules that are physically similar to actives but chemically distinct and unlikely to bind. This allows for a rigorous assessment of an algorithm's ability to distinguish true hits from false positives.

Key Insights and Discussion

The Importance of Orthogonality

The study rests on the hypothesis that SBVS and LBVS are "orthogonal," meaning they tend to fail in different ways. By fusing these approaches, the strengths of one can compensate for the weaknesses of the other. This synergy is particularly valuable for novel targets where it is unclear which single method will perform best, providing a "safety net" for researchers.

Quantifying Confidence

A significant advantage of the probabilistic framework over simple rank-based methods is the ability to provide a quantifiable confidence level. Rather than a relative rank, the framework offers a statistical likelihood of success, allowing for better prioritization of compounds for expensive laboratory testing.

Results and Future Work

Preliminary results indicate that the fusion of structure- and ligand-based approaches consistently outperforms any single screening metric. The probabilistic framework proved more effective than simple rank fusion because it accounts for the underlying distribution of scores rather than just their ordinal position.

Despite these promising results, challenges remain in the fusion of information when target-specific performance data is missing. Future research will focus on determining the exact degree of redundancy between these methods and testing the framework's robustness across more diverse and proprietary chemical datasets beyond the DUD.

Summary updated

Abstract

A wide variety of structure- and ligand-based virtual screening approaches have been developed that aim at finding potential leads to initiate drug discovery efforts. Since each method has its strengths and weakness, combining the outcome of different structure- and ligand-based approaches can be expected to decrease the number of false positive predictions. However, a reliable fusion of information from different methods is challenging. This holds true in particular for new target structures, where target specific performance experiences are missing. Here, we assess the performance of a probilistic framework approach [1] that combines structure- and ligand-based information in a meaningful way by assigning probabilities that any two molecules are active. The approach is validated using two popular docking methods (GOLD and AutoDock) and an in-house ligand-based screening approach (ElectroShape [2]). Results of similarity search and docking calculations for the Directory of Useful Decoys (DUD) [3] are combined through rank fusion as well as a probabilistic framework approach. The study will be used to answer questions such as: How far do the virtual screening-approaches used provide complementary or redundant hit lists? Does the fusion of structure- and ligand-based approaches consistently outperform any single screening metric? Using a probabilistic framework approach, is it possible to obtain a quantification of the confidence that any molecule will be active?
BibTeX
@article{fulle2012assessment,
  author = {Simone Fulle and Stuart M. Armstrong and Paul W. Finn and Garrett M. Morris},
  title = {{Assessment of a probabilistic framework for combining structure- and ligand-based virtual screening}},
  journal = {Journal of Cheminformatics},
  year = {2012},
  doi = {10.1186/1758-2946-4-s1-p7},
}
Figure