GLPocket: A Multi-Scale Representation Learning Approach for Protein Binding Site Prediction

Peiying Li, Yongchang Liu, Shikui Tu, Lei Xu

Introduction: The Scale Dilemma in Drug Discovery

In the early stages of drug discovery, identifying "binding sites"—the specific grooves or pockets on a protein's surface where a ligand can attach—is a critical task. However, this task is computationally challenging because binding pockets are minuscule relative to the overall protein structure, often occupying less than 1/10th of the protein's diameter.

Protein binding sites are small cavities (a) where ligands bind (b-e), presenting a significant multi-scale detection challenge.

Existing deep learning methods, primarily based on 3D U-Nets, suffer from a "scale dilemma." Models that analyze the entire protein often lose the fine-grained geometric details necessary to define a pocket's precise shape. Conversely, models that focus only on small local subgrids lose the global structural context of the protein. This frequently results in "noisy" predictions, disconnected artifacts, or missed pockets entirely.

The GLPocket Framework

To resolve this dilemma, the authors propose GLPocket, a multi-scale deep learning framework built on the Lmser (Least mean square error reconstruction) architecture. Lmser is an autoencoder variant that utilizes enhanced skip and feedback connections to improve feature reconstruction.

GLPocket introduces two novel components to bridge the gap between global context and local detail:

1. Target Cropping Block (TCB)

The TCB functions as an intelligent zoom lens. During the encoding phase, the model identifies a "region of interest" (ROI) based on global features. The TCB then crops this region, effectively discarding approximately 82% of the "empty" protein volume. This allows the decoder to concentrate its computational resources on the most probable pocket area, reducing noise and preventing the formation of artifacts common in global-only models.

2. Transformer Block (TB)

Once focused on the local region, GLPocket employs a Transformer block to model long-range relationships between different 3D "patches" of the pocket. While traditional convolutions are limited to local receptive fields, the TB captures the complex 3D semantic context of the pocket. This helps the model generate biologically realistic, continuous pocket masks rather than fragmented clusters of points.

The GLPocket architecture features a Target Cropping Block (TCB) for multi-scale focus and a Transformer Block (TB) for capturing 3D semantic context.

Experimental Setup and Datasets

The model was trained on the scPDB (v2017) dataset, which contains over 16,000 protein-ligand structures. To ensure generalizability, GLPocket was evaluated against four diverse gold-standard benchmarks:

  • COACH420 and HOLO4k: Standard sets for pocket prediction.
  • PDBbind (v2020): A large-scale dataset with varied complexes.
  • SC6K: A benchmark focused on diverse protein families.

Key Results and Performance

GLPocket consistently outperformed previous state-of-the-art (SOTA) models, including DeepPocket, RecurPocket, and Kalasanty, across all benchmarks:

  • Accuracy Gains: The model showed a 0.5% to 4% improvement in DCA (Distance between Centers and Atoms) Top-n accuracy.
  • Success Rates: On the COACH420 dataset, GLPocket achieved a 92.74% success rate in DCC (Distance between Centers), a massive improvement over the 56.85% achieved by the earlier Kalasanty model.
  • Qualitative Superiority: Visual analysis confirms that GLPocket produces cleaner, more continuous masks that closely align with the ground-truth cavities where ligands reside. Unlike its predecessors, it avoids producing disconnected "blobs" of predicted density.

Conclusion and Future Directions

By combining global-to-local cropping with Transformer-based attention, GLPocket effectively navigates the scale dilemma of protein binding site prediction. While the model is highly effective for standard sites, the authors noted that its specialized cropping might require further tuning for exceptionally large or elongated binding sites, as seen in some PDBbind complexes.

Future work may involve developing dynamic cropping ratios that adapt to the protein's initial global scan or applying this multi-scale "zoom" architecture to other 3D medical imaging tasks where small targets are embedded within large, complex volumes.

Summary updated

Abstract

Protein binding site prediction is an important prerequisite for the discovery of new drugs. Usually, natural 3D U-Net is adopted as the standard site prediction framework to do per-voxel binary mask classification. However, this scheme only performs feature extraction for single-scale samples, which may bring the loss of global or local information, resulting in incomplete, artifacted or even missed predictions. To tackle this issue, we propose a network called GLPocket, which is based on the Lmser (Least mean square error reconstruction) network and utilizes multi-scale representation to predict binding sites. Firstly, GLPocket uses Target Cropping Block (TCB) for targeted prediction. TCB selects the local interested feature from the global representations to perform concentrated prediction, and reduces the volume of feature maps to be calculated by 82% without adding additional parameters. It integrates global distribution information into local regions, making prediction more concentrated on decoding stage. Secondly, GLPocket establishes long-range relationship of patches within the local region with Transformer Block (TB), to enrich local context semantic information. Experiments show that GLPocket improves by 0.5%-4% on DCA Top-n prediction compared with previous state-of-the-art methods on four datasets. Our code has been released in https://github.com/CMACH508/GLPocket.
BibTeX
@inproceedings{li2023glpocket,
  author = {Peiying Li and Yongchang Liu and Shikui Tu and Lei Xu},
  title = {{GLPocket: A Multi-Scale Representation Learning Approach for Protein Binding Site Prediction}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2023},
  doi = {10.24963/ijcai.2023/536},
}
Figure