IBEX: Information-Bottleneck-EXplored Coarse-to-Fine Molecular Generation under Limited Data

Dong Xu, Zhangfan Yang, Shuangbao Song, Zexuan Zhu, Jianqiang Li, Junkai JiSubmission to ICLR 2026 · Withdrawn

TL;DR

Training 3D molecular generative models is severely constrained by the small number of known protein–ligand structures. IBEX solves this by leveraging an information-theoretic insight: training diffusion models exclusively on scaffold hopping maximizes information density and tightens generalization bounds. By pairing this scaffold-trained diffusion model with a decoupled, rigid-body physical refinement step, IBEX performs zero-shot de novo ligand generation that significantly outperforms traditional end-to-end models in binding affinity and drug-likeness.

What Problem Does This Paper Address?

Structure-based drug design (SBDD) relies on 3D generative models to design drug-like molecules that fit into target protein pockets. However, drug discovery suffers from a severe data bottleneck: there are fewer than $2 \times 10^5$ publicly available experimental protein–ligand structures—orders of magnitude fewer than the millions of samples used in computer vision or NLP.

Because data is so scarce, typical 3D diffusion models trained on de novo design (masking an entire molecule and regenerating it from scratch) often overfit, memorizing training-set residue biases instead of genuine physical binding principles. Furthermore, end-to-end architectures that mix generative denoising with binding-pose optimization suffer from gradient conflict and vanishing gradients, resulting in molecules that look artificially well-placed but collapse upon rigorous molecular docking.

Methods

IBEX tackles these problems via an asymmetric train-inference strategy and a decoupled architecture:

  • Information-Theoretic Task Evaluation: The authors analyze three generation paradigms using the Bemis–Murcko scaffold decomposition:
  • De Novo (DN): Generating the entire molecule from scratch.
  • Side-Chain Decoration (SC): Fixing the core scaffold and generating arms.
  • Scaffold Hopping (SH): Fixing peripheral side chains and generating an internal core scaffold. Using a PAC-Bayes Information Bottleneck (PIB) formulation, they map complexes to a 4D summary vector $Z = (\bar{n}, \bar{d}, \bar{t}, \bar{k})$ reflecting neighbor density, virtual-edge distance, interaction types, and contact counts, computing the information density $\rho = I(Z; X)/4$.

  • Asymmetric Training & Zero-Shot Transfer: Based on finding that Scaffold Hopping has the highest information density, the generative diffusion model (an $\mathrm{SE}(3)$-equivariant diffusion network built upon the TargetDiff backbone) is trained exclusively on the SH task. During inference, it is deployed directly to unconditional de novo generation without any task-specific fine-tuning.

  • Decoupled Physics-Guided Position Refinement (PR): Rather than attempting end-to-end physical optimization, IBEX freezes internal ligand geometry and uses an L-BFGS optimizer over 6 rigid-body degrees of freedom (3 translations, 3 rotations). It optimizes a surrogate empirical energy function comprising five physical terms (two van der Waals Gaussians, hard-sphere repulsion, hydrophobic interactions, and directional hydrogen bonding) approximated via forward finite differences. Updates are accepted only if the refined energy improves upon the initial generative placement.

Datasets

  • CBGBench (CrossDocked2020-based): Follows the standard LiGAN and 3DSBDD data splits, rigorously preventing label leakage by partitioning complexes before fragmenting into scaffold and side-chain components.
  • PPAR$\gamma$ (PDB: 9F7W): An unseen test pocket used to evaluate out-of-distribution generalization and diversity across 2,000 sampled structures.

Key Insights and Ideas

  • Location Beats Quantity: Although Scaffold Hopping denoises fewer total atoms than full de novo generation, keeping the peripheral side-chain context intact anchors the molecule against the protein wall. This maximizes mutual information $I(Z; X)$, yielding richer training gradients and tightening the PAC-Bayes generalization bound by 38% compared to DN and 47% compared to SC.
  • Task Difficulty Drives Robust Generalization: Counter to classic bias-variance intuition, the more structurally constrained task (SH) enters its representation compression phase earlier (at $\sim 2 \times 10^5$ steps, where gradient-SNR variance drops to $1.6 \times 10^{-5}$). This tightens the train-test generalization gap across 18 chemistry metrics to just 0.03 (versus 0.25 for de novo training).
  • Decoupling Prevents "Metric Hacking": Generative diffusion often places atoms close to key residues to optimize initial score, yet fails post-simulation docking. By separating geometric molecule generation from rigid-body physical refinement, IBEX avoids gradient dilution and optimization conflicts.

Key Results

  • Docking Performance: On the 100 held-out test pockets of CBGBench, IBEX increased the molecular docking success rate (IMP) from 53% (TargetDiff baseline) to 63.69%, while improving the docked Vina energy from -7.41 kcal/mol to -8.09 kcal/mol.
  • Pocket Superiority: IBEX achieved the superior median docked Vina energy in 57 out of 100 test binding pockets against competitive baselines (D3FG, DecompDiff, MolCRAFT, TargetDiff).
  • Drug-Likeness & Diversity: Drug-likeness (QED) improved by over 20% (reaching 0.60, compared to 0.49 for TargetDiff and DecompDiff) while maintaining a high validity rate of 96% and uniqueness of 95.07%. On the out-of-distribution 9F7W target, IBEX preserved 1,706 unique valid molecules out of 2,000, dwarfing Pocket2Mol's 217.

Limitations and Future Work

  • Rigid-Body Assumption in Refinement: The post-generation refinement only searches over 6 degrees of freedom (rigid rotations and translations). It does not optimize internal rotatable bonds/torsions or accommodate induced-fit receptor side-chain flexibility.
  • Finite-Difference Overhead: Approximating gradients via forward finite differences for the physical energy evaluator introduces extra function evaluations; integrating fully analytical, differentiable force fields could improve efficiency.
  • Synthetic Feasibility: While synthetic accessibility (SA) and Lipinski compliance are competitive, wet-lab experimental validation of the generated scaffolds is not explored in the paper.

Summary updated

Abstract

The potential of three-dimensional molecular generation for structure-based drug discovery is hampered by the scarcity of public protein-ligand complexes, which causes models to overfit and fail to learn generalizable geometric priors. To address this challenge, we employ the PAC-Bayes information bottleneck framework to systematically quantify the information density of three generation paradigms: Scaffold Hopping (SH), Side-Chain Decoration (SC), and De Novo Design (DN). Our analysis reveals that SH possesses the highest information density, which tightens the model's generalization bound and enhances its transferability compared to conventional de novo generation. Motivated by this finding, we propose IBEX, a novel decoupled generation framework. IBEX is trained exclusively on the information-rich SH task to structure its latent representation of chemical space, which is then directly applied to de novo generation in a zero-shot transfer setting. Subsequently, a rapid physical refinement module utilizes the L-BFGS algorithm to optimize each conformer's geometry and binding compatibility by adjusting five short-range interaction terms and six degrees of freedom. Evaluated in a rigorous zero-shot setting on the CBGBench CrossDocked2020-based dataset, IBEX demonstrates substantial improvements over the TargetDiff baseline. It increases the docking success rate from 53% to 64% and improves the average Dock score from -7.41 to -8.09 kcal/mol. Notably, IBEX achieves a superior median Vina energy in 57 out of 100 binding pockets. Furthermore, IBEX enhances drug-likeness by approximately 25% while maintaining state-of-the-art validity and diversity, all corresponding to a demonstrably reduced generalization error. Our results validate that this decoupled approach, which synergizes information-dense pre-training with physical refinement, enables robust zero-shot structure generation and cross-pocket generalization in data-limited regimes.
BibTeX
@misc{xu2025ibex,
  author = {Dong Xu and Zhangfan Yang and Shuangbao Song and Zexuan Zhu and Jianqiang Li and Junkai Ji},
  title = {{IBEX: Information-Bottleneck-EXplored Coarse-to-Fine Molecular Generation under Limited Data}},
  year = {2025},
  eprint = {2508.10775},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2508.10775},
}
Figure