Lipophilicity Prediction with Multitask Learning and Molecular Substructures Representation

Nina Lukashina, Alisa Alenicheva, Elizaveta Vlasova, Artem Kondiukov, Aigul Khakimova, Emil Magerramov, Nikita Churikov, Aleksei ShpilmanarXiv 2020 · arXiv

Introduction

In the field of drug discovery, lipophilicity is a critical physicochemical property that determines a molecule's ability to dissolve in fats and lipids. This property is a primary driver of a drug's pharmacokinetics, influencing how effectively it can permeate cell membranes to reach its biological target. Lipophilicity is typically quantified using two descriptors: logP (the partition coefficient for neutral molecules) and logD (the distribution coefficient for ionizable compounds at a specific pH).

Despite the advancements in deep learning for molecular property prediction, standard Graph Neural Networks (GNNs) often fall short. Their primary limitation lies in their focus on local, atom-to-atom interactions. This "bottom-up" approach frequently misses the broader structural context—the "big picture"—of how complex functional groups like rings, esters, or sulfonamides collectively influence the molecule's overall lipophilicity. Furthermore, logP and logD are often treated as independent prediction tasks, ignoring the inherent chemical correlation between them.

Methods: The StructGNN Architecture

To address these challenges, the authors introduced StructGNN, a novel dual-encoder graph-based neural network. The architecture is designed to capture both local atomic details and higher-level structural information.

The StructGNN architecture combines a standard D-MPNN with a specialized substructure encoder to generate a comprehensive molecular vector embedding for multitask prediction.

The model consists of three primary components:

  1. D-MPNN Encoder: A standard Direct Message Passing Neural Network branch that captures edge-focused information and local connectivity between individual atoms.
  2. Substructure Encoder: This novel branch identifies predefined functional groups (e.g., rings, acids, amines) and represents them as "hyper-atoms." Instead of processing individual atoms, it calculates aggregate features for these groups, such as total mass, aromaticity, and formal charge. These hyper-atoms are processed through a feed-forward network (FFNN) and averaged into a global substructure embedding ($h_s$).
  3. Multitask Learning Head: Recognizing that logP and logD are chemically related (with a Pearson correlation coefficient of 0.66), StructGNN is trained to predict both values simultaneously. This multitask approach allows the model to leverage the larger logP datasets to improve performance on the typically smaller logD datasets.

The final molecular representation is formed by concatenating the standard graph embedding ($h_d$) and the substructure embedding ($h_s$), which is then passed to a regression head for final prediction.

Datasets

The researchers compiled a comprehensive experimental dataset for training and evaluation:

  • logP Dataset: Approximately 17,318 samples aggregated from sources including PhysProp, the NCI Open Database, OChem, and DiverseDataset.
  • logD Dataset: Approximately 4,200 samples sourced from the ChEMBL lipophilicity dataset.
  • Multitask Set: A standardized set of 17,603 unique molecules, including a subset of 251 molecules for which both logP and logD values were available.

Key Results and Insights

StructGNN, particularly when combined with multitask learning, established new state-of-the-art (SOTA) performance on standard benchmarks, significantly outperforming previous models like OT-GNN and JtVAE.

Performance comparison of StructGNN against baseline models across logP and logD benchmarks, showing significant improvements in RMSE and R² metrics.

As shown in the results, StructGNN + Multitask achieved an RMSE of 0.425 for logP (down from OT-GNN's 0.508) and 0.537 for logD (down from 0.735). The model also demonstrated high explained variance, with $R^2$ values reaching 0.948 and 0.817 for logP and logD, respectively.

The "Symmetry Gap"

A notable discovery in this study was the performance disparity between symmetric and asymmetric molecules. The authors found that all tested models, including StructGNN, performed significantly worse on symmetric molecules. This suggests that current graph representations may struggle to capture the unique electronic or spatial environments inherent in molecular symmetry, identifying a clear area for future improvement in molecular modeling.

Conclusion

By explicitly encoding molecular substructures as hyper-atoms and utilizing multitask learning, StructGNN provides a more "chemically intuitive" representation of molecules. While the model achieves superior results, the persistent "symmetry gap" highlights a fundamental challenge in graph-based molecular representation. Future work may focus on unsupervised substructure identification and developing specialized layers to better handle molecular symmetry.

Summary updated

Abstract

Lipophilicity is one of the factors determining the permeability of the cell membrane to a drug molecule. Hence, accurate lipophilicity prediction is an essential step in the development of new drugs. In this paper, we introduce a novel approach to encoding additional graph information by extracting molecular substructures. By adding a set of generalized atomic features of these substructures to an established Direct Message Passing Neural Network (D-MPNN) we were able to achieve a new state-of-the-art result at the task of prediction of two main lipophilicity coefficients, namely logP and logD descriptors. We further improve our approach by employing a multitask approach to predict logP and logD values simultaneously. Additionally, we present a study of the model performance on symmetric and asymmetric molecules, that may yield insight for further research.
BibTeX
@misc{lukashina2020lipophilicity,
  author = {Nina Lukashina and Alisa Alenicheva and Elizaveta Vlasova and Artem Kondiukov and Aigul Khakimova and Emil Magerramov and Nikita Churikov and Aleksei Shpilman},
  title = {{Lipophilicity Prediction with Multitask Learning and Molecular Substructures Representation}},
  year = {2020},
  eprint = {2011.12117},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2011.12117},
}
Figure