Learning the shape of protein micro-environments with a holographic convolutional neural network

Michael N. Pun, Andrew Ivanov, Quinn Bellamy, Zachary Montague, Colin H. LaMont, Philip Bradley, Jakub Otwinowski, Armita NourmohammadarXiv 2022 · OpenReview

TL;DR

This paper introduces a novel "Holographic Convolutional Neural Network" (H-CNN) that learns protein structure-function relationships by encoding local atomic environments as "holograms." This physically motivated approach accurately predicts mutation effects on protein stability and binding, offering a more interpretable and efficient alternative to existing methods.

What Problem Does This Paper Address?

Proteins are the workhorses of biology, and while we've made great strides in predicting their 3D structures from their amino acid sequences (thanks to tools like AlphaFold), understanding how a protein's structure dictates its function remains a significant challenge. Specifically, predicting the impact of mutations on protein stability and function is crucial for understanding diseases and designing new proteins. Existing machine learning approaches often struggle with the inherent rotational symmetry of protein structures, leading to models that are either computationally expensive or fail to capture the full picture of local atomic interactions.

Methods

The core innovation here is the Holographic Convolutional Neural Network (H-CNN). Instead of directly feeding raw 3D coordinates into a neural network, H-CNN first encodes the local "micro-environment" around each amino acid. This encoding uses 3D Zernike polynomials, which are mathematically well-suited to represent spherical data and are inherently rotationally equivariant. This means that if you rotate the protein structure, the encoded representation changes in a predictable, well-defined way, rather than arbitrarily. These equivariant representations are then fed into a 3D rotationally equivariant convolutional neural network (specifically, a Clebsch-Gordan network). This architecture ensures that the model respects the physical symmetries of protein structures, leading to more efficient learning and interpretable results.

Datasets

The authors trained and evaluated their H-CNN model on data from the Protein Data Bank (PDB). For specific tasks, they utilized:

  • ProteinNet's splits for training, validation, and testing of protein neighborhood classification.
  • T4 lysozyme variants with experimentally determined stability effects (ΔΔG values) and available PDB structures.
  • SARS-CoV-2 Receptor-Binding Domain (RBD) mutation data from deep mutational scanning (DMS) experiments, measuring effects on RBD folding (expression) and binding to ACE2.

Key Insights and Ideas

  • Holographic Encoding for Symmetry: Representing local protein environments as "holograms" using Zernike polynomials is a clever way to capture geometric information while inherently respecting rotational symmetry. This bypasses the need for computationally expensive alignment steps.
  • Physically Motivated Equivariance: Building neural networks that are rotationally equivariant (not just invariant) is key to learning physically meaningful representations of protein structures. This allows the model to learn how local atomic arrangements influence amino acid preferences.
  • Interpretable Predictions: The H-CNN's predictions about amino acid interchangeability align well with evolutionary data (e.g., BLOSUM62 scores) and physico-chemical properties, suggesting the model has learned fundamental biophysical principles.
  • Structure-Function Link: The model demonstrates a strong ability to predict functional outcomes (stability, binding) directly from structural information, even for mutations where experimental structures are not available (by using relaxed or predicted structures).

Key Results

  • Amino Acid Prediction Accuracy: H-CNN achieves 68% accuracy in predicting the identity of an amino acid from its surrounding micro-environment, comparable to state-of-the-art methods but with significantly fewer parameters and faster training.
  • Mutation Effect Prediction:
    • For T4 lysozyme stability, H-CNN predictions correlate with experimentally measured ΔΔG values with a Pearson correlation of 0.67.
  • For SARS-CoV-2 RBD binding and expression, H-CNN predictions show correlations of r=0.52 with experimental DMS data.
  • Efficiency: The rotationally equivariant nature of H-CNN leads to substantially faster training times compared to conventional 3D CNNs.

Limitations and Future Work

  • Data Availability: The performance of H-CNN, like any structure-based model, is dependent on the availability of high-resolution protein structures. While they explored using predicted structures (AlphaFold), this can introduce noise.
  • Generalizability: While H-CNN shows promise for predicting protein function, further systematic comparisons with other advanced models (like large language models) are needed.
  • De Novo Design: The authors suggest that H-CNN's ability to learn effective potentials could be leveraged for solving the inverse folding problem and designing novel proteins.
  • Broader Applications: The all-atom representation and learned features could be extended to analyze non-amino acid molecules or protein-DNA/drug interactions.
  • Interactions: The learned representations could serve as building blocks for understanding larger-scale protein-protein interactions.

Summary updated

Abstract

Proteins play a central role in biology from immune recognition to brain activity. While major advances in machine learning have improved our ability to predict protein structure from sequence, determining protein function from structure remains a major challenge. Here, we introduce Holographic Convolutional Neural Network (H-CNN) for proteins, which is a physically motivated machine learning approach to model amino acid preferences in protein structures. H-CNN reflects physical interactions in a protein structure and recapitulates the functional information stored in evolutionary data. H-CNN accurately predicts the impact of mutations on protein function, including stability and binding of protein complexes. Our interpretable computational model for protein structure-function maps could guide design of novel proteins with desired function.
BibTeX
@misc{pun2022learning,
  author = {Michael N. Pun and Andrew Ivanov and Quinn Bellamy and Zachary Montague and Colin H. LaMont and Philip Bradley and Jakub Otwinowski and Armita Nourmohammad},
  title = {{Learning the shape of protein micro-environments with a holographic convolutional neural network}},
  year = {2022},
  eprint = {2211.02936},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2211.02936},
}
Figure