Challenges in antibody structure prediction

Monica L. Fernández‐Quintero, Janik Kokot, Franz Waibl, Anna-Lena M. Fischer, Patrick K. Quoika, Charlotte M. Deane, Klaus R. Liedl

TL;DR

While AI tools like AlphaFold2 have revolutionized protein structure prediction, this paper warns that antibody models often contain "physically impossible" errors—like non-natural D-amino acids and atomic clashes—that global accuracy metrics miss. The authors introduce TopModel, a validation tool to catch these chemical glitches before they ruin downstream drug discovery and simulations.

What Problem Does This Paper Address?

In the wake of AlphaFold2, the scientific community has pivoted toward using AI-generated models for everything from vaccine design to therapeutic antibody engineering. On the surface, these models look incredible, often boasting Root Mean Square Deviations (RMSD) of less than 1 Å from experimental structures.

However, the authors argue that "close enough" isn't good enough for biochemistry. Antibodies recognize targets via six hypervariable loops called the Complementarity Determining Regions (CDRs). Even a tiny error in the geometry of these loops—specifically the notorious CDR-H3—can lead to "irreparable" mistakes in predicting how an antibody binds to a virus or how "sticky" (hydrophobic) its surface is. If the starting model is chemically flawed, the millions of dollars spent on subsequent simulations and lab experiments may be wasted.

Methods

The researchers didn't build a new prediction tool; instead, they built a validator. They evaluated four popular antibody structure prediction pipelines:

  • ABlooper
  • IgFold
  • DeepAb
  • MOE Antibody Modeller

To audit these tools, they developed TopModel, a Python-based package that performs a "chemical sanity check" on PDB files. It specifically looks for:

  1. Chirality Errors: Identifying D-amino acids (mirror-image versions of amino acids that are virtually non-existent in natural proteins).
  2. Amide Bond Stereochemistry: Checking for incorrect cis-amide bonds (which should mostly only occur with Proline).
  3. Van der Waals Clashes: Finding atoms that are physically overlapping.
  4. Non-planar Bonds: Identifying distorted peptide backbones.

Datasets

The study utilized two primary datasets for evaluation:

  • The Jain et al. Dataset: A collection of 137 clinical-stage antibody sequences used to benchmark the frequency of structural errors across different tools.
  • CIS43 Antibody (PDB 7SG5): An experimental X-ray structure released after the prediction tools were published. This served as a "blind test" to compare AI predictions against a ground-truth reference that wasn't in their training data.

Key Insights and Ideas

  • The RMSD Trap: A model can have a very low global RMSD (appearing accurate) while containing localized chemical "horrors" like D-amino acids. Global metrics hide local failures.
  • The CDR-H3 Bottleneck: The CDR-H3 loop remains the "Grand Challenge." Because it is so flexible and diverse, a single static structure is often insufficient to represent its behavior in solution.
  • MD Can't Save You: Many researchers hope that Molecular Dynamics (MD) simulations will "fix" a bad starting structure. The authors point out that standard MD cannot sample the transitions needed to flip a D-amino acid back to an L-amino acid or correct a cis-trans isomerisation. If the start is bad, the simulation stays bad.
  • DeepAb's Edge: Interestingly, DeepAb was the only tool tested that did not introduce any D-amino acids, suggesting its architecture or training constraints are more physically grounded than its peers.

Key Results

  • Widespread Errors: Across the 137 antibody models, the researchers found up to 300 D-amino acids and 240 incorrect cis-amide bonds.
  • Hydrophobicity Distortion: The paper demonstrates that these structural inaccuracies significantly alter surface hydrophobicity maps. Since hydrophobicity is a key predictor of whether a drug will aggregate or be "developable," these errors could lead to false positives in drug screening.
  • Visualizing the Mess: The authors integrated TopModel with PyMOL, allowing researchers to see these errors (colored in magenta, red, and yellow) directly on the 3D structure.
  • CDR-H3 Variability: While framework regions were nearly identical across tools, the CDR-H3 loops showed high variability (RMSD > 2 Å), highlighting the continued difficulty of predicting the "business end" of the antibody.

Limitations and Future Work

The authors acknowledge that while TopModel identifies errors, it doesn't automatically fix them. The primary limitation in the field remains the static nature of predictions. Since CDR loops exist as an "ensemble" of shapes in the body, a single PDB file is a snapshot that might not capture the functional state.

Future work in the field will likely need to move toward ensemble structure prediction—generating a range of possible shapes rather than just one—and integrating TopModel-like validation directly into the loss functions of AI training to prevent these "non-natural" structures from being generated in the first place.

Summary updated

Abstract

Advances in structural biology and the exponential increase in the amount of high-quality experimental structural data available in the Protein Data Bank has motivated numerous studies to tackle the grand challenge of predicting protein structures. In 2020 AlphaFold2 revolutionized the field using a combination of artificial intelligence and the evolutionary information contained in multiple sequence alignments. Antibodies are one of the most important classes of biotherapeutic proteins. Accurate structure models are a prerequisite to advance biophysical property predictions and consequently antibody design. Specialized tools used to predict antibody structures based on different principles have profited from current advances in protein structure prediction based on artificial intelligence. Here, we emphasize the importance of reliable protein structure models and highlight the enormous advances in the field, but we also aim to increase awareness that protein structure models, and in particular antibody models, may suffer from structural inaccuracies, namely incorrect cis-amide bonds, wrong stereochemistry or clashes. We show that these inaccuracies affect biophysical property predictions such as surface hydrophobicity. Thus, we stress the importance of carefully reviewing protein structure models before investing further computing power and setting up experiments. To facilitate the assessment of model quality, we provide a tool "TopModel" to validate structure models.
BibTeX
@inproceedings{fernandezquintero2023challenges,
  author = {Monica L. Fernández‐Quintero and Janik Kokot and Franz Waibl and Anna-Lena M. Fischer and Patrick K. Quoika and Charlotte M. Deane and Klaus R. Liedl},
  title = {{Challenges in antibody structure prediction}},
  booktitle = {mAbs},
  year = {2023},
  doi = {10.1080/19420862.2023.2175319},
}
Figure