Sequence-based modelling of bacterial genomes enables accurate antibiotic resistance prediction

Maciej Wiatrak, Aaron Weimann, Adam M. Dinan, Maria Brbić, R. Andrés FlotobioRxiv 2024 · DOI

TL;DR

This paper introduces GeneBac, a novel deep learning framework that predicts antibiotic resistance in bacteria by analyzing their full genomic sequences and the interactions between genes. GeneBac achieves state-of-the-art performance, accurately predicting minimum inhibitory concentrations (MICs) and even generalizing to novel genetic variants not seen during training, a critical step towards combating the growing threat of antimicrobial resistance.

What Problem Does This Paper Address?

Antimicrobial resistance (AMR) is a major global health crisis, leading to millions of deaths annually. Rapid and accurate diagnosis of resistance is crucial for effective treatment, but current methods struggle with several key challenges:

  • Epistatic effects: Existing models often fail to capture how combinations of genetic variants interact to influence resistance, leading to incomplete understanding.
  • Generalization to novel variants: Bacteria rapidly mutate, and new resistance mechanisms emerge. Methods that cannot predict the impact of these novel variants are quickly outdated.
  • Ignoring genetic context: Many approaches treat variants in isolation, neglecting how their location within a gene or their interaction with other genes might affect resistance.
  • Binary classification limitations: Most methods classify resistance as binary (resistant/susceptible), which is an oversimplification given the continuous nature of MIC values and can lead to misdiagnosis.

Methods

GeneBac is a deep learning framework built on two core components:

  1. Convolutional Neural Network (CNN): This module processes the DNA sequence of individual genes, extracting low-dimensional representations that capture sequence variations. Crucially, it integrates variants directly into the DNA sequence input, allowing it to learn from the genetic context.
  2. Graph Neural Network (GNN): This module takes the gene representations from the CNN and models the interactions between genes within a bacterial strain. It uses prior knowledge of protein-protein interactions (from the STRING database) to construct a graph, allowing it to account for epistatic effects and gene-gene dependencies.

GeneBac's modular design allows it to be applied to various tasks, including gene expression prediction, variant effect prediction, and strain clustering. The authors also leverage transfer learning, using weights trained on gene expression data to improve performance on antibiotic resistance prediction.

Datasets

The study utilized the following datasets:

  • Mycobacterium tuberculosis (MTB) CRyPTIC dataset: This dataset contains MIC readings for 13 different drugs across approximately 12,460 strains.
  • Pseudomonas aeruginosa (PA) dataset: This dataset includes MIC data for 14 antibiotics across approximately 1,109 strains.
  • WHO Mycobacterium tuberculosis mutation catalogue: Used for evaluating the model's ability to predict the effect of known and novel variants.
  • PA RNA-seq dataset: Used for training the gene expression prediction module, consisting of paired DNA and RNA counts from 386 strains.

Key Insights and Ideas

  • Genomic context matters: By directly integrating variants into DNA sequences and modeling gene interactions, GeneBac captures crucial contextual information that improves resistance prediction.
  • Generalizing to the unknown: GeneBac's ability to predict the impact of novel variants is a significant breakthrough, crucial for staying ahead of evolving AMR.
  • Beyond binary classification: Predicting continuous MIC values offers a more nuanced and clinically relevant approach to resistance assessment.
  • Transfer learning across modalities: Leveraging gene expression data to pre-train the model significantly boosts performance on antibiotic resistance prediction, demonstrating the power of multi-task learning.
  • Interpretable insights: The GNN component, combined with tools like GNN Explainer, allows for insights into which genes and interactions are most influential for resistance prediction.

Key Results

  • High prediction accuracy: GeneBac achieved high performance on both MTB and PA datasets, with Pearson correlation scores over 0.87 for MTB and 0.76 for PA on held-out strains.
  • Superior performance: GeneBac substantially outperformed existing methods (Lasso, ElasticNet, MD-CNN) in predicting antibiotic resistance MICs.
  • Accurate variant effect prediction: GeneBac accurately predicted the effects of both known and novel variants from the WHO MTB catalogue, even those not seen during training.
  • Robustness to population structure: GeneBac demonstrated robustness to clonal population structures and could generalize to unseen lineages.
  • Effective gene expression prediction: The model achieved nearly 0.9 Pearson correlation for predicting RNA abundance from DNA sequences.
  • Transfer learning benefits: Transfer learning from gene expression to resistance prediction improved performance by almost 4% on average across drugs.

Limitations and Future Work

  • Dataset size: Performance improvements were observed with larger training datasets, suggesting that further gains are possible with more data.
  • Pre-selection of genes: While an improvement over pre-selecting variants, the need to pre-select genes for input is still a limitation. Future work aims to expand the model to cover larger portions of the genome.
  • Cross-species generalization: While GeneBac was applied to two species, further validation on a wider range of bacterial species, especially those with less stable genomes, is warranted.
  • Integrating protein sequence data: Combining protein sequence information with DNA sequence data could further enhance model interpretability and performance.
  • Clinical deployment: The authors envision GeneBac being systematically employed for clinical diagnosis and for uncovering causal variants and genes influencing AMR. They have made the model openly available to facilitate this.

Summary updated

Abstract

Abstract Rapid detection of antibiotic-resistant bacteria and understanding the mecha- nisms underlying antimicrobial resistance (AMR) are major unsolved problems that pose significant threats to global public health. However, existing methods for predicting antibiotic resistance from genomic sequence data have had lim- ited success due to their inability to model epistatic effects and generalize to novel variants. Here, we present GeneBac, a deep learning method for predicting antibiotic resistance from DNA sequence through the integration of interactions between genes. We apply GeneBac to two distinct bacterial species and show that it can successfully predict the minimum inhibitory concentration (MIC) of multiple antibiotics. We use the WHO Mycobacterium tuberculosis mutation cat- alogue to demonstrate that GeneBac accurately predicts the effects of different variants, including novel variants that have not been observed during training. GeneBac is a modular framework which can be applied to a number of tasks including gene expression prediction, resistant gene identification and strain clus- tering. We leverage this modularity to transfer learn from the transcriptomic data to improve performance on the MIC prediction task.
BibTeX
@misc{wiatrak2024sequence,
  author = {Maciej Wiatrak and Aaron Weimann and Adam M. Dinan and Maria Brbić and R. Andrés Floto},
  title = {{Sequence-based modelling of bacterial genomes enables accurate antibiotic resistance prediction}},
  year = {2024},
  doi = {10.1101/2024.01.03.574022},
  howpublished = {bioRxiv},
}

Loading related content...

Figure