Nanopore- and AI-empowered microbial viability inference

Harika Ürel, Sabrina Benassou, Hanna Marti, Tim Reska, Ela Sauerborn, Yuri Pinheiro Alves de Souza, Albert Perlas, Enrique Rayo, Michael Biggel, Stefan Kesselheim, Nicole Borel, Edward J. Martin, Constanza B. Venegas, Michael Schloter, Katrin Schröder, Jana Mittelstrass, Simone Prospero, James M. Ferguson, Lara UrbanbioRxiv 2024 · DOI

TL;DR

This paper introduces a novel, fully computational framework that uses deep learning on raw nanopore sequencing signal data ("squiggles") to accurately predict microbial viability. This approach bypasses the limitations of traditional methods and opens up new possibilities for understanding microbial communities in various settings.

What Problem Does This Paper Address?

Determining whether microorganisms in a sample are alive or dead is crucial for many biological inferences, from understanding ecosystem functions to identifying dangerous pathogens. Current methods for assessing microbial viability are often labor-intensive, expensive, and lack sensitivity. Genomic approaches, like metagenomics, can detect DNA from both living and dead cells, making it impossible to distinguish between them. This ambiguity can lead to misleading conclusions about microbial activity and impact. The authors aim to overcome these limitations by developing a computational method that can infer viability directly from the raw signal data generated by nanopore sequencing.

Methods

The core of this work is a deep learning framework, specifically a Residual Neural Network (ResNet1), trained on raw nanopore signal data (squiggles). Instead of relying on the basecalled DNA sequence, the model learns patterns directly from the electrical signals generated as DNA passes through the nanopore. This approach allows the model to capture subtle physical changes in DNA that may occur due to damage or degradation, which are indicative of cell death. The authors also employed Explainable AI (XAI) techniques, specifically Class Activation Maps (CAMs), to understand which parts of the nanopore signal the model uses for its predictions. This helps to identify the underlying features associated with viability.

Datasets

The primary dataset used for training and initial validation was generated from Escherichia coli cultures that were either viable or killed using UV irradiation. This controlled experiment provided a benchmark for developing and testing the viability prediction model. For real-world application and testing generalizability, data from Chlamydia suis (an obligate intracellular bacterium) and a mock microbial community exposed to antibiotics were also used.

Key Insights and Ideas

  • Squiggles hold viability information: The most significant insight is that raw nanopore signal data, not just the basecalled sequence, contains rich information about microbial viability. This suggests that DNA damage or structural changes associated with cell death leave detectable footprints in the electrical signal.
  • Deep learning can decode these signals: Deep neural networks, particularly ResNets, are capable of learning complex patterns within these squiggle signals to accurately distinguish between viable and dead cells.
  • Taxonomy-agnostic potential: The model trained on E. coli showed surprising generalizability, accurately predicting the viability of Chlamydia suis, a phylogenetically distant bacterium. This suggests that the learned features might be related to general DNA damage rather than specific species characteristics.
  • Killing method matters: The study highlights that the specific method used to kill the cells (e.g., UV vs. antibiotic) influences the predictive patterns in the squiggle data, indicating that models may need to be tailored to specific degradation contexts.

Key Results

  • The ResNet1 model achieved high accuracy in predicting viability from E. coli squiggle data, with an accuracy of 0.83 and an F1 score of 0.81 on the test dataset at the chunk level.
  • When applied at the read level, the model's performance improved significantly, reaching an accuracy of 0.96 and an AUROC of 0.99.
  • The E. coli-trained model demonstrated strong performance on Chlamydia suis, achieving accuracies of 0.93 and 0.93 for the two biological replicates.
  • Explainable AI (CAM) analysis revealed that "sudden drops" in the nanopore signal were a key indicator of dead cells, potentially related to DNA backbone damage.
  • A model trained on UV-killed E. coli struggled to predict viability in an antibiotic-exposed mock community, necessitating the training of a new, killing-method-specific model, which achieved an accuracy of 0.73.

Limitations and Future Work

  • Generalizability: While the model showed cross-taxonomic potential, its generalizability across a wider range of microbial taxa (e.g., spore-forming bacteria, fungi) and diverse degradation sources and intensities needs further assessment.
  • Antibiotic Viability: The study highlights the need for specific models for different killing methods, as the UV-trained model did not perform well on antibiotic-exposed bacteria. Future work could focus on developing models that can distinguish between different types of degradation.
  • Understanding Mechanisms: While XAI pointed to DNA backbone damage as a potential mechanism, further research is needed to fully understand the biological, chemical, and physical underpinnings of the squiggle signal patterns predictive of viability.
  • Metagenomic Integration: The authors envision integrating this viability inference into future nanopore-based metagenomic studies, allowing for free viability assessments without additional costs. This could lead to more accurate interpretations of microbial communities in diverse ecological settings.

Summary updated

Abstract

Abstract The ability to differentiate between viable and dead microorganisms in metagenomic data is crucial for various microbial inferences, ranging from assessing ecosystem functions of environmental microbiomes to inferring the virulence of potential pathogens from metagenomic analysis. While established viability-resolved genomic approaches are labor-intensive as well as biased and lacking in sensitivity, we here introduce a new fully computational framework that leverages nanopore sequencing technology to assess microbial viability directly from freely available nanopore signal data. Our approach utilizes deep neural networks to learn features from such raw nanopore signal data that can distinguish DNA from viable and dead microorganisms in a controlled experimental setting of UV-induced Escherichia cell death. The application of explainable AI tools then allows us to pinpoint the signal patterns in the nanopore raw data that allow the model to make viability predictions at high accuracy. Using the model predictions as well as explainable AI, we show that our framework can be leveraged in a real-world application to estimate the viability of obligate intracellular Chlamydia , where traditional culture-based methods suffer from inherently high false negative rates. This application shows that our viability model captures predictive patterns in the nanopore signal that can be utilized to predict viability across taxonomic boundaries. We finally show the limits of our model’s generalizability through antibiotic exposure of a simple mock microbial community, where a new model specific to the killing method had to be trained to obtain accurate viability predictions. While the potential of our computational framework’s generalizability and applicability to metagenomic studies needs to be assessed in more detail, we here demonstrate for the first time the analysis of freely available nanopore signal data to infer the viability of microorganisms, with many potential applications in environmental, veterinary, and clinical settings. Author summary Metagenomics investigates the entirety of DNA isolated from an environment or a sample to holistically understand microbial diversity in terms of known and newly discovered microorganisms and their ecosystem functions. Unlike traditional culturing of microorganisms, genomic approaches are not able to differentiate between viable and dead microorganisms since DNA might persist under different environmental circumstances. The viability of microorganisms is, however, of importance when making inferences about a microorganism’s metabolic potential, a pathogen’s virulence, or an entire microbiome’s impact on its environment. As existing viability-resolved genomic approaches are labor-intensive, expensive, and lack sensitivity, we here investigate our hypothesis if freely available nanopore sequencing signal dat that captures DNA molecule information beyond the DNA sequence might be leveraged to infer such viability. This hypothesis assumes that DNA from dead microorganisms accumulates certain damage signatures that reflect microbial viability and can be read from nanopore signal data using fully computational frameworks. We here show first evidence that such a computational framework might be feasible by training a deep model on controlled experimental data to predict viability at high accuracy, exploring what the model has learned, and using it in a real-world application by application to a bacterial species of veterinary relevance. We finally show that a specific model has to be trained to accurately predict viability after antibiotic exposure of a mock microbial community. While the generalizability of our computational framework therefore needs to be assessed in much more detail, we here demonstrate that freely available data might be usable for relevant viability inferences in environmental, veterinary, and clinical settings.
BibTeX
@misc{urel2024nanopore,
  author = {Harika Ürel and Sabrina Benassou and Hanna Marti and Tim Reska and Ela Sauerborn and Yuri Pinheiro Alves de Souza and Albert Perlas and Enrique Rayo and Michael Biggel and Stefan Kesselheim and Nicole Borel and Edward J. Martin and Constanza B. Venegas and Michael Schloter and Katrin Schröder and Jana Mittelstrass and Simone Prospero and James M. Ferguson and Lara Urban},
  title = {{Nanopore- and AI-empowered microbial viability inference}},
  year = {2024},
  doi = {10.1101/2024.06.10.598221},
  howpublished = {bioRxiv},
}
Figure