Convolutional neural networks quantify antibiotic resistance in Mycobacterium tuberculosis with diagnostic grade accuracy and predict treatment response

Sanjana G. Kulkarni, Anna G. Green, Brendon C. Mann, Samantha Malatesta, Steve Goodwin, Nina Cesare, Shandukani Mulaudzi, Noorjahn Rawoot, Robin M. Warren, Karen R. Jacobson, Maha FarhatmedRxiv 2025 · DOI

TL;DR

Researchers have developed a multimodal convolutional neural network (CNN) that moves beyond simple "resistant vs. susceptible" labels for Mycobacterium tuberculosis (Mtb). By integrating genomic sequences with protein biochemical properties, the model predicts precise antibiotic concentrations (MICs) with 89% accuracy, revealing that even subtle, "sub-threshold" increases in resistance are strong predictors of poor clinical outcomes.

What Problem Does This Paper Address?

In the fight against tuberculosis, clinicians typically rely on a binary "pass/fail" system for antibiotic resistance. A sample is labeled "resistant" only if the bacteria can grow above a specific "critical concentration" (CC). However, antibiotic resistance is a continuous spectrum, not a toggle switch.

This "convention of convenience" creates two major issues:

  1. Misclassification: Samples sitting just below the threshold might be labeled susceptible but still fail to respond to treatment.
  2. Loss of Information: Binary tests ignore the biological nuance of how specific mutations affect drug-binding pockets or protein stability.

The authors sought to build a machine learning framework capable of predicting the Minimum Inhibitory Concentration (MIC)—the exact amount of drug needed to stop the bacteria—directly from genetic data.

Methods

The team developed single-drug CNNs for eight different antibiotics. What sets this approach apart from standard genomic models is its multimodal input:

  • Genomic Sequences: One-hot encoded nucleotide sequences of relevant loci.
  • Protein Properties: To help the model understand the functional impact of mutations, they added "biophysical channels" including molecular weight, isoelectric point, and hydrophobicity for the encoded proteins.
  • Lineage Information: A 62-SNP barcode was included to account for the genetic background (ancestry) of the Mtb strain.

Technically, they implemented a custom "binned" loss function. Because experimental MIC data is often interval-censored (e.g., "the MIC is between 0.2 and 0.4"), the loss function only penalizes the model if its prediction falls outside the experimentally determined range. To interpret the "black box," they used DeepLIFT saliency mapping and in silico mutagenesis to see which mutations the model prioritized.

Datasets

The study utilized a massive dataset of 14,834 Mtb isolates with known MICs, aggregated from:

  • The CRyPTIC project.
  • The NCBI PATRIC database.
  • The WHO Resistance Mutation Catalogue.
  • A clinical validation cohort of 373 patients from the TRUST study in South Africa to evaluate real-world treatment response.

Key Insights and Ideas

  • Proteins Matter: Nucleotide-only models struggled to distinguish between "nonsense" mutations (which stop protein production) and "missense" mutations (which just change one "letter"). Adding biochemical properties allowed the CNN to "understand" when a mutation likely truncated a protein, drastically improving accuracy for drugs like Pyrazinamide.
  • Learning 3D Structure from 1D Data: Using saliency maps, the researchers found that the CNNs naturally focused on residues that form actual drug-binding pockets. The model essentially "discovered" the 3D active sites of proteins without ever being shown a 3D structure.
  • The "Borderline" Danger: Perhaps the most striking insight was clinical. In the patient cohort, those with "susceptible" infections but higher predicted MICs (even below the legal threshold) had significantly worse treatment outcomes. This suggests our current "susceptible" definitions may be too lenient.

Key Results

  • High Precision: The models achieved an Essential Agreement (EA) of 89%, meaning the predicted MIC was within one doubling dilution of the true value—a level of accuracy comparable to manual laboratory testing.
  • State-of-the-Art: Despite being trained on only ~50% of the data used for the official WHO catalog, the CNNs accurately predicted the effects of 97% of graded mutations.
  • Clinical Prediction: In the patient cohort, a predicted Rifampicin MIC > 0.06 µg/mL was associated with unfavorable outcomes (p=0.003), even though these patients were technically "rifampicin-susceptible" by standard diagnostic criteria.

Limitations and Future Work

The authors acknowledge that the model is still limited by data scarcity for newer drugs like Bedaquiline, where resistance is rare and the model's sensitivity remains lower. Additionally, the CNN can sometimes be "confused" by different mutation types occurring on the same codon if the training data is sparse.

Future work will likely involve integrating more dimensions of biological data—such as protein stability or drug-binding free energy—to help the model generalize to extremely rare or "unseen" mutations. The researchers also suggest that these CNNs could be deployed in clinical trials to prospectively guide precision dosing for TB patients.

Summary updated

Abstract

Abstract There is considerable interest in training machine learning (ML) models on genomic data that achieve clinical grade diagnostic accuracy. Many successful ML models have been trained and validated on binary tasks because predicting biomedically relevant continuous variables is difficult to optimize. In this work, we present convolutional neural networks (CNNs) that predict minimum inhibitory concentrations (MICs) for eight antibiotics from Mycobacterium tuberculosis (Mtb) gene sequences. By including evolutionary information, protein biochemical properties, and data augmentation for rare variants, we build models that predict 89% of MICs within one drug concentration doubling. Although trained on ≤ 52% of the World Health Organization’s (WHO) drug resistance mutation catalogue data, the CNNs accurately predict the effects of 97% of its graded mutations. In a cohort of 373 patients with rifampicin-susceptible Mtb infections, higher CNN-predicted rifampicin MICs are associated with unfavorable treatment outcomes, suggesting that subtle differences in MIC below the resistance threshold are clinically relevant. These results demonstrate the value of encoding multiple dimensions of biological data in machine learning of function or cellular phenotypes and that domain knowledge-inspired machine learning models can be both interpretable and reach clinical grade accuracy.
BibTeX
@misc{kulkarni2025convolutional,
  author = {Sanjana G. Kulkarni and Anna G. Green and Brendon C. Mann and Samantha Malatesta and Steve Goodwin and Nina Cesare and Shandukani Mulaudzi and Noorjahn Rawoot and Robin M. Warren and Karen R. Jacobson and Maha Farhat},
  title = {{Convolutional neural networks quantify antibiotic resistance in <i>Mycobacterium tuberculosis</i> with diagnostic grade accuracy and predict treatment response}},
  year = {2025},
  doi = {10.1101/2025.08.05.25333066},
  howpublished = {medRxiv},
}
Figure