Predicting Phenotypic Polymyxin Resistance in Klebsiella pneumoniae through Machine Learning Analysis of Genomic Data

Nenad Maćešić, Oliver J. Bear Don’t Walk, Itsik Pe’er, Nicholas P. Tatonetti, Anton Y. Peleg, Anne‐Catrin UhlemannmSystems 2020 · DOI

TL;DR

This paper demonstrates that machine learning (ML) applied to whole-genome sequencing data can accurately predict polymyxin resistance (PR) in Klebsiella pneumoniae, a critical last-resort antibiotic. Their reference-based ML approach significantly outperformed traditional rule-based methods, offering a promising avenue for rapid and accurate PR detection in a clinically relevant pathogen.

What Problem Does This Paper Address?

Polymyxins are vital last-resort antibiotics for treating infections caused by highly resistant Gram-negative bacteria like Klebsiella pneumoniae. However, the emergence and spread of polymyxin resistance (PR) pose a significant threat, potentially ushering in a "post-antibiotic era." Current phenotypic methods for detecting PR are resource-intensive, time-consuming, and can be difficult to perform accurately. Furthermore, PR is a complex, polygenic trait, meaning it's influenced by multiple genes, making it challenging to predict solely by identifying known resistance determinants. This complexity hinders rapid molecular detection and effective clinical management. The authors aim to leverage the power of machine learning and whole-genome sequencing (WGS) to overcome these limitations and accurately predict PR.

Methods

The researchers employed a machine learning framework to predict phenotypic polymyxin resistance. Their core approach involved two main "feature representation" strategies:

  • Reference-based: This method generated a binary matrix where each "instance" was a genome and each "feature" represented the presence of single nucleotide variants (SNVs) or insertion sequence (IS) elements in coding regions relative to a reference K. pneumoniae CG258 genome. This approach is "curated" as it focuses on known genomic elements.
  • Reference-free: This method used k-mers (short nucleotide sequences of a fixed length) as features, capturing genomic information without relying on a specific reference genome.

They then applied several ML algorithms (logistic regression, random forest, support vector machine classifier, and gradient-boosted trees classifier) to these matrices. To enhance prediction accuracy, they explored two "feature engineering" techniques:

  • Genome-Wide Association Study (GWAS) filtering: This involved using GWAS results to prioritize and select the most informative genomic features.
  • Integration of clinical data: Specifically, they incorporated a binary variable indicating prior polymyxin exposure for some isolates.

A simple rule-based approach, identifying variants in known PR genes, served as a baseline for comparison.

Datasets

The study utilized a substantial dataset of 619 Klebsiella pneumoniae clonal group 258 (CG258) genomes. These included:

  • 313 genomes from the Columbia University Irving Medical Center (CUIMC).
  • 306 publicly available genomes from various sources (e.g., CDC, PATRIC, and other research groups).

The authors note that the CUIMC genomes had a high degree of clonal relatedness and higher PR rates, while the publicly available datasets represented different degrees of clonal relatedness and PR rates.

Key Insights and Ideas

  • ML Outperforms Rules for Complex Resistance: The study strongly suggests that ML is superior to traditional rule-based methods for predicting complex polygenic traits like polymyxin resistance. This is likely because ML can capture intricate interactions between multiple genetic factors that rule-based systems might miss.
  • Reference-Based is King (for this problem): Surprisingly, the curated, reference-based approach yielded significantly better results than the more flexible reference-free k-mer approach. This highlights that for certain complex resistance mechanisms, a structured genomic representation can be more effective.
  • Interpretability is Key: A major win is that the ML models were interpretable, allowing researchers to identify which genes were most important for prediction. This not only validates the ML approach but also opens doors for discovering novel resistance mechanisms.
  • Clinical Data Adds Value (Modestly): Incorporating clinical data like prior polymyxin exposure provided a modest performance boost, underscoring the value of integrating different data types in predictive models.

Key Results

  • High Predictive Performance: The reference-based ML approach achieved a high Area Under the Receiver-Operator Curve (AUROC) of 0.894 when analyzing all genomes, significantly outperforming the rule-based approach (AUROC of 0.791, P = 0.006).
  • Reference-Free Underperforms: The reference-free k-mer approach showed decreased performance, with an AUROC of 0.692 compared to the reference-based method (P = 0.015).
  • GWAS and Clinical Data Boost: Incorporating GWAS filtering and prior polymyxin exposure data led to modest performance increases, with the best-performing model (reference-based with polymyxin exposure) achieving an AUROC of 0.923.
  • Identification of Known and Novel Determinants: The interpretable ML models correctly identified six of seven known PR genes without explicit programming. Furthermore, they highlighted several genes involved in stress responses and cell membrane maintenance as potential novel determinants of PR.

Limitations and Future Work

  • Reference-Based Limitations: The authors acknowledge that the reference-based approach has limitations, particularly in its inability to account for novel genomic content not present in the reference genome. This is especially relevant for organisms with large accessory genomes. They also note that plasmid-mediated PR, while rare in K. pneumoniae, would not be detected by their current reference-based model.
  • Generalizability: While the study focused on K. pneumoniae CG258, the authors suggest that similar ML approaches could be applicable to other forms of complex antimicrobial resistance and other bacterial species. However, they caution against a "one-size-fits-all" approach, emphasizing the need to tailor ML methods to specific organisms and resistance mechanisms.
  • Future Directions: The identified potential novel determinants of PR require functional testing to confirm their role. Further work could explore integrating a wider range of clinical variables (e.g., patient comorbidities, prior antibiotic exposure beyond polymyxins) and investigate the impact of population structure on ML model performance. The authors also suggest that future research could explore more advanced feature representation methods and weighted scoring systems to better capture the functional impact of genetic variants.

Summary updated

Abstract

Polymyxins are used as treatments of last resort for Gram-negative bacterial infections. Their increased use has led to concerns about emerging polymyxin resistance (PR). Phenotypic polymyxin susceptibility testing is resource intensive and difficult to perform accurately. The complex polygenic nature of PR and our incomplete understanding of its genetic basis make it difficult to predict PR using detection of resistance determinants. We therefore applied machine learning (ML) to whole-genome sequencing data from >600 <i>Klebsiella pneumoniae</i> clonal group 258 (CG258) genomes to predict phenotypic PR. Using a reference-based representation of genomic data with ML outperformed a rule-based approach that detected variants in known PR genes (area under receiver-operator curve [AUROC], 0.894 versus 0.791, <i>P = </i>0.006). We noted modest increases in performance by using a bacterial genome-wide association study to filter relevant genomic features and by integrating clinical data in the form of prior polymyxin exposure. Conversely, reference-free representation of genomic data as k-mers was associated with decreased performance (AUROC, 0.692 versus 0.894, <i>P = </i>0.015). When ML models were interpreted to extract genomic features, six of seven known PR genes were correctly identified by models without prior programming and several genes involved in stress responses and maintenance of the cell membrane were identified as potential novel determinants of PR. These findings are a proof of concept that whole-genome sequencing data can accurately predict PR in <i>K. pneumoniae</i> CG258 and may be applicable to other forms of complex antimicrobial resistance.<b>IMPORTANCE</b> Polymyxins are last-resort antibiotics used to treat highly resistant Gram-negative bacteria. There are increasing reports of polymyxin resistance emerging, raising concerns of a postantibiotic era. Polymyxin resistance is therefore a significant public health threat, but current phenotypic methods for detection are difficult and time-consuming to perform. There have been increasing efforts to use whole-genome sequencing for detection of antibiotic resistance, but this has been difficult to apply to polymyxin resistance because of its complex polygenic nature. The significance of our research is that we successfully applied machine learning methods to predict polymyxin resistance in <i>Klebsiella pneumoniae</i> clonal group 258, a common health care-associated and multidrug-resistant pathogen. Our findings highlight that machine learning can be successfully applied even in complex forms of antibiotic resistance and represent a significant contribution to the literature that could be used to predict resistance in other bacteria and to other antibiotics.
BibTeX
@inproceedings{macesic2020predicting,
  author = {Nenad Maćešić and Oliver J. Bear Don’t Walk and Itsik Pe’er and Nicholas P. Tatonetti and Anton Y. Peleg and Anne‐Catrin Uhlemann},
  title = {{Predicting Phenotypic Polymyxin Resistance in Klebsiella pneumoniae through Machine Learning Analysis of Genomic Data}},
  booktitle = {mSystems},
  year = {2020},
  doi = {10.1128/msystems.00656-19},
}
Figure