Analysis of the limited M. tuberculosis accessory genome reveals potential pitfalls of pan-genome analysis approaches

Maximillian G. Marin, Christoph Wippel, Natalia Quinones‐Olvera, Mahboobeh Behruznia, Brendan M. Jeffrey, Michael A. Harris, Brendon C. Mann, Alex Rosenthal, Karen R. Jacobson, Robin M. Warren, Heng Li, Conor J. Meehan, Maha FarhatbioRxiv 2024 · DOI

TL;DR

This paper investigates the reliability of pan-genome analysis, a key tool for understanding bacterial evolution, by highlighting how different computational choices can lead to wildly different results. They introduce panqc, a new software tool to correct for common errors like redundant gene annotations, improving the accuracy of pan-genome estimates, especially for closely related bacteria.

What Problem Does This Paper Address?

Understanding bacterial evolution and diversity relies heavily on analyzing the "pan-genome" – the complete set of genes found across all strains of a species. However, the way researchers define and compare these genes can significantly influence the results, leading to inconsistent estimates of a species' genetic repertoire. This is particularly problematic when trying to pinpoint subtle evolutionary changes, like gene gain or loss, especially in bacteria with limited genetic variation. The authors aim to quantify these sources of variability and develop a method to improve the accuracy of pan-genome analyses, focusing on Mycobacterium tuberculosis (Mtb) as a model organism due to its clonal nature and limited accessory genome.

Methods

The study employed a multi-faceted approach:

  • Pan-genome Graph Construction: They used the minigraph algorithm to build a pan-genome graph representing structural variations (rearrangements, deletions, duplications) across a collection of Mtb genomes. This approach focuses on nucleotide-level differences.
  • Pan-genome Analysis Pipeline Comparison: They systematically evaluated three popular pan-genome analysis pipelines (Panaroo, Roary, and PPanGGolin) using different genome assembly types (hybrid vs. short-read) and annotation pipelines (Bakta vs. PGAP).
  • Development of panqc: A novel software tool, panqc, was developed. It addresses two main issues:
  • Annotation Discrepancy Detection: It identifies genes that are present at the nucleotide level but absent at the coding sequence (CDS) level due to annotation errors.
  • Nucleotide Redundancy Collapse: It merges CDSs with highly similar nucleotide sequences, effectively collapsing redundant entries that arise from minor variations or annotation differences.
  • Gene Gain/Loss Event Reconstruction: Ancestral state reconstruction was used to infer gene gain and loss events before and after applying panqc to assess its impact on evolutionary interpretations.

Datasets

  • Mycobacterium tuberculosis (Mtb): A curated dataset of 151 complete Mtb isolates was used. These isolates were sequenced using both short-read (Illumina) and long-read (Oxford Nanopore, PacBio) technologies, providing both hybrid and short-read de novo assemblies. This dataset spans global Mtb diversity across several lineages.
  • Escherichia coli (E. coli): A dataset of 50 E. coli isolates was also analyzed to assess the applicability of panqc to a more genetically diverse population. These were also assembled using a hybrid approach.

Key Insights and Ideas

  • Structural Variation Dominates in Mtb: Contrary to expectations of novel gene acquisition, the majority of genetic variation in the Mtb pan-genome arises from rearrangements, deletions, and duplications of existing DNA sequences, rather than entirely new genes.
  • Amino Acid-Based Comparisons Can Be Misleading: Pan-genome analyses relying solely on amino acid sequences can produce highly variable and inflated estimates of accessory genes, especially when assembly quality or annotation pipelines differ.
  • Annotation Discrepancies are a Major Pitfall: Differences in how genes are annotated (e.g., identifying pseudogenes vs. functional CDSs) are a significant driver of inflated accessory genome sizes, particularly in closely related strains.
  • panqc Corrects for Redundancy: The developed panqc tool effectively reduces inflated pan-genome estimates by accounting for nucleotide redundancy caused by annotation discrepancies and highly similar sequences.
  • Genomic Diversity Matters: The impact of panqc and the nature of pan-genome biases differ significantly between highly clonal populations like Mtb and more diverse populations like E. coli.

Key Results

  • Mtb Structural Variation: The Mtb pan-genome graph revealed 536 core nodes (3.9 Mb) and 2602 SV nodes (1.3 Mb), with only 23% of SV nodes representing novel sequence content.
  • Pipeline Variability: Pan-genome estimates for Mtb varied dramatically, from 220 to 2951 accessory genes, depending on the pipeline, assembly, and annotation choices.
  • panqc Impact on Mtb: Applying panqc reduced the Mtb accessory genome size by an average of 420 genes (44%). CDS annotation discrepancies accounted for an average of 49% of initially reported absent CDSs.
  • panqc Impact on E. coli: For E. coli, panqc had a more modest effect, reducing the accessory genome by only 0.7% on average, as CDS annotation discrepancies were responsible for only 1.0% of absent genes.
  • Assembly Type Matters: Hybrid assemblies generally led to more consistent pan-genome estimates (larger core, smaller accessory) compared to short-read assemblies, which often suffer from incompleteness.
  • Annotation Pipeline Impact: PGAP consistently produced smaller pan-genome estimates than Bakta, largely due to PGAP's higher frequency of annotating pseudogenes.

Limitations and Future Work

  • Short-Read Assembly Limitations: The study highlights that short-read assemblies, while useful, can be incomplete and lead to inflated accessory genome predictions. Careful quality control of short-read assemblies is crucial.
  • Mtb's Unique Nature: The findings regarding annotation discrepancies and redundancy are particularly pronounced in highly similar genomes like Mtb. Their impact may lessen in more diverse species, though panqc still offers value.
  • Future Directions: The authors envision panqc being used in conjunction with other quality control tools for pan-genome analysis. They also suggest that future pan-genome analysis methods should aim to integrate both nucleotide and amino acid level information for a more comprehensive understanding of bacterial evolution.

Summary updated

Abstract

Pan-genome analysis is a fundamental tool for studying bacterial genome evolution; however, the variety of methods used to define and measure the pan-genome poses challenges to the interpretation and reliability of results. To quantify sources of bias and error related to common pan-genome analysis approaches, we evaluated different approaches applied to curated collection of 151 <i>Mycobacterium tuberculosis</i> ( <i>Mtb</i> ) isolates. <i>Mtb</i> is characterized by its clonal evolution, absence of horizontal gene transfer, and limited accessory genome, making it an ideal test case for this study. Using a state-of-the-art graph-genome approach, we found that a majority of the structural variation observed in <i>Mtb</i> originates from rearrangement, deletion, and duplication of redundant nucleotide sequences. In contrast, we found that pan-genome analyses that focus on comparison of coding sequences (at the amino acid level) can yield surprisingly variable results, driven by differences in assembly quality and the softwares used. Upon closer inspection, we found that coding sequence annotation discrepancies were a major contributor to inflated <i>Mtb</i> accessory genome estimates. To address this, we developed panqc, a software that detects annotation discrepancies and collapses nucleotide redundancy in pan-genome estimates. When applied to <i>Mtb</i> and <i>E. coli</i> pan-genomes, panqc exposed distinct biases influenced by the genomic diversity of the population studied. Our findings underscore the need for careful methodological selection and quality control to accurately map the evolutionary dynamics of a bacterial species.
BibTeX
@misc{marin2024analysis,
  author = {Maximillian G. Marin and Christoph Wippel and Natalia Quinones‐Olvera and Mahboobeh Behruznia and Brendan M. Jeffrey and Michael A. Harris and Brendon C. Mann and Alex Rosenthal and Karen R. Jacobson and Robin M. Warren and Heng Li and Conor J. Meehan and Maha Farhat},
  title = {{Analysis of the limited <i>M. tuberculosis</i> accessory genome reveals potential pitfalls of pan-genome analysis approaches}},
  year = {2024},
  doi = {10.1101/2024.03.21.586149},
  howpublished = {bioRxiv},
}
Figure