NucBreak: location of structural errors in a genome assembly by using paired-end Illumina reads

Ksenia Khelik, Geir Kjetil Sandve, Alexander Johan Nederbragt, Torbjørn RognesBMC Bioinformatics 2020 · DOI

Introduction

Assembling a genome from short DNA sequences is a complex computational challenge, often resulting in structural errors such as insertions, deletions, inversions, and mislocations. These misassemblies can significantly impact downstream biological analyses. Traditional validation tools, like REAPR or Pilon, typically identify errors by flagging "discordant" reads—pairs that map with unexpected orientations or distances. However, these signals are often noisy, leading to high false discovery rates (FDR).

NucBreak is an open-source tool designed to address these limitations. Instead of focusing solely on problematic reads, NucBreak analyzes the inconsistencies within "properly mapped" reads and their alternative alignments to achieve high sensitivity with a significantly lower false alarm rate.

Methodology

The NucBreak workflow shifts the focus to the internal consistency of read alignments through a multi-step process:

  1. Comprehensive Mapping: Using Bowtie2 in "sensitive-local" mode, the tool captures not only the primary alignment for each read but also all potential alternative locations.
  2. Read Categorization: Read pairs are classified into groups based on their mapping uniqueness (e.g., "Single-Single" for pairs where both reads map uniquely, or "Multiple-Multiple" for repetitive regions).
  3. Path Creation: Overlapping reads are merged into continuous "paths." In a correct assembly, these paths should cover the sequence smoothly.
Basic representation of forward and reverse-oriented paths created from overlapping reads.
  1. Path Gap Analysis: NucBreak identifies "path gaps"—regions where the expected flow of reads is broken. This often occurs because reads are "pulled" toward a better alternative alignment elsewhere in the genome.
NucBreak categorizes read pairs into different path types (Single, Multiple, etc.) and identifies "missed paths" or gaps that indicate potential assembly errors.
  1. Localization: To minimize false positives, NucBreak requires that a suspected error be supported by gaps in both forward-oriented and reverse-oriented read paths. The intersection of these gaps allows for precise coordinate-level localization of the structural error.

Experimental Evaluation

The authors benchmarked NucBreak against several established tools, including Pilon, REAPR, FRCbam, BreakDancer, Lumpy, and Wham, using a variety of datasets:

  • Simulated Genomes: Artificial sequences with known structural errors and varying sequencing depths (5x to 200x).
  • Assemblathon 1: A standard benchmark dataset based on an evolved human chromosome 13.
  • Real Bacterial Genomes: Eight species (e.g., E. coli, S. aureus) where reads were mapped back to assemblies produced by SPAdes, Velvet, and ABySS.

Key Results

NucBreak demonstrated several advantages over existing methodologies:

  • Precision and Sensitivity: It maintained high sensitivity (>0.7) for most error types, particularly relocations and inversions, while consistently showing a lower FDR than competitors like REAPR or FRCbam.
  • Robustness to Coverage: Unlike some tools that struggle at low or extremely high sequencing depths, NucBreak's performance remained stable across a wide range of coverage (10x to 200x).
  • Real-World Utility: In bacterial genome tests, NucBreak provided a significantly cleaner set of predicted errors compared to Pilon, which often generated thousands of false positives in similar contexts.

Conclusion and Limitations

NucBreak offers a reliable "second opinion" for genome assembly quality by leveraging the signal from properly mapped reads. While highly effective at localizing structural errors, it does not currently annotate the specific type of error (e.g., labeling a gap as an "inversion"). Additionally, it is optimized for structural variations and may miss small errors like single-nucleotide substitutions or indels smaller than 30 base pairs.

NucBreak is freely available on GitHub at https://github.com/uio-bmi/NucBreak.

Summary updated

BibTeX
@article{khelik2020nucbreak,
  author = {Ksenia Khelik and Geir Kjetil Sandve and Alexander Johan Nederbragt and Torbjørn Rognes},
  title = {{NucBreak: location of structural errors in a genome assembly by using paired-end Illumina reads}},
  journal = {BMC Bioinformatics},
  year = {2020},
  doi = {10.1186/s12859-020-3414-0},
}
Figure