Automated annotation and validation of human respiratory virus sequences using VADR

Jeffrey C. Furlong, Stephanie Goya, Eric P. Nawrocki, Vince D. Calhoun, Eneida Hatcher, Linda Yankie, Alexander L. Greninger

TL;DR

This paper expands the Viral Annotation DefineR (VADR) tool with 12 new models for key human respiratory viruses, significantly improving automated genome annotation accuracy. These enhanced models are now integrated into NCBI's GenBank submission pipeline, enabling more reliable and scalable viral genome analysis for public health.

What Problem Does This Paper Address?

Accurate and standardized annotation of viral genomes is crucial for understanding viral evolution, tracking outbreaks, and developing diagnostics and therapeutics. While the NCBI's VADR pipeline offers a standardized approach to this, it previously only supported a limited number of viral groups. This left a significant gap for annotating many common and emerging human respiratory viruses, hindering efficient data sharing and downstream analysis. The authors aimed to bridge this gap by developing and validating new VADR models for a broader range of respiratory viruses.

Methods

The core of this work involved developing and refining VADR models for 12 human respiratory viruses. This process was iterative and data-driven:

  • Initial Model Construction: Prototype genomes from NCBI's RefSeq database were used to build initial VADR models.
  • Phylogenetic and Genomic Diversity Analysis: To capture the full spectrum of genetic variation within each species, the researchers performed extensive phylogenetic analyses and examined genomic diversity. This guided the selection of representative genomes from different genotypes and lineages.
  • Iterative Refinement: VADR annotation error alerts were used to identify areas for improvement. This involved incorporating "alternate features" – strain-specific genetic elements like insertions, deletions, or frameshifts that are biologically plausible – and adjusting model parameters (e.g., indefclass thresholds).
  • VADR Pipeline: The VADR pipeline itself automates the validation and annotation of viral genomes by comparing them against curated models. It performs numerous quality control checks to identify issues like frameshifts, premature stop codons, and misassemblies.

Datasets

The study utilized several datasets:

  • Training Data: Over 5,327 publicly available complete viral genomes from INSDC databases (NCBI GenBank portal) were used to train and build the VADR models. Sequences with more than 10% ambiguous bases ("N") were excluded.
  • Testing Data: 372 viral genomes, sequenced in the authors' lab and not previously submitted to GenBank, were used to independently validate the performance of the newly developed VADR models.

Key Insights and Ideas

  • Genotype-Specific Models are Crucial: The study strongly demonstrated that a single reference genome is insufficient for accurate annotation due to high intra-species diversity. Developing genotype-specific models, informed by phylogenetic analysis, dramatically improved annotation success rates.
  • "Alternate Features" Unlock Accuracy: Incorporating biologically plausible variations (like stop codon mutations or small insertions/deletions) as "alternate features" was key to handling the complex genetic diversity of these viruses and achieving high annotation accuracy.
  • VADR as a Quality Control Gatekeeper: VADR's ability to detect misassemblies and novel biological features highlights its value not just for annotation but also as a critical pre-submission quality control step for genomic data.
  • Novel Viral Biology Discovery: The VADR models not only improved annotation but also helped uncover previously unreported biological phenomena, such as an HCoV-OC43 NS2 knockout and novel G and SH coding sequence lengths in human metapneumovirus.

Key Results

  • High Annotation Success Rates: The expanded VADR models achieved high annotation success rates: 96.3% for publicly available genomes and 98.1% for genomes not in the training set.
  • Significant Improvement Over Initial Models: Initial models based on single RefSeq references often failed to annotate even 70% of genomes. The refined, diversity-aware models pushed success rates to over 95% for most virus-specific libraries.
  • Specific Virus Improvements: For example, HCoV-229E annotation success jumped from 12.3% to 96.3% by using a clinical isolate instead of a lab-adapted reference. Mumps virus (MuV) annotation improved from 8.6% to 99% by incorporating all 12 known genotypes.
  • Integration with NCBI: The developed VADR models are now publicly available and actively used by NCBI curators in the GenBank submission pipeline.

Limitations and Future Work

  • Genome Completeness and Ambiguity: VADR performance is sensitive to genome completeness and the presence of ambiguous bases ("N"), especially when they disrupt conserved nucleotide signatures or are not multiples of three.
  • Underrepresented Genotypes/Emergent Strains: For some viruses (e.g., MeV), certain genotypes have limited sequence data, hindering robust model development. Emergent strains may also harbor novel features not yet captured.
  • Limited Validation for Some Viruses: For MeV, MuV, and RuV, the authors did not have newly sequenced isolates from their own lab to validate the models, relying instead on existing data and beta-testing by NCBI curators.
  • Future Work: The authors suggest continued collaborative model refinement, leveraging community feedback, and ongoing updates to incorporate new data and emergent strains. They also highlight the need for standardized protein nomenclature to reduce database confusion.

Summary updated

Abstract

Accurate annotation of viral genomes is essential for reliable downstream analysis and public data sharing. While National Center for Biotechnology Information's (NCBI's) Viral Annotation DefineR (VADR) pipeline provides standardized annotation and quality control, it only supports six viral groups to date. Here, we developed and validated 12 new reference sequence-based VADR models targeting key human respiratory viruses: measles virus, mumps virus, rubella virus, human metapneumovirus, human parainfluenza virus types 1-4, and seasonal coronaviruses (229E, NL63, OC43, and HKU1). Model construction was guided by a comprehensive analysis of intra-species genomic and phylogenetic diversity, enabling the development of genotype-specific models associated with reference genomes that defined expected genome structure and annotation. Models were trained on 5327 publicly available complete viral genomes and tested on 372 viral genomes not yet submitted to GenBank. VADR passed 96.3% of publicly available viral genomes and 98.1% of viral genomes not in the training set, correctly identifying overlapping ORFs, mature peptides, and transcriptional slippage as well as genome misassemblies. VADR detected novel viral biology including the first reported HCoV-OC43 NS2 knockout in a human infection and novel G and SH coding sequence lengths in human metapneumovirus. These VADR models are publicly available and are used by NCBI curators as part of the GenBank submission pipeline, supporting high-quality, scalable viral genome annotation for research and public health.
BibTeX
@inproceedings{furlong2025automated,
  author = {Jeffrey C. Furlong and Stephanie Goya and Eric P. Nawrocki and Vince D. Calhoun and Eneida Hatcher and Linda Yankie and Alexander L. Greninger},
  title = {{Automated annotation and validation of human respiratory virus sequences using VADR}},
  booktitle = {Database},
  year = {2025},
  doi = {10.1093/database/baaf078},
}
Figure