Abstract
Wastewater-based surveillance (WBS) has emerged as a critical public health tool for monitoring pathogen genetic diversity at scale. However, deconvolving complex mixtures of viral lineages from short-read sequencing data remains a significant computational challenge. This study benchmarks nine tools—Alcov, Basic, Freyja, Gromstole, LCS, Lineagespot, Pipes, VLQ, and V-pipe—using 100 simulated wastewater samples containing SARS-CoV-2 BA.1, BA.2, and Delta lineages, along with recombinants and novel synthetic lineages. While most tools proved robust to variations in sequencing depth and read length, reliability was highest for variants above a 5% abundance threshold.
Introduction
Wastewater-based surveillance (WBS) provides a non-invasive, community-level view of viral spread. While qPCR measures total viral load, genomic sequencing is required to identify specific Variants of Concern (VOCs). Wastewater samples are inherently "genomic soups," containing fragments from numerous individuals and lineages. Deconvolving these mixtures to estimate relative abundances is a complex task that requires specialized computational tools. Until now, there hasn't been a comprehensive, independent comparison of how these different tools handle "messy" real-world conditions like low coverage or the appearance of entirely new, unclassified lineages.
Methodology
The researchers conducted a semi-blind benchmark involving nine computational tools, each employing different algorithmic strategies such as linear modeling, phylogenetic placement, and expectation-maximization.
The benchmark used 100 simulated samples designed to test tool performance against varying sequencing depths, read lengths, and the presence of "edge cases" like recombinants and unclassified synthetic lineages. These tools represent a variety of approaches, from linear regression (Alcov, Gromstole) to phylogenetic placement (Freyja) and pseudoalignment (VLQ).
Results and Performance
Most tools demonstrated high accuracy in identifying lineages and estimating their relative abundances, achieving high F1 scores and low Root-Mean-Square Error (RMSE). Performance was particularly strong for variants present at frequencies above 5%. Below this threshold, the signal-to-noise ratio often led to increased false positives or quantification errors.
Top-performing tools, including Freyja, Alcov, and V-pipe, showed consistent results across various simulated conditions. Notably, the tools were generally resilient to "bad" data, such as low coverage or shorter read lengths, suggesting that cost-saving measures in sequencing may not severely compromise surveillance quality. However, some tools like Lineagespot (designed for presence/absence) and Basic (optimized for pre-Omicron variants) showed higher error rates in this specific benchmark.
Handling Complexity and Novelty
The study also explored how tools handle "unknown" data. When presented with a novel synthetic lineage, most tools correctly categorized it as "Other" or "Unassigned." However, the presence of such unknown lineages did slightly increase the error in quantifying known variants. Recombinants (e.g., Delta-Omicron) proved more challenging, with some tools identifying the recombinant specifically and others splitting the abundance between the parent lineages.
Conclusion and Future Directions
This assessment highlights the maturity and robustness of current WBS deconvolution tools. While tool choice should be tailored to specific goals—such as presence/absence vs. precise quantification—most methods are capable of providing reliable public health data even under suboptimal sequencing conditions.
Future work should focus on fully automated, independent benchmarking and the development of tools that can better distinguish between closely related sub-lineages as the virus continues to evolve convergently. The authors also note that real-world wastewater is even more complex than these simulations, containing higher levels of degradation and potential contamination from other coronaviruses.
Summary updated