Accuracy of rapid point-of-care antigen-based diagnostics for SARS-CoV-2: an updated systematic review and meta-analysis with meta regression analyzing influencing factors

Lukas E. Brümmer, Stephan Katzenschlager, Sean McGrath, Stephani Schmitz, Mary Gaeddert, Christian Erdmann, Marc Bota, Maurizio Grilli, Jan Larmann, Markus Weigand, Nira R. Pollock, Aurélien Macé, Berra Erkoşar, Sergio Carmona, Jilian A. Sacks, Stefano Ongarello, Claudia M. DenkingermedRxiv 2022 · DOI

TL;DR

This massive meta-analysis of over 220,000 test results confirms that while rapid antigen tests (Ag-RDTs) have moderate overall sensitivity (~72%), they are exceptionally good (>90%) at identifying individuals with high viral loads. The study reveals that factors like symptom status and timing are primarily proxies for viral load, which remains the single most important predictor of test performance.

What Problem Does This Paper Address?

Since the start of the pandemic, rapid antigen tests have been a pillar of public health. However, reported accuracy has varied wildly across different studies. This discrepancy creates a challenge for policy makers: is a "bad" result due to a poor-quality test, the timing of the sample, the presence of symptoms, or the way the sample was collected?

The authors address this by updating a "living" systematic review to untangle these influencing factors. By using meta-regression, they aim to determine which variables—such as viral load (measured by Ct-value), symptom duration, and sample type—independently drive test sensitivity.

Methods

The researchers conducted a systematic review and meta-analysis, searching databases including PubMed, Web of Science, medRxiv, and bioRxiv for studies published through August 2021.

What sets this paper apart is the use of multivariate mixed-effects meta-regression models. Instead of just looking at one variable at a time, this approach allowed the authors to estimate the "direct effect" of a factor (like symptoms) while holding others (like viral load) constant. They used RT-PCR as the reference "gold standard" and applied the Quantile Estimation approach to standardize heterogeneous Ct-value data across different studies.

Datasets

The "dataset" for this study is a synthesis of 194 clinical accuracy studies encompassing 221,878 Ag-RDTs.

  • Reference Standard: RT-PCR (or viral culture in one instance).
  • Tests Evaluated: 76 different Ag-RDT brands, with the most data available for the SD Biosensor "Standard Q" and Abbott "Panbio" tests.
  • Population: A mix of symptomatic and asymptomatic individuals across all age groups.

Key Insights and Ideas

  • Viral Load is the Primary Driver: The "aha moment" here is that while symptomatic patients appear to have much higher test sensitivity (76.2% vs. 56.8% for asymptomatic), this difference is largely explained by viral load. Symptomatic people simply tend to have more virus at the time of testing. When adjusting for Ct-values, the sensitivity gap between the two groups narrows significantly.
  • The "First Week" Window: Sensitivity drops off a cliff after the first week of symptoms (81.9% in week one vs. 51.8% after). Again, this is driven by the natural decline of viral shedding over time.
  • Sample Type Hierarchy: Not all swabs are equal. Nasopharyngeal (NP) and anterior nasal/mid-turbinate samples outperformed saliva and oropharyngeal-only swabs. Interestingly, anterior nasal swabs performed nearly as well as the more invasive NP swabs.
  • The "Instructions for Use" (IFU) Premium: Following manufacturer instructions matters. Sensitivity was nearly 10% higher in studies that strictly followed the IFU compared to those that deviated (e.g., using different transport media or banked samples).

Key Results

  • Overall Performance: Pooled sensitivity was 72.0% (95% CI 69.8–74.2) and specificity was 98.9% (95% CI 98.6–99.1).
  • Sensitivity by Viral Load:
    • Ct < 20 (Very high load): 97.9% sensitivity.
  • Ct < 25 (High load): 90.6% sensitivity.
  • Ct ≥ 30 (Low load): 18.7% sensitivity.
  • Top Performers: Among individual tests with sufficient data, the LumiraDx (82.7%) and Standard Q nasal (81.4%) showed the highest pooled sensitivity.
  • Meta-regression: Sensitivity increased by 2.9 percentage points for every unit decrease in mean Ct-value (indicating a higher viral load).

Limitations and Future Work

The authors acknowledge several limitations:

  1. Ct-Value Variability: Ct-values are semi-quantitative and vary between different PCR platforms and labs, making them an imperfect proxy for absolute viral load.
  2. Variant Data: Most data in this meta-analysis preceded the dominance of the Omicron variant. Early data suggests Ag-RDTs may perform differently (potentially lower sensitivity) with Omicron, necessitating urgent updated studies.
  3. Study Quality: Many included studies had a high or unclear risk of bias, particularly regarding how participants were selected and whether the test operators were blinded to the PCR results.

The authors conclude by calling for better standardization in clinical accuracy studies, specifically requesting that researchers provide patient-level Ct-values and symptom duration to allow for even more precise future analyses.

Summary updated

Abstract

ABSTRACT Background Comprehensive information about the accuracy of antigen rapid diagnostic tests (Ag-RDTs) for SARS-CoV-2 is essential to guide public health decision makers in choosing the best tests and testing policies. In August 2021, we published a systematic review and meta-analysis about the accuracy of Ag-RDTs. We now update this work and analyze the factors influencing test sensitivity in further detail. Methods and findings We registered the review on PROSPERO (registration number: CRD42020225140). We systematically searched multiple databases (PubMed, Web of Science Core Collection, medRvix, bioRvix, and FIND) for publications evaluating the accuracy of Ag-RDTs for SARS-CoV-2 until August 31, 2021. Descriptive analyses of all studies were performed, and when more than 4 studies were available, a random-effects meta-analysis was used to estimate pooled sensitivity and specificity with reverse transcription polymerase chain reaction (RT-PCR) testing as a reference. To evaluate factors influencing test sensitivity, we performed 3 different analyses using multivariate mixed-effects meta-regression models. We included 194 studies with 221,878 Ag-RDTs performed. Overall, the pooled estimates of Ag-RDT sensitivity and specificity were 72.0% (95% confidence interval [CI] 69.8 to 74.2) and 98.9% (95% CI 98.6 to 99.1), respectively. When manufacturer instructions were followed, sensitivity increased to 76.4% (95%CI 73.8 to 78.8). Sensitivity was markedly better on samples with lower RT-PCR cycle threshold (Ct) values (sensitivity of 97.9% [95% CI 96.9 to 98.9] and 90.6% [95% CI 88.3 to 93.0] for Ct-values &lt;20 and &lt;25, compared to 54.4% [95% CI 47.3 to 61.5] and 18.7% [95% CI 13.9 to 23.4] for Ct-values ≥25 and ≥30) and was estimated to increase by 2.9 percentage points (95% CI 1.7 to 4.0) for every unit decrease in mean Ct-value when adjusting for testing procedure and patients’ symptom status. Concordantly, we found the mean Ct-value to be lower for true positive (22.2 [95% CI 21.5 to 22.8]) compared to false negative (30.4 [95% CI 29.7 to 31.1]) results. Testing in the first week from symptom onset resulted in substantially higher sensitivity (81.9% [95% CI 77.7 to 85.5]) compared to testing after 1 week (51.8%, 95% CI 41.5 to 61.9). Similarly, sensitivity was higher in symptomatic (76.2% [95% CI 73.3 to 78.9]) compared to asymptomatic (56.8% [95% CI 50.9 to 62.4]) persons. However, both effects were mainly driven by the Ct-value of the sample. With regards to sample type, highest sensitivity was found for nasopharyngeal (NP) and combined NP/oropharyngeal samples (70.8% [95% CI 68.3 to 73.2]), as well as in anterior nasal/mid-turbinate samples (77.3% [95% CI 73.0 to 81.0]). Conclusion Ag-RDTs detect most of the individuals infected with SARS-CoV-2, and almost all when high viral loads are present (&gt;90%). With viral load, as estimated by Ct-value, being the most influential factor on their sensitivity, they are especially useful to detect persons with high viral load who are most likely to transmit the virus. To further quantify the effects of other factors influencing test sensitivity, standardization of clinical accuracy studies and access to patient level Ct-values and duration of symptoms are needed.
BibTeX
@misc{brummer2022accuracy,
  author = {Lukas E. Brümmer and Stephan Katzenschlager and Sean McGrath and Stephani Schmitz and Mary Gaeddert and Christian Erdmann and Marc Bota and Maurizio Grilli and Jan Larmann and Markus Weigand and Nira R. Pollock and Aurélien Macé and Berra Erkoşar and Sergio Carmona and Jilian A. Sacks and Stefano Ongarello and Claudia M. Denkinger},
  title = {{Accuracy of rapid point-of-care antigen-based diagnostics for SARS-CoV-2: an updated systematic review and meta-analysis with meta regression analyzing influencing factors}},
  year = {2022},
  doi = {10.1101/2022.02.11.22270831},
  howpublished = {medRxiv},
}
Figure