Assessing the Impact of the COVID-19 Pandemic in Spain: Large-Scale, Online, Self-Reported Population Survey

Nuria Oliver, Xavier Barber, Kirsten Roomp, Kristof RoompJournal of Medical Internet Research 2020 · DOI

TL;DR

This paper demonstrates the power of large-scale, online, self-reported surveys as a rapid and cost-effective tool for assessing the impact of a pandemic. By analyzing over 140,000 responses from Spain during the early stages of COVID-19, the study provides crucial insights into public behavior, economic impact, and disease prevalence, highlighting the limitations of traditional data collection methods during a crisis.

What Problem Does This Paper Address?

The COVID-19 pandemic presented an unprecedented challenge for public health authorities, demanding rapid assessment of the population's situation, perceptions, and the disease's prevalence. Traditional methods like representative household surveys are slow and resource-intensive, while phone surveys, though faster, can still be labor-intensive and yield low response rates. During the initial surge of COVID-19 in Spain, there was a significant scarcity of high-quality data on crucial aspects such as social contact during confinement, personal economic impact, labor situation, and actual disease prevalence, especially given limited testing capacity. This paper addresses this gap by exploring the utility of a large-scale, online, self-reported survey as a viable alternative for timely data collection and analysis.

Methods

The study employed a 24-question anonymous online survey, dubbed the "Covid19Impact survey," designed to capture four key dimensions: social contact behavior, economic impact, workplace/labor situation, and health status. The survey was distributed via social media (primarily Twitter and WhatsApp) and snowball sampling, targeting the Spanish adult population (age >18). This non-probability sampling method was chosen for its scalability and speed, crucial for rapid data collection during confinement. The survey was deployed on March 28-April 2, 2020, during the peak of the first wave in Spain. Statistical analyses included Z-tests for proportion comparisons, chi-square tests, Cramér's V for association strength, and weighted logistic regression to model prevalence. Data underwent exclusion, cleansing, and reweighting to match Spanish demographic distributions.

Datasets

The primary dataset used in this study consists of 141,865 responses collected from the "Covid19Impact" online survey. This dataset was collected between March 28 and April 2, 2020. The paper also references data from the Spanish National Institute of Statistics (INE) for reweighting purposes and from the Spanish Ministry of Health's seroprevalence study for comparison.

Key Insights and Ideas

  • The Power of Citizen Science: The overwhelming response to the survey highlights a societal need for information and a willingness of the public to contribute to data-driven decision-making during a crisis.
  • Close Contacts Drive Transmission: Over 16% of respondents reported close contact with someone infected with SARS-CoV-2, with this figure rising to over 80% for those who tested positive. This strongly suggests that known contacts, rather than anonymous encounters, are primary drivers of infection, with implications for contact tracing strategies.
  • Gender and Age Matter: Statistically significant differences were observed across gender and age groups regarding social behavior, vulnerability, and attitudes towards containment measures. Women, for instance, were more likely to report not leaving home, while older adults were more likely to stay home and receive visitors.
  • Economic Strain Fuels Confinement Fatigue: A strong correlation was found between severe economic impact (e.g., inability to pay rent or buy food) and a reduced willingness to sustain confinement measures.
  • Testing Gaps Exposed: The survey revealed a significant lack of testing capacity, with 6.1% of respondents unable to get tested despite medical recommendation, and 32.5% of symptomatic individuals facing this issue.
  • Online Surveys as a Viable Tool: The study strongly advocates for large-scale online surveys as an effective, cheap, and fast method for assessing pandemic impact and prevalence, especially when official data is scarce and testing is limited.

Key Results

  • Prevalence Estimation: The study estimated a SARS-CoV-2 prevalence of approximately 5% in the Spanish population during the survey period, a figure consistent with later official seroprevalence studies.
  • Social Contact: 17.3% of respondents reported close contact with someone infected with COVID-19.
  • Reasons for Leaving Home: Basic needs (47.8%) and work (31.3%) were the most common reasons for leaving home.
  • Confinement Sustainability: A significant portion of respondents (44.1%) believed they could sustain confinement for only one additional month, with 32.4% able to continue for 3-6 months.
  • Economic Impact: 43.0% felt the crisis had not yet significantly affected them economically, but 19.4% of small businesses reported facing bankruptcy.
  • Testing: Only 1% of the population reported being tested, with 6% unable to be tested despite doctor's recommendation.
  • Model Performance: A generalized linear model for predicting SARS-CoV-2 positivity achieved a sensitivity of 0.77 and a specificity of 0.80.

Limitations and Future Work

The authors acknowledge several limitations:

  • Selection Bias: Participants volunteered without incentives, potentially skewing the sample towards those more engaged or concerned.
  • Self-Reported Bias: Data relies on individuals' honest reporting, which can be subject to inaccuracies.
  • Sampling Bias: The non-probability sampling method led to geographical underrepresentation, particularly of rural areas. While reweighting was used, it doesn't fully eliminate bias.
  • Snapshot in Time: The survey captured a specific 5-day period, representing a snapshot of the evolving situation.
  • Symptom Overestimation: The presence of other flu-like illnesses could have led to overestimation of COVID-19 symptoms.
  • Testing Detail: Lack of detailed information on test types, reliability, and timing relative to symptoms.

Future work suggested includes launching successive versions of the survey to track changes over time and conducting deeper analyses across various dimensions, including geographical granularity. The authors also emphasize the value of this approach for other countries facing similar data scarcity during pandemics.

Summary updated

Abstract

Large-scale online population surveys, distributed via social media and online messaging platforms, can be an effective, cheap, and fast tool to assess the impact and prevalence of an infectious disease in the context of a pandemic, particularly when there is a scarcity of official data and limited testing capacity.
BibTeX
@article{oliver2020assessing,
  author = {Nuria Oliver and Xavier Barber and Kirsten Roomp and Kristof Roomp},
  title = {{Assessing the Impact of the COVID-19 Pandemic in Spain: Large-Scale, Online, Self-Reported Population Survey}},
  journal = {Journal of Medical Internet Research},
  year = {2020},
  doi = {10.2196/21319},
}
Figure