Lottery or Triage? Controlled Experimental Evidence from the COVID-19 Pandemic on Public Preferences for Allocation of Scarce Medical Resources

Rhys Thomas, Laurence Roope, Raymond Duch, Thomas Robinson, Alexei Zakharov, Philip ClarkeMedical 2025 · DOI

TL;DR

This study surveyed over 15,000 people across 14 countries during the COVID-19 pandemic to gauge public opinion on allocating scarce vaccines. The findings reveal a strong global preference for allocation by expert committees over lotteries, though significant country-level variations exist, suggesting the need for tailored communication strategies.

What Problem Does This Paper Address?

The allocation of scarce medical resources, especially during crises like pandemics, presents a significant ethical challenge. Bioethicists have proposed lotteries as a fair and transparent mechanism, particularly when individuals have similar needs. However, there's been a lack of empirical evidence on public acceptance of this approach compared to more traditional methods like expert-led triage. This paper addresses this gap by directly comparing public agreement with lottery-based allocation versus allocation by an expert committee in the context of COVID-19 vaccine distribution.

Methods

The researchers conducted a controlled experimental survey involving 15,380 respondents from 14 diverse countries between November 2020 and May 2021. Participants were randomly assigned to one of two hypothetical scenarios:

  1. Lottery Allocation: Vaccines would be allocated by randomly drawing names from a pool of eligible individuals (nurses in this scenario).
  2. Expert Committee Allocation: Vaccines would be allocated by a committee of independent expert physicians who would select recipients based on who would benefit most.

Respondents rated their agreement with the appropriateness of each allocation method on a scale of 0 (strongly disagree) to 100 (strongly agree). The study used two-sided t-tests to compare mean agreement scores between the two groups and across various demographic and country-specific strata.

Datasets

The study utilized a dataset of 15,380 survey responses collected from participants in 14 countries: Australia, Brazil, Canada, Chile, China, Colombia, France, India, Italy, Russia, Spain, Uganda, the United Kingdom, and the United States. The data was collected via online surveys, with participants recruited through a combination of a survey firm's active panel and Facebook Ad Manager (for Chile and Uganda).

Key Insights and Ideas

  • Universal Preference for Expertise: Despite theoretical arguments for fairness in lotteries, the public overwhelmingly favors expert judgment when allocating scarce resources. This suggests a deep-seated trust in medical expertise for complex decision-making.
  • Country-Specific Nuances: The "one-size-fits-all" approach to public engagement for lotteries is unlikely to succeed. The significant variation in agreement across countries highlights the need for culturally sensitive and context-specific communication strategies.
  • Demographic Divides: Support for lotteries is not uniform within countries. Factors like gender (males more supportive), income (higher income more supportive), education (lower education more supportive), and political ideology (right-leaning more supportive) reveal specific demographic groups that might be more receptive to lottery-based allocation.
  • Transparency vs. Optimal Outcomes: The study implicitly touches upon the trade-off between fairness (lottery's transparency) and maximizing benefits (expert committee's potential for optimal outcomes). Public opinion leans towards the latter when it comes to critical medical resources.

Key Results

  • Overall Agreement: Mean agreement with lottery allocation was significantly lower (37.25) compared to expert committee allocation (61.19) across all countries.
  • Country Variation:
    • Lottery Support: Ranged from a low of 21.1 in Chile to a high of 62.33 in India.
  • Expert Committee Support: Ranged from 51.25 in Chile to 69.77 in India.
  • Significant Differences: In almost every country, there was a statistically significant difference in agreement, with expert committee allocation consistently receiving higher support.
  • Demographic Differences: Males, higher-income individuals, those with lower education, and those identifying as politically right-leaning showed greater agreement with lottery allocation.

Limitations and Future Work

The authors acknowledge several limitations:

  • Opt-in Panels: The study relied on opt-in panels, which may be less accurate than probability-based panels. However, they argue that random assignment within the experiment mitigates this, as any errors would likely be distributed evenly.
  • Single Vignette: The study used only one specific scenario (vaccine allocation among nurses). This might not generalize to all contexts where lotteries could be considered.
  • Wording of Expert Committee: The wording of the expert committee vignette might have implied an unrealistic level of certainty in determining who would benefit most, potentially inflating its perceived advantage.
  • Sampling Strategy: While quota sampling was used, it's possible the samples didn't perfectly reflect the broader population.
  • Vaccine Uptake: The study did not assess the downstream effects of allocation mechanisms on vaccine uptake, which could be influenced by perceived fairness.

Future work could explore the receptiveness of various populations to arguments for lotteries, especially in contexts of unequal needs, and investigate effective communication strategies to convey the potential advantages of lotteries. Further research could also examine how different wording or scenarios might influence public agreement.

Summary updated

Abstract

BackgroundBioethicists have advocated lotteries to distribute scarce health care resources, highlighting the benefits that make them attractive amid growing health care challenges. During the COVID-19 pandemic, lotteries were used to distribute vaccines within priority groups in some settings, notably in the United States. Nonetheless, limited evidence exists on public attitudes toward lotteries.MethodsTo assess public support for vaccine allocation by lottery versus expert committee, we conducted a survey-based experiment during the pandemic. Between November 2020 and May 2021, data were collected from 15,380 respondents across 14 diverse countries. Respondents were randomly allocated (1:1) to 1 of 2 hypothetical scenarios involving COVID-19 vaccine allocation among nurses: 1) by lottery and 2) prioritization by a committee of expert physicians. The outcome was agreement on the appropriateness of the allocation mechanism on a scale ranging from 0 (<i>strongly disagree</i>) to 100 (<i>strongly agree</i>), with differences stratified by a range of covariates. Two-sided <i>t</i> tests were used to test for overall differences in mean agreement between lottery and expert committee.FindingsMean agreement with lottery allocation was 37.25 (95% confidence interval [CI] 34.86-39.65), ranging from 21.1 (95% CI 15.07-27.13) in Chile to 62.33 (95% CI 54.45-70.21) in India. In every country, expert committee allocation received higher support, with mean agreement of 61.19 (95% CI: 60.04-62.35), varying from 51.25 in Chile to 69.77 in India. Greater agreement with lotteries was observed among males, higher-income individuals, those with lower education, and those identifying as politically right leaning.ConclusionsDespite arguments for lottery-based allocation of medical resources, we found low overall public support, albeit with substantial variation across countries. Successful implementation of lottery allocation will require targeted public engagement and clear communication of potential benefits.HighlightsThis study surveyed 15,380 respondents from 14 diverse countries during the COVID-19 pandemic, analyzing international agreement with the appropriateness of using lottery allocation for scarce health care resources.There was universal preference for allocating vaccines by expert committee rather than by lotteries, but there was significant variation in agreement between countries, indicating the need for region-specific policy approaches.Successful implementation of lottery allocation requires targeted public engagement and communication of their benefits, especially with groups less supportive of lotteries.
BibTeX
@inproceedings{thomas2025lottery,
  author = {Rhys Thomas and Laurence Roope and Raymond Duch and Thomas Robinson and Alexei Zakharov and Philip Clarke},
  title = {{Lottery or Triage? Controlled Experimental Evidence from the COVID-19 Pandemic on Public Preferences for Allocation of Scarce Medical Resources}},
  booktitle = {Medical},
  year = {2025},
  doi = {10.1177/0272989x251367777},
}
Figure