The effectiveness of public health advertisements to promote health: a randomized-controlled trial on 794, 000 participants

Elad Yom-Tov, Jinia Shembekar, Sarah Barclay, Peter MuennigNpj Digit. Medicine 2018 · DOI · OpenReview

Introduction

Traditional public health campaigns, such as billboards and television spots, often struggle with high costs, limited personalization, and measurement difficulties. In contrast, private corporations leverage big data and predictive analytics to micro-target consumers with high precision. This study explores whether these same digital marketing tools can be repurposed to "nudge" public health behaviors effectively and at scale.

Methods and Study Design

The researchers conducted a large-scale Randomized Controlled Trial (RCT) using Microsoft’s Bing search engine. The study identified users searching for "trigger" terms related to metabolic health (e.g., "high blood pressure," "healthy diet"). Eligible users were randomized into a treatment group, shown professionally developed health advertisements based on the Fogg Behavior Model, or a control group shown standard "status quo" ads.

Figure 1: CONSORT flow diagram illustrating the enrollment, allocation, and analysis phases of the study.

The intervention focused on providing a behavioral "trigger" at the moment of high motivation. Crucially, the study tracked search behavior for one month before and after the intervention to measure sustained interest in health-promoting activities, rather than just immediate click-through rates.

Population and Datasets

The trial involved a massive dataset of over 794,000 initial participants. After screening for eligibility and consistent tracking, the final analysis included a robust sample across various demographics.

Table 1: Demographic distribution of the study population by age group and gender for both control and treatment groups.

Key Results

The intervention yielded a significant impact on user behavior. Exposure to targeted health ads led to a 50% relative increase in future searches for weight loss or exercise information (48% in the treatment group vs. 32% in the control group).

Other notable findings include:

  • The "View-Through" Effect: Behavioral shifts occurred even without ad clicks. Only 36 tracked users clicked the ads, yet the group as a whole showed significant changes in intent, suggesting that mere exposure to health messaging is powerful.
  • Frequency and Recency: Repeated exposure (more than one ad) increased the likelihood of future health searches by 11%.
  • Demographic Variance: Response rates varied by age and gender. For example, females were less likely than males to perform subsequent health searches after exposure (HR = 0.84), highlighting the need for gender-specific creative strategies.

Insights and Precision Targeting

The study demonstrated that lifestyle preferences and sociodemographic characteristics explained nearly half (49%) of the variation in user response. Precision targeting was particularly effective for "uninitiated" users—those with no prior history of health searches—where the ads doubled the likelihood of future health-related queries.

Conclusion and Limitations

This research proves that algorithmic bidding systems can be used by public health agencies to "outmaneuver" less healthy commercial influences. While the study was limited to the Bing platform and faced ethical questions regarding data collection without explicit consent, it provides a scalable framework for modern public health interventions. Future work should focus on real-time "stepping up" algorithms that adjust ad intensity based on user readiness for behavior change.

Summary updated

Abstract

As public health advertisements move online, it becomes possible to run inexpensive randomized-controlled trials (RCTs) thereof. Here we report the results of an online RCT to improve food choices and integrate exercise into daily activities of internet users. People searching for pre-specified terms were randomized to receive one of several professionally developed campaign advertisements or the “status quo” (ads that would otherwise have been served). For 1-month pre-intervention and post-intervention, their searches for health-promoting goods or services were recorded. Our results show that 48% of people who were exposed to the ads made future searches for weight loss information, compared with 32% of those in the control group—a 50% increase. The advertisements varied in efficacy. However, the effectiveness of the advertisements may be greatly improved by targeting individuals based on their lifestyle preferences and/or sociodemographic characteristics, which together explain 49% of the variation in response to the ads. These results demonstrate that online advertisements hold promise as a mechanism for changing population health behaviors. They also provide researchers powerful ways to measure and improve the effectiveness of online public health interventions. Finally, we show that corporations that use these sophisticated tools to promote unhealthy products can potentially be outbid and outmaneuvered. People who see specific health-promoting messages after searching online for weight-related terms are more likely to subsequently search for information on weight loss interventions. A team led by Elad Yom-Tov from Microsoft Research Israel in Herzeliya conducted a randomized trial involving 794,000 users of the Bing search engine who queried terms related to weight, diet, and exercise. Randomly chosen subjects were shown advertisements designed to promote healthy living, while all other users were shown standard ads. The researchers found that 48% of people exposed to the health-promoting advertisements made searches within the next month for weight loss information, compared with only 32% of those in the control group. The findings suggest that targeted online messaging can help change population health behaviors.
BibTeX
@article{yomtov2018effectiveness,
  author = {Elad Yom-Tov and Jinia Shembekar and Sarah Barclay and Peter Muennig},
  title = {{The effectiveness of public health advertisements to promote health: a randomized-controlled trial on 794, 000 participants}},
  journal = {Npj Digit. Medicine},
  year = {2018},
  doi = {10.1038/s41746-018-0031-7},
}
Figure