The Role of Information Boxes in Search Engine Results for Symptom Searches: Analysis of Archival Data

Lorien C Abroms, Elad Yom-TovJMIR Infodemiology 2022 · OpenReview

Abstract

Search engines have introduced health information boxes to provide expert-vetted summaries for common medical symptoms. This study analyzes 28,552 unique Bing searches to understand how users interact with these boxes compared to standard results and advertisements. Findings indicate that information boxes capture the highest share of user attention (25%), and their design—specifically reading ease—can influence search behavior, including reducing clicks on commercial advertisements.

Introduction

When individuals experience new health symptoms, search engines are often their first point of contact. However, the vast amount of online information can lead to "cyberchondria" or the consumption of misinformation. To address this, search engines like Bing and Google have implemented health information boxes—curated summaries that appear alongside search results. While these features are common, empirical data on real-world user interaction has been limited. This research investigates how these "information anchors" influence user attention and click behavior.

Methodology

The researchers analyzed archival, deidentified data from Microsoft Bing searches in the United States between September and November 2019. The dataset comprised 28,552 unique searches for the 17 most common medical symptoms, such as anxiety, cough, and headache.

To measure user attention at scale, the study utilized mouse pointer hover time as a proxy for eye-tracking—a validated metric in information retrieval research. The researchers manually coded the characteristics of the information boxes, assessing "reading ease" via Flesch scores and identifying features like "related conditions." Linear and logistic regressions were used to analyze the time spent on various page elements and the likelihood of clicks.

Figure 1: Example of a Bing search engine results page for "headache," illustrating the various page elements analyzed in the study, including the information box, advertisements, and standard web results.

Key Findings

The study revealed that the information box is the primary driver of attention on the search results page. When all elements were present, users spent 25% of their time (7.1 seconds) on the information box, significantly more than on standard web results (23%), advertisements (20%), or itemized results (10%).

  • Design Influences Engagement: Higher reading ease and the inclusion of "related conditions" were associated with longer hover times.
  • Impact on Ad Clicks: Notably, high-quality information boxes were negatively correlated with clicks on advertisements. This suggests that providing immediate, accessible answers can steer users away from commercialized health content, potentially serving as a public health benefit.
  • Itemized Results Gap: Users spent the least amount of time (10%) on itemized web results, preferring either the high-level curated summary or the full context of a standard link.

Conclusion

Information boxes successfully compete for user attention and serve as a critical tool for providing vetted health information. By optimizing the readability and content of these boxes, search engines can better support users in their health-seeking journeys. Future research should investigate whether these interactions lead to improved real-world medical outcomes and how behaviors might differ across various search platforms.

Summary updated

Abstract

Background: Search engines provide health information boxes as part of search results to address information gaps and misinformation for commonly searched symptoms. Few prior studies have sought to understand how individuals who are seeking information about health symptoms navigate different types of page elements on search engine results pages, including health information boxes.Objective: Using real-world search engine data, this study sought to investigate how users searching for common health-related symptoms with Bing interacted with health information boxes (info boxes) and other page elements.Methods: A sample of searches (N=28,552 unique searches) was compiled for the 17 most common medical symptoms queried on Microsoft Bing by users in the United States between September and November 2019. The association between the page elements that users saw, their characteristics, and the time spent on elements or clicks was investigated using linear and logistic regression.Results: The number of searches ranged by symptom type from 55 searches for cramps to 7459 searches for anxiety. Users searching for common health-related symptoms saw pages with standard web results (n=24,034, 84%), itemized web results (n=23,354, 82%), ads (n=13,171, 46%), and info boxes (n=18,215, 64%). Users spent on average 22 (SD 26) seconds on the search engine results page. Users who saw all page elements spent 25% (7.1 s) of their time on the info box, 23% (6.1 s) on standard web results, 20% (5.7 s) on ads, and 10% (10 s) on itemized web results, with significantly more time on the info box compared to other elements and the least amount of time on itemized web results. Info box characteristics such as reading ease and appearance of related conditions were associated with longer time on the info box. Although none of the info box characteristics were associated with clicks on standard web results, info box characteristics such as reading ease and related searches were negatively correlated with clicks on ads.Conclusions: Info boxes were attended most by users compared with other page elements, and their characteristics may influence future web searching. Future studies are needed that further explore the utility of info boxes and their influence on real-world health-seeking behaviors.JMIR Infodemiology 2022;2(2):e37286doi:10.2196/37286
BibTeX
@inproceedings{abroms2022role,
  author = {Lorien C Abroms and Elad Yom-Tov},
  title = {{The Role of Information Boxes in Search Engine Results for Symptom Searches: Analysis of Archival Data}},
  booktitle = {JMIR Infodemiology},
  year = {2022},
  url = {https://openreview.net/forum?id=8IXmCSeyH8},
}
Figure