Evaluating whole-page relevance

Peter Bailey, Nick Craswell, Ryen W. White, Liwei Chen, Ashwin Satyanarayana, Seyed M. M. Tahaghoghi

Abstract

Whole page relevance defines how well the surface-level repre-sentation of all elements on a search result page and the corre-sponding holistic attributes of the presentation respond to users' information needs. We introduce a method for evaluating the whole-page relevance of Web search engine results pages. Our key contribution is that the method allows us to investigate aspects of component relevance that are difficult or impossible to judge in isolation. Such aspects include component-level information redundancy and cross-component coherence. The method we describe complements traditional document relevance measurement, affords comparative relevance assessment across multiple search engines, and facilitates the study of important factors such as brand presentation effects and component-level quality.
BibTeX
@inproceedings{bailey2010evaluating,
  author = {Peter Bailey and Nick Craswell and Ryen W. White and Liwei Chen and Ashwin Satyanarayana and Seyed M. M. Tahaghoghi},
  title = {{Evaluating whole-page relevance}},
  booktitle = {International ACM SIGIR Conference on Research and Development in Information Retrieval},
  year = {2010},
  doi = {10.1145/1835449.1835606},
}

Loading related content...

Figure