Page-level template detection via isotonic smoothing

Deepayan Chakrabarti, Ravi Kumar, Kunal PuneraWWW 2007 · OpenReview

Abstract

We develop a novel framework for the page-level template detection problem. Our framework is built on two main ideas. The first is theautomatic generation of training data for a classifier that, given apage, assigns a templateness score to every DOM node of the page. The second is the global smoothing of these per-node classifier scores bysolving a regularized isotonic regression problem; the latter follows from a simple yet powerful abstraction of templateness on a page. Our extensive experiments on human-labeled test data show that our approachdetects templates effectively.
BibTeX
@inproceedings{chakrabarti2007page,
  author = {Deepayan Chakrabarti and Ravi Kumar and Kunal Punera},
  title = {{Page-level template detection via isotonic smoothing}},
  booktitle = {The Web Conference},
  year = {2007},
  url = {https://openreview.net/forum?id=rJbsNzZdZr},
}

Loading related content...

Figure