Exploiting the deep web with DynaBot: matching, probing, and ranking

Daniel Rocco, James Caverlee, Ling Liu, Terence Critchlow

Abstract

We present the design of Dynabot, a guided Deep Web discovery system. Dynabot's modular architecture supports focused crawling of the Deep Web with an emphasis on matching, probing, and ranking discovered sources using two key components: service class descriptions and source-biased analysis. We describe the overall architecture of Dynabot and discuss how these components support effective exploitation of the massive Deep Web data available.
BibTeX
@inproceedings{rocco2005exploiting,
  author = {Daniel Rocco and James Caverlee and Ling Liu and Terence Critchlow},
  title = {{Exploiting the deep web with DynaBot: matching, probing, and ranking}},
  booktitle = {The Web Conference},
  year = {2005},
  doi = {10.1145/1062745.1062925},
}

Loading related content...

Figure