Gradient field descriptor for sketch based retrieval and localization

Rui Hu, Mark Barnard, John P. CollomosseICIP 2010 · OpenReview

Abstract

We present an image retrieval system driven by free-hand sketched queries depicting shape. We introduce Gradient Field HoG (GF-HOG) as a depiction invariant image descriptor, encapsulating local spatial structure in the sketch and facilitating efficient codebook based retrieval. We show improved retrieval accuracy over 3 leading descriptors (Self Similarity, SIFT, HoG) across two datasets (Flickr160, ETHZ extended objects), and explain how GF-HOG can be combined with RANSAC to localize sketched objects within relevant images. We also demonstrate a prototype sketch driven photo montage application based on our system.
BibTeX
@inproceedings{hu2010gradient,
  author = {Rui Hu and Mark Barnard and John P. Collomosse},
  title = {{Gradient field descriptor for sketch based retrieval and localization}},
  booktitle = {ICIP},
  year = {2010},
  url = {https://openreview.net/forum?id=qKASy2QGGjGk},
}

Loading related content...

Figure