Which Body Is Mine?

Mona Ragab Sayed, Terence Sim, Joo-Hwee Lim, Keng Teck MaWACV 2019 · OpenReview

Abstract

In the light of the human studies that report a strong correlation between head circumference and body size, we propose a new research problem: head-body matching. Given an image of a person's head, we want to match it with his body (headless) image. We propose a dual-pathway framework which computes head and body discriminating features independently, and learns the correlation between such features. We introduce a comprehensive evaluation of our proposed framework for this problem using different features including anthropometric features and deep-CNN features, different experimental setting such as head-body scale variations, and different body parts. We demonstrate the usefulness of our framework with two novel applications: head/body recognition, and T-shirt sizing from a head image. Our evaluations for head/body recognition application on the challenging large scale PIPA dataset (contains high variations of pose, viewpoint, and occlusion) show up to 53% of performance improvement using deep-CNN features, over the global model features in which head and body features are not separated or correlated. For T-shirt sizing application, we use anthropometric features for head-body matching. We achieve promising experimental results on small and challenging datasets.
BibTeX
@inproceedings{sayed2019which,
  author = {Mona Ragab Sayed and Terence Sim and Joo-Hwee Lim and Keng Teck Ma},
  title = {{Which Body Is Mine?}},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year = {2019},
  url = {https://openreview.net/forum?id=NhFAb-vMEPL},
}

Loading related content...

Figure