Dress With Style: Learning Style From Joint Deep Embedding of Clothing Styles and Body Shapes

Shintami Chusnul Hidayati, Ting Wei Goh, Ji-Sheng Gary Chan, Cheng-Chun Hsu, John See, Lai-Kuan Wong, Kai‐Lung Hua, Yu Tsao, Wen-Huang ChengIEEE Trans. Multimedia 2020 · DOI

Abstract

Body shape is about proportion, and fashion style is all about dressing those proportions to look their very best. Figuring out the styles to suit a body shape can be a daunting task for many people. It is, therefore, essential to develop a framework for learning the compatibility of body shapes and clothing styles. Though fashion designers and fashion stylists have analyzed the correlation between human body shapes and fashion styles for a long time, this issue did not receive much attention in multimedia science. In this paper, we present a novel style recommender, on the basis of the user's body attributes. The rich amount of fashion styling knowledge from social big data is exploited for this purpose. We first construct a joint embedding of clothing styles and human body measurements with deep multimodal representation learning on a reference dataset that has been sorted to meet the fashion rules. We then discover the relevant semantic features by propagation and selection in clothing style and body shape graphs. Experiments demonstrate the effectiveness of the proposed framework when compared with several baseline methods.
BibTeX
@article{hidayati2020dress,
  author = {Shintami Chusnul Hidayati and Ting Wei Goh and Ji-Sheng Gary Chan and Cheng-Chun Hsu and John See and Lai-Kuan Wong and Kai‐Lung Hua and Yu Tsao and Wen-Huang Cheng},
  title = {{Dress With Style: Learning Style From Joint Deep Embedding of Clothing Styles and Body Shapes}},
  journal = {IEEE Transactions on Multimedia},
  year = {2020},
  doi = {10.1109/tmm.2020.2980195},
}

Loading related content...

Figure