Knowledge-aware Multimodal Fashion Chatbot
Lists
Only you see this
Abstract
Multimodal fashion chatbot provides a natural and informative way to fulfill customers' fashion needs. However, making it 'smart' in generating substantive responses remains a challenging problem. In this paper, we present a multimodal domain knowledge enriched fashion chatbot. It forms a taxonomy-based learning module to capture the fine-grained semantics in images and leverages an end-to-end neural conversational model to generate responses based on the conversation history, visual semantics, and domain knowledge. To avoid inconsistent dialogues, deep reinforcement learning method is used to further optimize the model.
BibTeX
@inproceedings{liao2018knowledge,
author = {Lizi Liao and You Zhou and Yunshan Ma and Richang Hong and Tat-Seng Chua},
title = {{Knowledge-aware Multimodal Fashion Chatbot}},
booktitle = {ACM Multimedia},
year = {2018},
doi = {10.1145/3240508.3241399},
}Loading related content...