Towards Age-friendly E-commerce Through Crowd-Improved Speech Recognition, Multimodal Search, and Personalized Speech Feedback

Lei Meng, Nguyen Quy Hy, Xiaohai Tian, Zhiqi Shen, Eng Siong Chng, Frank Yunqing Guan, Chunyan Miao, Cyril Leung

Abstract

This paper presents an age-friendly system for improving the elderly's online shopping experience. Different from most related studies focusing on website design and content organization, we propose to integrate three assistive techniques to facilitate the elderly's browsing of products in E-commerce platforms, including the crowd-improved speech recognition, the multimodal search, and the personalized speech feedback. The first two techniques, namely, the crowd-improved speech recognition and the multimodal search, work together to allow the elderly search for desired products flexibly using either speech, an image, text, or any combination of them whichever are convenient for the elderly. The personalized speech feedback provides a speech summary of search result in a personalized voice. That is, the elderly are allowed to choose or even create their desired voices, and also can customize the voices in terms of pitch, speaking speed, and loudness. As a whole, the proposed system is expected to help and engage the elderly's E-commerce adoption. Testing on real-world E-commerce product datasets demonstrated the usability of the proposed system.
BibTeX
@inproceedings{meng2017towards,
  author = {Lei Meng and Nguyen Quy Hy and Xiaohai Tian and Zhiqi Shen and Eng Siong Chng and Frank Yunqing Guan and Chunyan Miao and Cyril Leung},
  title = {{Towards Age-friendly E-commerce Through Crowd-Improved Speech Recognition, Multimodal Search, and Personalized Speech Feedback}},
  booktitle = {ICCSE},
  year = {2017},
  doi = {10.1145/3126973.3129306},
}

Loading related content...

Figure