DoodleTunes: Interactive Visual Analysis of Music-Inspired Children Doodles with Automated Feature Annotation
Lists
Only you see this
Abstract
Music and visual arts are essential in children’s arts education, and their integration has garnered significant attention. Existing data analysis methods for exploring audio-visual correlations are limited. Yet, relevant research is necessary for innovating and promoting arts integration courses. In our work, we collected substantial volumes of music-inspired doodles created by children and interviewed education experts to comprehend the challenges they encountered in the relevant analysis. Based on the insights we obtained, we designed and constructed an interactive visualization system DoodleTunes. DoodleTunes integrates deep learning-driven methods for automatically annotating several types of data features. The visual designs of the system are based on a four-level analysis structure to construct a progressive workflow, facilitating data exploration and insight discovery between doodle images and corresponding music pieces. We evaluated the accuracy of our feature prediction results and collected usage feedback on DoodleTunes from five domain experts.
BibTeX
@inproceedings{liu2024doodletunes,
author = {Shuqi Liu and Jia Bu and Huayuan Ye and Juntong Chen and Shiqi Jiang and Mingtian Tao and Liping Guo and Changbo Wang and Chenhui Li},
title = {{DoodleTunes: Interactive Visual Analysis of Music-Inspired Children Doodles with Automated Feature Annotation}},
booktitle = {CHI},
year = {2024},
doi = {10.1145/3613904.3642346},
}Loading related content...