Clotho Analysis Set

Félix Gontier, Romain Serizel, Huang Xie, Samuel Lipping, Tuomas Virtanen, Konstantinos DrossosZenodo 2022 · DOI · OpenAlex

Abstract

This dataset is derived from the evaluation subset of Clotho dataset. It is designed to analyze the behavior of the captioning system under certain perturbation in order to try and identify some open challenges in automated audio captioning. The original audio clips are transformed with audio_degrader. The transformations applied are the following: Microphone response simulation Mixup with another clip from the dataset (ratio -6dB, -3dB and 0dB) Additive noise from DESED (ratio -12dB, -6dB, 0dB)
BibTeX
@inproceedings{gontier2022clotho,
  author = {Félix Gontier and Romain Serizel and Huang Xie and Samuel Lipping and Tuomas Virtanen and Konstantinos Drossos},
  title = {{Clotho Analysis Set}},
  booktitle = {Zenodo},
  year = {2022},
  doi = {10.5281/zenodo.6604108},
}

Loading related content...

Figure