Gugak-VocalSet: A Multi-Genre Studio-Quality Dataset of Korean Traditional Singing with Sigimsae Annotations

Danbinaerin Han, Wonil Kim, Seah Hong, Dongjoo Moon, Jaeok Lee, Jongpil Lee, Chaewon Kim, Juhan NamarXiv 2026 · arXiv

TL;DR

Gugak-VocalSet is the first large-scale, publicly available audio dataset for Korean traditional singing, featuring 24.5 hours of studio-quality solo vocal recordings. Its core contribution is a unified ontology and dense expert annotations of sigimsae—the intricate, constitutive pitch inflections that define the melodic identity of the Korean tradition.

What Problem Does This Paper Address?

In Korean traditional music (Gugak), pitch expression is not merely decorative; it is structural. These expressions, known as sigimsae, encompass the slides, vibratos, and flicking gestures that shape a melody. However, computational research in this field has been hamstrung by two major obstacles:

  1. Data Scarcity: Most high-quality Gugak recordings are either commercially restricted or consist of field recordings with instrumental accompaniment, making solo vocal analysis nearly impossible.
  2. Lack of Standardization: Sigimsae terminology varies wildly across different genres and lineages. Historically, these ornaments have been documented via subjective text or staff notation, which fails to capture the continuous, nuanced audio reality.

The authors address these gaps by providing a curated, high-fidelity dataset with a standardized annotation framework that works across multiple genres.

Methods

The researchers recorded 20 professional singers in a controlled studio environment. To facilitate corpus-level comparison, they used a "fixed-tonic and fixed-tempo" protocol, providing singers with a reference pitch (cheong) and a metronome.

The most significant methodological contribution is the Unified Sigimsae Ontology. The team moved away from genre-specific jargon to create a hierarchy based on the functional position of the ornament within a melodic line:

  • Onset: Slides or turns at the start of a note.
  • Mid-note: Vibrato (yoseong) or rolls during the note.
  • Offset: Slides or "sharp cuts" at the end of a note.
  • Transition: Snaps between notes.
The 17 sigimsae types in the unified ontology grouped by functional position.

For evaluation, the authors tested task-specific CNNs (using F0 and Mel-spectrogram inputs) against state-of-the-art music foundation models like MERT and its culturally-adapted variant, CultureMERT.

Datasets

The paper introduces Gugak-VocalSet, which consists of:

  • 305 tracks (24.5 hours) of unaccompanied solo vocals.
  • Genre Hierarchy: Includes Jeongak (court/literati music) and Minsogak (folk music/pansori).
  • Annotations: Approximately 68,000 segments (71,700 instances) labeled by 14 experts.
  • Metadata: Includes lyrics (phrase-level alignment), mood (80 tags), and timbre (38 tags).
Figure 1: Genre hierarchy of Gugak-VocalSet. Numbers show track counts per category.

Key Insights and Ideas

  • Domain Knowledge Beats Scale: A relatively small, task-specific CNN using domain-informed F0 (pitch) representations outperformed massive, general-purpose foundation models in classifying sigimsae. This suggests that for highly specialized musical traditions, "more data" isn't always better than "better features."
  • Pitch vs. Spectrum: The researchers found a functional split in audio features. Pitch (F0) is the primary driver for identifying what an ornament is (identity), while spectral cues (Mel-spectrograms) are superior for detecting where an ornament begins and ends (localization).
  • The "Culture Gap" in AI: Interestingly, CultureMERT—which was pre-trained on non-Western traditions like Indian and Turkish music—underperformed the standard MERT. This highlights that Korean music has unique acoustic characteristics that aren't automatically captured by simply training on "non-Western" data generally.

Key Results

  • Classification: The F0-based CNN achieved a Macro F1 of 0.441, significantly higher than the best-performing frozen MERT layer (0.358).
  • Event Detection: A lightweight EDTCN (Temporal Convolutional Network) using Mel-spectrograms matched or slightly exceeded MERT's performance on event-level metrics (0.763 vs 0.756 Ev.F1) while using less than 2% of the parameter cost.
  • Annotation Density: The dataset provides a massive leap in granularity, as shown in the distribution of the 17 sigimsae types.
Annotation count and duration distribution per sigimsae type.

Limitations and Future Work

The authors acknowledge that the fixed-tempo/fixed-tonic recording protocol is somewhat "unnatural" for traditional singers, who usually employ flexible timing and tuning. This was a necessary trade-off for scientific reproducibility but may limit the "expressive freedom" captured in the audio.

Future work includes:

  • Developing models that can handle multi-label segments (where two ornaments overlap).
  • Applying the dataset to generative tasks, such as high-fidelity singing voice synthesis that can realistically replicate sigimsae.
  • Expanding the ontology to include more granular, genre-specific vocal production techniques (e.g., seong-eum).

Summary updated

Abstract

We present Gugak-VocalSet, the first publicly available audio dataset for Korean traditional singing with dense annotations of sigimsae, a structured pitch contour system of vocal expressions. Gugak-VocalSet contains 24.5 hours of unaccompanied solo vocal recordings across 305 tracks of representative repertoire curated by the National Gugak Center, performed by 20 professional singers in a controlled studio environment with fixed key and tempo. In addition to genre, lyrics, and mood/timbre tags, the dataset provides a unified sigimsae ontology and approximately 68,000 segments (71,700 instances including multi-label) of audio-grounded sigimsae annotations; the ontology adopts a functional-position-based hierarchy designed for consistent application across genres, and 14 expert annotators specializing in Korean traditional music performed segment-level labeling accordingly. Baseline experiments on sigimsae classification and event detection show that domain-informed F0 representations remain competitive with, and on classification surpass, frozen probing of a general-purpose music foundation model, while pitch and spectral cues play complementary roles in event-level detection. Companion page: https://www.danbinaerin.com/Gugak-VocalSet/
BibTeX
@misc{han2026gugak,
  author = {Danbinaerin Han and Wonil Kim and Seah Hong and Dongjoo Moon and Jaeok Lee and Jongpil Lee and Chaewon Kim and Juhan Nam},
  title = {{Gugak-VocalSet: A Multi-Genre Studio-Quality Dataset of Korean Traditional Singing with Sigimsae Annotations}},
  year = {2026},
  eprint = {2610.15350},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.15350},
}
Figure