Fidelity and diversity metrics for validating hierarchical synthetic data: Application to residential energy demand
Lists
Only you see this
Abstract
Synthetic data is gaining rapid importance in many application domains due to privacy issues, bias, lack, or simply unavailability of real data. It is important that the synthetic data be a good representation of real data for successfully completing the task at hand. Thus, devising characteristic validation metrics is crucial and remains an open problem in many domains (e.g., image generation). Good validation metrics must be able to disentangle the differences between the quality and the variability coverage of the synthetic data. We propose to use a 3-dimensional metric (precision α, recall β, coverage γ) to describe the fidelity and diversity of the synthetic data. In this paper, we improve on existing definitions of precision, recall, and coverage to extend to large scale time series data. Traditional nearest neighbor manifolds from the literature are replaced by unsupervised learning techniques such as clustering to deal with large scale fine resolution time series while computing the validation metrics. The proposed metrics are employed to validate synthetic data in the domain of residential energy demand. In addition, we extend these definitions to datasets that have a natural hierarchical structure. We propose a hierarchical data-tree model in which precision, recall, and coverage can be computed at multiple inherent (and/or custom) levels of groupings of the data.
BibTeX
@inproceedings{thorve2022fidelity,
author = {Swapna Thorve and Anil Vullikanti and Henning S. Mortveit and Samarth Swarup and Madhav V. Marathe},
title = {{Fidelity and diversity metrics for validating hierarchical synthetic data: Application to residential energy demand}},
booktitle = {IEEE Big Data},
year = {2022},
doi = {10.1109/bigdata55660.2022.10020837},
}Loading related content...