Introduction
In sectors like healthcare and government, privacy concerns often restrict the release of comprehensive datasets, leading to a state of "data poverty." For instance, the US Census Bureau might only release a 1% sample of its records. Training machine learning models on such limited data often results in poor generalization and inaccuracy. Standard data augmentation techniques, such as SMOTE or traditional Generative Adversarial Networks (GANs), frequently fail to capture global statistical properties or respect the logical constraints inherent in relational data, known as Functional Dependencies (FDs).
Methodology: The ITS-GAN Framework
To address these challenges, we introduce ITS-GAN (Incomplete Table Synthesis GAN). This framework is designed to augment small, incomplete tabular datasets by ensuring synthetic records adhere to both global statistical averages and strict relational rules.
The core innovations of ITS-GAN include:
- FD Modeling with Autoencoders: Since discrete logical constraints like $A \rightarrow B$ are difficult to integrate into neural networks directly, ITS-GAN uses dedicated autoencoders for each FD. These models learn to reconstruct dependent values; high reconstruction error indicates a violation of the relational rule.
- Constraint-Aware Loss Function: The generator's loss is augmented with an $\alpha$-term to match known global column-wise averages and a $\beta$-term to penalize FD violations detected by the autoencoders.
- Enhanced Discriminator: The discriminator receives FD error terms as additional inputs, forcing the generator to produce logically consistent data to avoid detection.
Experimental Setup
The framework was evaluated on two real-world datasets:
- US Census Bureau Data: Used to predict "hours-per-week" with an enforced FD: (gender, relationship) $\rightarrow$ marital-status.
- US Bureau of Transportation Statistics (BTS): Used to predict "ticket price" with an enforced FD: (source/destination airports, flown distance) $\rightarrow$ overall distance.
In both scenarios, "data poverty" was simulated by providing only 1% or 5% of the original records for training.
Results and Discussion
ITS-GAN consistently outperformed state-of-the-art methods like TableGAN and SMOTE in classification accuracy. A key finding was that a model trained on a 1% sample augmented by ITS-GAN often matched or exceeded the performance of a model trained on a real 15% sample, effectively "filling in" the missing distribution.
As shown in the CDF plots, ITS-GAN's synthetic data follows the "true" full-table distribution much more closely than competitors, which tend to overfit the small released sub-table. By turning discrete logical constraints into differentiable error terms, ITS-GAN successfully balances visual similarity, global statistical alignment, and relational integrity.
Conclusion
ITS-GAN provides a robust solution for generating high-fidelity synthetic relational data under conditions of data scarcity. While it currently requires pre-defined FDs and uses basic categorical encoding, it represents a significant step forward in functional dependency-preserving data synthesis. Future work will explore handling unknown or "soft" dependencies and more complex categorical embeddings.
Summary updated