Latent Constraints on Unsupervised Text-Graph Alignment with Information Asymmetry

Jidong Tian, Wenqing Chen, Yitian Li, Caoyun Fan, Hao He, Yaohui Jin

Introduction

Unsupervised Text-Graph Alignment (UTGA) aims to bridge the gap between structured knowledge graphs and natural language without relying on parallel datasets. This bidirectional task—converting graphs to text and vice versa—is fundamental for knowledge-grounded reasoning. However, a significant hurdle remains: Information Asymmetry.

In real-world scenarios, a text and its corresponding graph rarely contain identical information. For instance, a sentence might include descriptive "scene information" (e.g., "on a nice Sunday afternoon") that is absent from a logical graph. Conversely, a graph might encode complex logical rules (e.g., the definition of a grandmother) that are implicit in the text. Standard UTGA models often fail because they attempt to force a symmetric, one-to-one mapping between these asymmetric sources.

Information asymmetry in text-graph alignment: text contains scene details (yellow) while the graph contains logical rules (yellow).

The ConstrainedBT Framework

To address this, researchers introduced ConstrainedBT, a framework that explicitly models asymmetric information using latent variable decomposition. The core idea is to categorize information into three distinct types of latent variables:

  1. Transferable Variable (TV): Information shared by both text and graph.
  2. Dependent Variable (DV): Non-transferable information that depends on the shared content (e.g., linguistic style).
  3. Independent Variable (IV): Non-transferable information independent of the shared content (e.g., abstract logical constraints).

Latent Constraints and Disentanglement

ConstrainedBT employs three Variational Auto-Encoder (VAE) based regularizations to manage these variables. The Transferable Constraint (TC) aligns shared info in a common latent space. The Dependent Constraint (DC) uses a Conditional VAE to model format-specific details. Finally, the Independent Constraint (IC) ensures that unique logical rules are preserved even when they aren't present in the text.

Comparison between Disentangling and Entangling conditions in latent variable modeling.

By enforcing a "Disentangling Condition," the model can effectively separate shared semantics ($z$) from format-specific nuances ($z_t, z_g$), allowing the generator to "imagine" missing details during the back-translation process.

Experimental Results

The model was evaluated on three benchmarks: Logic2Text (symmetric), LogicNLI (asymmetric logic), and CLUTRR (kinship reasoning). ConstrainedBT significantly outperformed existing unsupervised baselines like CycleGT and CycleCVAE, particularly on asymmetric tasks:

  • LogicNLI: Achieved a Node F1 score of 65.9, a 12-point improvement over the best baseline.
  • CLUTRR: BLEU-4 scores for text generation jumped from 17.2 to 23.9, demonstrating the model's ability to recover missing scene information.
  • Downstream Impact: Using the learned latent variables as prompts for Natural Language Understanding (NLU) tasks improved LogicNLI accuracy from 51.3% to 74.4%.

Conclusion

ConstrainedBT demonstrates that information asymmetry is not a barrier to be removed, but a feature to be modeled. By decomposing latent spaces into transferable and non-transferable components, the framework achieves state-of-the-art performance in unsupervised alignment. Future work will focus on automating hyperparameter tuning for these constraints and integrating explicit symbolic rules directly into the latent space.

Summary updated

Abstract

Unsupervised text-graph alignment (UTGA) is a fundamental task that bidirectionally generates texts and graphs without parallel data. Most available models of UTGA suffer from information asymmetry, a common phenomenon that texts and graphs include additional information invisible to each other. On the one hand, these models fail to supplement asymmetric information effectively due to the lack of ground truths. On the other hand, it is challenging to indicate asymmetric information with explicit indicators because it cannot be decoupled from the data directly. To address the challenge posed by information asymmetry, we propose the assumption that asymmetric information is encoded in unobservable latent variables and only affects the one-way generation processes. These latent variables corresponding to asymmetric information should obey prior distributions recovered approximately from original data. Therefore, we first propose a taxonomy of the latent variable that classifies the latent variable into transferrable (TV) and non-transferable (NTV) variables and further distinguish NTV as the dependent variable (DV) and the independent variable (IV). Next, we propose three latent VAE-based regularizations on TV, DV, and IV to constrain their distributions to well-designed prior distributions to introduce asymmetric information into models and enhance the preservation of shared contents. Finally, we impose the three proposed constraints on a cycle-consistent learning framework, back-translation (BT), named ConstrainedBT. Experimental results on three UTGA tasks demonstrate the effectiveness of ConstrainedBT on the information-asymmetric challenge.
BibTeX
@inproceedings{tian2023latent,
  author = {Jidong Tian and Wenqing Chen and Yitian Li and Caoyun Fan and Hao He and Yaohui Jin},
  title = {{Latent Constraints on Unsupervised Text-Graph Alignment with Information Asymmetry}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2023},
  doi = {10.1609/aaai.v37i11.26600},
}
Figure