Attribute Acquisition in Ontology based on Representation Learning of Hierarchical Classes and Attributes

Tianwen Jiang, Ming Liu, Bing Qin, Ting LiuarXiv 2019 · arXiv

Introduction

Building a comprehensive ontology—a formal map of concepts and their relationships—is a fundamental yet labor-intensive task in knowledge engineering. A critical bottleneck in automating this process is attribute acquisition: determining which specific properties (e.g., "director," "sugar content," or "CEO") should be associated with a given class. Traditional data-driven approaches often falter when encountering multi-role entities. For instance, the entity "Apple" can represent both a fruit and a multinational technology company. Without contextual awareness, automated systems produce a noisy mixture of irrelevant attributes.

The TransATT model addresses this by representing classes as "class-paths" and employing selective attention to disentangle these roles, ensuring that attributes are correctly mapped based on the entity's hierarchical lineage.

Methodology: The TransATT Model

TransATT combines sequence modeling with translation-based embeddings to capture the full context of an ontology's hierarchy.

The TransATT architecture uses LSTMs to encode class-paths and a selective attention mechanism to map them to attributes.

The model follows a three-step process:

  1. Class-Path Encoding via LSTM: Rather than treating a class as an isolated keyword, TransATT represents it as a sequence of nodes from the root to the leaf (e.g., /thing/biology/plant/fruit). A Long Short-Term Memory (LSTM) network encodes these paths into continuous vectors, preserving the hierarchical context.
  2. Translation-Based Embedding: Inspired by the TransE framework, attribute acquisition is modeled as a translation task ($pM_a = a$). A class-path vector ($p$) is transformed via a mapping matrix ($M_a$) to predict a target attribute vector ($a$).
  3. Selective Attention: To handle multi-role entities that belong to multiple class-paths, the model uses an attention mechanism to weigh the relevance of each path to a specific attribute. This allows the model to "ignore" the fruit-related path when learning about corporate attributes like "stock price."

Dataset: BigCilin11K

To evaluate the model, the researchers introduced BigCilin11K, a large-scale Chinese dataset derived from the BigCilin knowledge base. It contains 11,161 entities, 5,174 unique class-paths, and 286 distinct attributes. This dataset enables testing on two primary tasks: Attribute Prediction for Entities (APE) and Attribute Prediction for Class-Paths (APC).

Key Insights and Results

The core strength of TransATT lies in its ability to perform contextual disambiguation. By leveraging the entire lineage of a class, the model gains a more precise semantic grounding than single-word definitions can provide.

Heatmaps demonstrating how the selective attention mechanism correctly associates attributes with specific class-paths for multi-role entities like "Apple."

Empirical results highlight the model's effectiveness:

  • APE Task: The model achieved a Hits@20 of nearly 76% overall, with performance exceeding 89% for "Person" entities.
  • APC Task: Testing on unseen class-paths yielded a mean Precision@1 (P@1) of 78.26%, demonstrating that the learned representations generalize effectively to new parts of the ontology.
  • Denoising: Qualitative analysis through heatmaps (see above) confirms that the attention mechanism successfully focuses on the correct class-path for a given attribute, effectively denoising real-world data where entities are linked to diverse, often conflicting, information.

Limitations and Future Directions

While TransATT shows significant promise, manual evaluation remains a bottleneck due to the lack of a "gold standard" complete dataset for Chinese class-attribute pairs. Additionally, while the methodology is language-agnostic, the current implementation is tailored to Chinese taxonomies. Future research could explore integrating TransATT into dynamic systems that update ontologies in real-time as new entities and categories emerge.

Summary updated

Abstract

Attribute acquisition for classes is a key step in ontology construction, which is often achieved by community members manually. This paper investigates an attention-based automatic paradigm called TransATT for attribute acquisition, by learning the representation of hierarchical classes and attributes in Chinese ontology. The attributes of an entity can be acquired by merely inspecting its classes, because the entity can be regard as the instance of its classes and inherit their attributes. For explicitly describing of the class of an entity unambiguously, we propose class-path to represent the hierarchical classes in ontology, instead of the terminal class word of the hypernym-hyponym relation (i.e., is-a relation) based hierarchy. The high performance of TransATT on attribute acquisition indicates the promising ability of the learned representation of class-paths and attributes. Moreover, we construct a dataset named \textbf{BigCilin11k}. To the best of our knowledge, this is the first Chinese dataset with abundant hierarchical classes and entities with attributes.
BibTeX
@misc{jiang2019attribute,
  author = {Tianwen Jiang and Ming Liu and Bing Qin and Ting Liu},
  title = {{Attribute Acquisition in Ontology based on Representation Learning of Hierarchical Classes and Attributes}},
  year = {2019},
  eprint = {1903.03282},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1903.03282},
}
Figure