Knowledge forest: a novel model to organize knowledge fragments

Qinghua Zheng, Jun Liu, Hongwei Zeng, Zhaotong Guo, Bei Wu, Bifan Wei

TL;DR

This paper introduces "Knowledge Forest," a novel model for organizing scattered knowledge fragments by structuring them into "facet trees" and explicitly representing learning dependencies between topics. This approach aims to combat information overload and learning disorientation, demonstrating improved learning performance in experimental evaluations.

What Problem Does This Paper Address?

The paper tackles the growing problem of "knowledge fragmentization" in educational and informational contexts. As knowledge expands, it becomes increasingly scattered across various sources, making it difficult for users to find relevant information (information overload). Furthermore, the inherent relationships and sequential nature of learning are often obscured, leading to confusion and disorientation for learners. Existing knowledge organization models, like simple lists or categorizations, fail to address these challenges effectively because they don't capture the hierarchical (facet) or sequential (learning dependency) aspects of knowledge.

Methods

The core of the paper is the Knowledge Forest model, which comprises two main components:

  • Facet Trees: These organize knowledge fragments within a topic based on "facet hyponymy." This means that different aspects or facets of a topic are structured hierarchically. For example, in the topic "Stack," facets like "operation," "storage," and "property" could form a tree.
  • Learning Dependencies: These explicitly represent the prerequisite relationships between topics. For instance, learning "Linear List" might be a prerequisite for learning "Stack."

The construction of a Knowledge Forest involves three key steps:

  1. Facet Propagation Algorithm: This algorithm identifies relevant facets for each topic by analyzing Wikipedia content and propagating facet similarities between parent-child and brother topics.
  2. Learning Dependency Extraction: This step leverages previous work to identify learning dependencies based on hypotheses about term distribution asymmetry and the locality of dependencies.
  3. Knowledge Fragment Assembly: A Convolutional Neural Network (CNN) based mapping method is used to assign knowledge fragments to their corresponding facets within the facet trees. This involves representing fragments and facet descriptions (Facet Label Texts or FaLTs) using word embeddings and then using a CNN to determine the similarity and assign labels.

The model uses Resource Description Framework (RDF) for knowledge representation and storage, but it aims to be more aligned with human cognition than standard RDF.

Datasets

The paper describes experiments conducted on three courses: Data Structure, Data Mining, and Computer Network. These courses were annotated by ten participants and contained a significant number of topics, knowledge fragments, and learning dependencies.

  • Data Structure: 193 topics, 35,076 knowledge fragments, 247 learning dependencies.
  • Data Mining: 93 topics, 12,723 knowledge fragments, 128 learning dependencies.
  • Computer Network: 84 topics, 13,081 knowledge fragments, 113 learning dependencies.

No new datasets were introduced; existing course materials were used and annotated.

Key Insights and Ideas

  • Explicitly modeling learning dependencies is crucial: Simply organizing knowledge fragments isn't enough; understanding how topics relate sequentially is key to preventing learning disorientation.
  • Facet hyponymy helps combat information overload: By breaking down complex topics into hierarchical facets, users can navigate and find specific information more efficiently.
  • CNNs can effectively map knowledge fragments to facets: The proposed method demonstrates that deep learning can automate the challenging task of assigning scattered pieces of information to their correct conceptual categories.
  • Knowledge Forest aligns better with human cognition: The paper posits that this structured approach, combining facets and dependencies, is more intuitive for human learning than traditional methods.

Key Results

  • Automatic Construction Effectiveness: The automatic construction method achieved an nDCG score of over 82% for facet tree construction and a Macro-F value of over 83% for knowledge fragment assembly across the three courses, indicating good generalization.
  • Learning Performance Improvement: An experimental study with sixty participants (divided into control and experimental groups) showed that participants using the "Yotta" system (based on the Knowledge Forest model) achieved significantly higher learning performance (measured by pre-test and post-test scores) compared to the control group. This suggests the model effectively alleviates information overload and learning disorientation.

Limitations and Future Work

  • Annotation Effort: While the construction is automated, the initial annotation of the datasets by human participants was a significant effort.
  • Generalizability to Other Domains: The experiments were conducted on computer science courses. The effectiveness of the Knowledge Forest model in other domains is not yet demonstrated.
  • Future Work: The paper implies that further exploration of the model's application in different educational contexts and the refinement of the construction algorithms are potential future directions.

Summary updated

Abstract

With the rapid growth of knowledge, it shows a steady trend of knowledge fragmentization. Knowledge fragmentization manifests as that the knowledge related to a specific topic in a course is scattered in isolated and autonomous knowledge sources. We term the knowledge of a facet in a specific topic as a knowledge fragment. The problem of knowledge fragmentization brings two challenges: First, knowledge is scattered in various knowledge sources, which exerts users' considerable efforts to search for the knowledge of their interested topics, thereby leading to information overload. Second, learning dependencies which refer to the precedence relationships between topics in the learning process are concealed by the isolation and autonomy of knowledge sources, thus causing learning disorientation. To solve the knowledge fragmentization problem, we propose a novel knowledge organization model, knowledge forest, which consists of facet trees and learning dependencies. Facet trees can organize knowledge fragments with facet hyponymy to alleviate information overload. Learning dependencies can organize disordered topics to cope with learning disorientation. We conduct extensive experiments on three manually constructed datasets from the Data Structure, Data Mining, and Computer Network courses, and the experimental results show that knowledge forest can effectively organize knowledge fragments, and alleviate information overload and learning disorientation.
BibTeX
@article{zheng2019knowledge,
  author = {Qinghua Zheng and Jun Liu and Hongwei Zeng and Zhaotong Guo and Bei Wu and Bifan Wei},
  title = {{Knowledge forest: a novel model to organize knowledge fragments}},
  journal = {Science China Information Sciences},
  year = {2019},
  url = {https://openreview.net/forum?id=JzBBGOovEg},
}
Figure