Device Fabrication Knowledge Extraction from Materials Science Literature

Neelanshi Wadhwa, Sarath S, Sapan Shah, Sreedhar Reddy, Pritwish Mitra, Deepak Jain, Beena RaiAAAI 2021 · DOI

Introduction

In the field of materials science, the precise "recipes" for fabricating devices—such as perovskite solar cells or lithium-ion batteries—are typically documented in the unstructured prose of academic publications. These procedures are highly sensitive; minor variations in operation sequences, temperatures, or chemical concentrations can significantly impact a device's final performance.

Currently, researchers must manually survey vast amounts of literature to identify viable fabrication routes, as no specialized search engine exists that understands the relationships between operations (e.g., "spin-coating"), materials (e.g., "PbI2 solution"), and specific parameters (e.g., "8000 rpm"). This research addresses this gap by automating the extraction of multi-step fabrication procedures into a machine-readable knowledge graph.

Methodology

The proposed system utilizes a multi-stage pipeline grounded in a custom ontology that defines entities (e.g., Operation, Material, Apparatus, Condition) and their interrelationships.

  1. Relevance Classification: A Hierarchical Attention Network (HAN) filters the corpus to identify paragraphs specifically describing experimental procedures.
  2. Entity Extraction: A BiLSTM-CRF architecture identifies domain-specific entities. The pipeline leverages pre-trained language models like Mat-ELMo and SciBERT, which are specifically trained on scientific corpora and outperform general-purpose models in this niche domain.
  3. Relation Extraction: A hybrid approach is employed. Deep learning models handle complex relationships (e.g., identifying input materials vs. byproducts), while pattern-based models (regular expressions over dependency trees) are used for more structured links, such as connecting an operation to its specific temperature or apparatus.
  4. Procedure Sequencing: An unsupervised algorithm chains individual operations into a chronological sequence, effectively reconstructing the experimental timeline from the text.
Example of a structured knowledge graph extracted from a fabrication procedure, illustrating the relationships between devices, operations, materials, and parameters.

Evaluation and Key Results

The system was evaluated using a corpus of 250 research articles focused on Perovskite Solar Cells (PSCs), with 132 articles manually annotated by experts. The resulting dataset contains over 18,000 entity and 15,000 relation annotations.

  • Relevance Classification: The model achieved an F1-score of 0.80 in identifying fabrication-heavy text.
  • Entity Extraction: The system reached peak F1-scores of 0.72 (strict matching) and 0.75 (relaxed matching) using Mat-ELMo embeddings, underscoring the importance of domain-specific pre-training.
  • Relation Extraction: Evaluation revealed that pattern-based models are exceptionally effective for well-defined linguistic structures. For instance, the opMethod relation (linking an operation to a method) achieved an F1-score of 0.91.
  • Procedure Sequencing: The unsupervised ordering algorithm achieved an F1-score of 0.86, demonstrating its ability to accurately reconstruct experimental timelines.
Detailed performance metrics for relation extraction, comparing supervised deep learning, pattern-based, and unsupervised methods.

Discussion and Future Work

A key insight from this work is the effectiveness of hybrid systems. While deep learning is powerful, hand-crafted linguistic patterns remain superior for certain structured scientific relations. Furthermore, the system identified a significant challenge in "implicit information"—details often omitted by authors because they are considered "obvious" to human experts.

The primary limitation remains error propagation across the pipeline; inaccuracies in entity identification necessarily degrade subsequent relation extraction. Future work will focus on developing a "Decision Support Layer" to allow researchers to query the knowledge graph for optimized fabrication routes based on specific performance targets, such as voltage or efficiency.

Summary updated

BibTeX
@inproceedings{wadhwa2021device,
  author = {Neelanshi Wadhwa and Sarath S and Sapan Shah and Sreedhar Reddy and Pritwish Mitra and Deepak Jain and Beena Rai},
  title = {{Device Fabrication Knowledge Extraction from Materials Science Literature}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2021},
  doi = {10.1609/aaai.v35i17.17811},
}
Figure