Reshaping MOFs synthesis conditions mining with a dynamic multi-agents framework of large language model

Zuhong Lin, Daoyuan Ren, K. Ran, Jing Sun, Songlin Yu, Xuefeng Bai, X. D. Huang, Haiyang He, Peng‐Zhi Pan, Ying Fang, Zhanglin Li, Haipu Li, Jingjing Yao

TL;DR

This paper introduces MOFh6, an innovative LLM-powered multi-agent system that revolutionizes the extraction of metal-organic framework (MOF) synthesis information from scientific literature. By overcoming challenges like scattered data and inconsistent terminology, MOFh6 provides a structured, efficient, and cost-effective way to access and utilize MOF synthesis knowledge, accelerating materials discovery.

What Problem Does This Paper Address?

Identifying accurate synthesis conditions for Metal-Organic Frameworks (MOFs) is crucial for experimental design and materials discovery. However, this process is hampered by the unstructured and heterogeneous nature of scientific texts. Information is often spread across different paragraphs, uses ambiguous abbreviations, and employs diverse linguistic styles, making it difficult to extract and standardize. Traditional NLP methods struggle with this complexity, requiring extensive manual effort and coding. This bottleneck hinders the translation of literature-derived knowledge into actionable insights for MOF synthesis.

Methods

MOFh6 employs a sophisticated multi-agent architecture built upon Large Language Models (LLMs), specifically fine-tuned GPT-40-mini. The system is designed with a hierarchical structure, involving a "Directorate" (LLMs), a "CEO" (coordination via LangGraph), a "CMO" (data management), a "COO" (human experts for annotation), and a "CTO" (LLM agents for technical implementation).

Key methodological components include:

  • Literature Crawling: An automated system to acquire full-text articles and supplementary materials.
  • Synthesis Data Parsing: LLM agents that extract synthesis paragraphs, resolve cross-paragraph references, and handle ambiguous abbreviations.
  • Table Data Parsing: Agents that extract information from tables and convert it into structured formats.
  • Chemical Abbreviation Resolution: A specialized agent using regular expressions and LLMs to map abbreviations (e.g., HxLx) to their full chemical names.
  • Crystal Data Comparison: A system that matches literature data with CCDC database entries based on lattice parameters and chemical composition.
  • Structured Conversion: Agents that organize extracted information into standardized Markdown tables.
  • Dynamic Context-Aware Architecture: The system maintains conversation history to understand user intent and provide relevant responses.
  • Prompt Engineering and Fine-tuning: Extensive use of carefully designed prompts and fine-tuning with expert-annotated data to enhance LLM performance and reduce hallucination.

Datasets

The paper mentions the use of expert-annotated datasets for fine-tuning the LLM agents. Specifically, datasets containing 50, 99, and 198 sets of expert-annotated texts were used, randomly allocated to training, validation, and test sets in an 8:1:1 ratio. The evaluation also involved a group of four human experts annotating 100 MOFs from five major publishers. The CCDC database was used for crystallographic data.

Key Insights and Ideas

  • LLMs as Dynamic Agents: MOFh6 moves beyond static LLM applications by orchestrating multiple LLM agents in a collaborative, dynamic workflow, enabling complex task decomposition and execution.
  • Bridging the Gap: The system effectively bridges the gap between unstructured scientific literature and actionable synthesis protocols, democratizing access to MOF synthesis knowledge.
  • Cost and Efficiency Revolution: By automating extraction and leveraging LLMs, MOFh6 significantly reduces the cost and time required for MOF synthesis data mining, making it more accessible for researchers.
  • Handling Ambiguity and Heterogeneity: The multi-agent approach, combined with specialized modules for abbreviation resolution and cross-paragraph fusion, effectively tackles the inherent ambiguity and heterogeneity in chemical literature.

Key Results

  • High Accuracy: MOFh6 achieves 99% accuracy in synthesis data parsing.
  • Abbreviation Resolution: It resolves 94.1% of complex co-reference abbreviations.
  • Processing Speed: A single full-text document is processed in 9.6 seconds, and structured synthesis descriptions are localized within 36 seconds.
  • Cost-Effectiveness: Processing 100 papers costs only $4.24, representing a 76% saving compared to existing systems.
  • Precision: Maintains a precision of 0.93 ± 0.01 for synthesis descriptions.

Limitations and Future Work

  • Third-Party Tool Compatibility: The current system is limited by the compatibility of third-party tools for dynamic data source integration.
  • Future Work: The authors plan to achieve seamless integration of CSD-Python-API and the LLM ecosystem through architectural upgrades, aiming to advance material development towards a fully digitalized stage of flexible human-machine interaction.

Summary updated

Abstract

Accurately identifying the synthesis conditions of metal-organic frameworks (MOFs) is essential for guiding experimental design, yet remains challenging because relevant information in the literature is often scattered, inconsistent, and difficult to interpret. We present MOFh6, a large-language-model-driven system that reads raw articles or crystal codes and converts them into standardized synthesis tables. It links related descriptions across paragraphs, unifies ligand abbreviations with full names, and outputs structured parameters ready for use. MOFh6 achieved 99% extraction accuracy, resolved 90.8% of abbreviation cases across five major publishers, and maintained a precision of 0.93 ± 0.01. Processing a full text takes 9.6s, locating synthesis descriptions 36 s, with 100 papers processed for 4.24$. By replacing static database lookups with real-time extraction, MOFh6 reshapes MOFs synthesis research, accelerating the conversion of literature knowledge into practical synthesis protocols, enabling scalable, data-driven materials discovery. • LLM-powered MOFh6 unifies fragmented synthesis knowledge into structured data. • Transforms MOF synthesis informatics with scalable and cost-efficient workflow. • End-to-end system supports literature mining, structure query, and MOFs visualization. • 7 × faster processing, 76% lower cost, advancing MOF synthesis information discover.
BibTeX
@article{lin2026reshaping,
  author = {Zuhong Lin and Daoyuan Ren and K. Ran and Jing Sun and Songlin Yu and Xuefeng Bai and X. D. Huang and Haiyang He and Peng‐Zhi Pan and Ying Fang and Zhanglin Li and Haipu Li and Jingjing Yao},
  title = {{Reshaping MOFs synthesis conditions mining with a dynamic multi-agents framework of large language model}},
  journal = {Transactions},
  year = {2026},
  doi = {10.1016/j.tramat.2026.100176},
}

Loading related content...

Figure