MatVerse: A Foundation Model for Materials Science

Xuanyu Zhu, Qian Tan, Bo Chen, Jiaqing Xie, Yang Han, Mei Wu, Wanhao Liu, Xuanze Lin, Yuchen Zhou, Shijie Wang, Biqing Qi, Shixiang Tang, Wenwei Zhang, Tianfan Fu, Kai Yu, Lu Chen, Yuqiang Li, Xin ChenarXiv 2026 · arXiv

TL;DR

MatVerse is a 35B-parameter foundation model specifically engineered for materials science, capable of reasoning across text, crystal structures, and experimental imagery. By combining a sophisticated data-synthesis pipeline with targeted domain post-training, it achieves performance competitive with much larger proprietary models on specialized scientific benchmarks.

What Problem Does This Paper Address?

Materials science is inherently multimodal and data-heavy. Researchers deal with a "heterogeneous" mix of information: textual literature, symbolic representations of molecules (SMILES) and crystals (CIF), experimental spectra (XRD), and microscopy images (SEM).

While general-purpose Large Language Models (LLMs) like GPT-4 are impressive, they often stumble when asked to perform domain-specific quantitative reasoning—like calculating defect concentrations—or when they need to jointly interpret a plot and a chemical formula. Existing materials-oriented models are usually "narrow," focusing only on one task (like property prediction) or one modality (like molecular strings), leaving a gap for a unified "backbone" that can support the entire materials research workflow.

Methods

The authors introduce MatVerse, built upon the Intern-S2-Preview-35B base model, which utilizes a Mixture-of-Experts (MoE) architecture. The core innovation lies in their domain-specific post-training pipeline:

  1. Reasoning Distillation: They used high-performing "teacher" models (like Qwen3.7-Max and Claude 3.5) to generate step-by-step reasoning traces for materials problems.
  2. Scientific Problem Synthesis: To overcome the scarcity of high-quality data, they synthesized new problems by modifying numerical values, units, and chemical contexts in existing seed questions while ensuring physical consistency.
  3. Multimodal Data Construction: They developed a dual-path retrieval system (text-to-image and image-to-image) to find relevant scientific images from large pools, then used teacher models to generate grounded question-answer pairs for them.
  4. Progressive Scaling: The training recipe was first validated on a 4B "pilot" model before being scaled to the full 35B backbone.
The MatVerse architecture and unified text-image interface.

Datasets

The model was trained on a new corpus of 149,792 SFT (Supervised Fine-Tuning) examples, split between reasoning-oriented data (~30k) and multimodal supervision (~120k). Evaluation was conducted on three key benchmarks:

  • OmniMatBench: A human-calibrated benchmark covering 19 subfields, featuring both calculation-intensive (CAL) and open-ended (QA) tracks.
  • MatSciBench: Focused on scientific reasoning and numerical calculations from textbooks.
  • MaCBench: A multimodal benchmark covering 26 topics with diverse visual content like diffraction patterns and microscopy.

Key Insights and Ideas

  • Domain Post-Training vs. Raw Scale: One of the most significant "aha" moments is that a 35B model, when properly specialized, can outperform or rival proprietary models that are likely much larger. For instance, MatVerse outperformed GPT-5.2 on the MatSciBench reasoning tasks.
  • The Power of Reasoning Traces: Explicitly training the model to "think" (using <think> blocks) before answering significantly improved accuracy in quantitative tasks.
  • Retrieval-Based Synthesis: Instead of just using existing image-caption pairs, retrieving images as "semantic anchors" and then synthesizing new, complex questions about them proved highly effective for teaching the model to "read" scientific figures.
The data construction pipeline for MatVerse.

Key Results

MatVerse showed consistent improvements over its base model across all benchmarks:

  • MatSciBench: Achieved 63.59% rule accuracy, a +5.14% improvement over the base model, outperforming GPT-5.2 (59.6%).
  • MaCBench: Reached 67.22% overall accuracy, with massive gains in structured visual tasks like hand-drawn molecule recognition (+20.7%) and laboratory equipment identification (+20.0%).
  • OmniMatBench CAL: Improved exact slot accuracy from 21.98% to 24.45%, showing it is better at handling the "math" of materials science.
Overall comparison of MatVerse against representative foundation models.

Limitations and Future Work

Despite its strengths, MatVerse still trails the absolute frontier models (like Claude 3.5 Opus) in open-ended question answering. The authors also noted that "formula derivation"—the ability to manipulate symbolic equations from scratch—remains a weak point, with accuracy staying near 9%.

Future work will look into Reinforcement Learning (RL) on verifiable calculation tasks and integrating the model with external tools (like simulation software and databases) to move toward fully autonomous AI research agents.

Summary updated

Abstract

Materials science involves highly heterogeneous scientific information, including textual knowledge, molecular and crystal structures, experimental characterization data, microscopy images, and structure-property relationships. Developing a general-purpose foundation model capable of understanding and reasoning over these diverse materials representations remains challenging. In this technical report, we introduce MatVerse, a materials foundation model built upon Intern-S2-Preview and further specialized through large-scale materials-domain post-training. We construct a large-scale multimodal training corpus covering materials knowledge, scientific reasoning, quantitative problem solving, structural understanding, and multimodal scientific interpretation. To improve domain adaptation, we develop a unified data construction pipeline combining teacher-guided reasoning distillation, scientific problem synthesis, consistency-based filtering, and retrieval-based multimodal data construction. We evaluate MatVerse on three representative materials-science benchmarks: our human-calibrated OmniMatBench, MatSciBench, and MaCBench. Results demonstrate consistent improvements after materials-specific post-training over the base model on all three benchmarks, alongside improved inference efficiency on calculation-intensive problems. These results show that targeted domain-specific post-training can effectively enhance scientific reasoning, materials knowledge understanding, and multimodal scientific capabilities of foundation models. MatVerse provides a unified language-and-vision interface for materials science and serves as a foundation for future AI-assisted materials research workflows.
BibTeX
@misc{zhu2026matverse,
  author = {Xuanyu Zhu and Qian Tan and Bo Chen and Jiaqing Xie and Yang Han and Mei Wu and Wanhao Liu and Xuanze Lin and Yuchen Zhou and Shijie Wang and Biqing Qi and Shixiang Tang and Wenwei Zhang and Tianfan Fu and Kai Yu and Lu Chen and Yuqiang Li and Xin Chen},
  title = {{MatVerse: A Foundation Model for Materials Science}},
  year = {2026},
  eprint = {2611.25651},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.25651},
}
Figure