DSADiff: Data Structure-Aware Diffusion for Crystal Structure Prediction via Mitigating Complexity- and Imbalance-Induced Biases

Jiang Xiaobo, Dinghong LaiarXiv 2026 · arXiv

DSADiff: Making Crystal Structure Prediction Data-Smart

Crystal Structure Prediction (CSP)—the ability to generate a 3D atomic arrangement from just a chemical formula—is the "Holy Grail" of materials science. While diffusion models have recently taken the lead in this field, they often struggle with consistency. A model might perform brilliantly on simple perovskites but fail miserably on complex carbon structures.

This paper introduces DSADiff, a framework that doesn't just throw more parameters at the problem. Instead, it uses a data-centric approach to identify and mitigate the hidden biases that make certain crystals harder to generate than others.

TL;DR

DSADiff improves crystal structure prediction by identifying two key sources of model bias: structural complexity and elemental composition imbalance. By encoding these factors into a "unified difficulty descriptor," the model adaptively adjusts its learning strategy, achieving a new state-of-the-art Match Rate improvement of up to 9% across benchmark datasets.

What Problem Does This Paper Address?

Current diffusion-based CSP models, like DiffCSP and TGDMat, are powerful but "data-blind." They treat every crystal sample the same way during training, regardless of whether it’s a simple 5-atom unit cell or a complex 24-atom structure.

The authors identify a major gap: we lack systematic ways to trace why performance varies so much across different material spaces. They argue that two intrinsic data characteristics introduce systematic bias:

  1. Crystal Complexity: Not all structures are equally easy to describe. A structure with high geometric variety or many atoms is inherently harder to "denoise" from a random cloud of points.
  2. Elemental Imbalance: Real-world datasets are skewed. Some chemical compositions appear thousands of times, while others are rare. Surprisingly, the authors found that high-frequency compositions can actually be harder to learn because they often correspond to many different possible structural prototypes (a "multimodal" distribution).

Methods

The authors first developed the Layered Analysis Strategy (LAS) to quantify these biases. LAS defines a crystal complexity metric ($\rho$) based on three weighted components:

  • Normalized Elemental Entropy ($H_{norm}$): Measures compositional diversity.
  • Structural Scale Factor ($S_{norm}$): A logarithmic measure of the number of atoms.
  • Local Geometric Complexity ($G_{loc}$): Measures the heterogeneity of interatomic distances.

Building on LAS, they proposed DSADiff (Data Structure-Aware Diffusion). The core innovation is a Unified Control Descriptor that combines complexity and imbalance data to guide the model in two ways:

  1. Feature Modulation: Using a conditional affine transformation, the model dynamically reallocates its representation capacity based on the sample's difficulty.
  2. Adaptive Training Strategy: The model progressively shifts its focus from common, "easier" compositions to rarer, more complex ones, preventing the training process from getting stuck in suboptimal solutions dominated by simple structures.
Fig. 1. Simplified architecture of the DiffCSP model

Datasets

The model was evaluated on three diverse CSP benchmarks:

  • Perov-5: 18,928 perovskite structures. High chemical diversity but a fixed structural prototype (simple).
  • Carbon-24: 10,153 carbon-based materials. Identical chemical composition but highly diverse structural prototypes (complex geometry).
  • MP-20: 45,231 stable inorganic materials from the Materials Project. The "gold standard" for CSP, featuring high diversity in both composition and structure.

Key Insights and Ideas

  • The Complexity Penalty: Correlation analysis proved that as crystal complexity increases, the Match Rate drops and RMSE (error) rises. SHAP analysis (see below) confirmed that structural scale and geometric complexity are the primary drivers of this difficulty.
Fig. 3. SHAP analysis of complexity features
  • The "Popularity" Paradox: In a counter-intuitive finding, the authors noted that very frequent compositions in the training set often lead to worse performance. This is because a single formula (like Carbon) can represent many different stable structures (diamond, graphite, nanotubes). The model struggles to identify the correct "target" structure when the mapping from formula to geometry is one-to-many.
Fig. 4. Analysis of elemental composition imbalance

Key Results

DSADiff consistently outperformed existing state-of-the-art (SOTA) methods across all metrics:

  • Carbon-24: Achieved a Match Rate of 52.61%, a massive jump from the previous SOTA of 43.60% (TGDMat).
  • MP-20: Improved Match Rate to 58.09% (up from 52.84%) and reduced RMSE to 0.0688.
  • Perov-5: Reached a near-perfect Match Rate of 93.18%.

Ablation studies confirmed that both the conditional feature modulation and the adaptive training strategy are necessary; neither alone could match the performance of the full DSADiff model.

Limitations and Future Work

While DSADiff handles complexity and imbalance well, the authors note that the current complexity weights (0.40, 0.35, 0.25) were assigned based on domain knowledge rather than being learned. Future iterations might benefit from an automated way to tune these weights.

Additionally, the authors plan to extend DSADiff to even more challenging chemical systems, such as high-entropy materials, and integrate property-guided design to generate crystals with specific desired functions (e.g., specific band gaps or hardness).

Summary updated

Abstract

Crystal Structure Prediction (CSP) is an important step in accelerating the generation and discovery of new materials. In recent years, diffusion-based CSP methods have made significant progress. However, existing models still suffer from generation bias when facing diverse materials spaces, while systematic approaches for tracing the sources of such performance variations remain limited. To address this issue, we propose LAS (Layered Analysis Strategy), a mechanism analysis framework that identifies crystal complexity and elemental composition imbalance as two key factors affecting generation difficulty and further reveals their relationships with model generation performance. Building on these findings, we further propose DSADiff (Data Structure-Aware Diffusion), a data structure-aware diffusion model that transforms the key factors identified by LAS into a unified generation difficulty representation and uses it to jointly drive feature modeling and training strategy optimization. This enables the model to adapt its representation and generation capability to samples with different data structures and difficulty levels, thereby mitigating learning bias across samples. Experiments on three CSP benchmark datasets, including Carbon-24, demonstrate that DSADiff consistently improves both Match Rate and RMSE, with a maximum Match Rate improvement of 9%, surpassing existing state-of-the-art methods and achieving new state-of-the-art performance. This work deepens the understanding of diffusion-based CSP models from the perspective of generation bias and provides a new direction for designing less biased generative models for complex materials spaces.
BibTeX
@misc{xiaobo2026dsadiff,
  author = {Jiang Xiaobo and Dinghong Lai},
  title = {{DSADiff: Data Structure-Aware Diffusion for Crystal Structure Prediction via Mitigating Complexity- and Imbalance-Induced Biases}},
  year = {2026},
  eprint = {2611.22050},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.22050},
}
Figure