Polyconvex neural network models of thermoelasticity

Jan N. Fuhg, Asghar Jadoon, Oliver Weeger, Daniel Seidl, Reese E. Jones

TL;DR

Researchers have developed a new neural network framework for thermoelasticity that is physically consistent by design. By embedding "polyconvexity" and thermodynamic constraints directly into the network architecture, the model guarantees stable, physically plausible predictions for how materials deform under heat, even when training data is scarce.

What Problem Does This Paper Address?

In the world of materials science, "constitutive modeling" is the art of writing equations that describe how a material responds to force and temperature. Traditionally, engineers used hand-crafted analytical models. Recently, Machine Learning (ML) has stepped in, offering neural networks that can "learn" these complex relationships from data.

However, standard neural networks are "black boxes." They can easily predict physically impossible behaviors—like a material becoming infinitely small under zero pressure or violating the laws of thermodynamics. In the sub-field of thermo-hyperelasticity (materials undergoing large deformations while heating/cooling), this is particularly challenging. There is a critical need for models that are flexible enough to capture complex data but rigid enough to obey fundamental physics, such as polyconvexity (which ensures mathematical stability) and temperature concavity (a requirement of the second law of thermodynamics).

Methods

The authors propose a Physics-Augmented Neural Network framework based on the Helmholtz free energy ($\Psi$). Instead of just training a network to minimize error, they build the physics into the network's "DNA":

  1. Polyconvex-Concave (PCC) Architecture: The network is structured so that the free energy is mathematically guaranteed to be convex with respect to deformation and concave with respect to temperature. They achieve this using Input Convex Neural Networks (ICNNs) and specific activation functions like Softplus and ReLU.
  2. Thermodynamic Consistency: The model ensures that derived quantities, like stress and heat capacity, behave according to thermodynamic principles (e.g., positive heat capacity).
  3. Extreme Sparsification: To prevent overfitting (a common issue when you have more "neurons" than data points), they use an $L^0$ regularization algorithm. This "prunes" the network during training, leaving behind only the most essential parameters. This makes the final model look less like a black box and more like a concise physical law.

Datasets

The framework was validated using both simulated and real-world data:

  • Synthetic Data: Generated from classical Neo-Hookean and Saint Venant material models to prove the network could recover known physical behaviors like thermal expansion and softening.
  • Butyl Rubber: Experimental data from the classic Moshin and Treloar (1987) experiments involving simultaneous stretching and twisting.
  • Biological Tissue: Uniaxial tension data from pig ear tissue across various temperatures.
  • Carbon-Filled Black Rubber: A complex dataset that exhibits "thermoelastic inversion"—a phenomenon where the material's stiffness actually increases with temperature after a certain point.

Key Insights and Ideas

  • Physics as a Structural Constraint: The biggest "aha moment" is that you don't need to teach the network physics through the loss function alone; you can force it to obey physics by choosing the right architecture. This ensures the model never "hallucinates" unphysical behavior.
  • Capturing the "Inversion": The model successfully captured the non-intuitive behavior of carbon-filled rubber. Most materials soften when heated, but some rubbers stiffen. The PCC framework handled this "inversion" naturally without needing special tweaks.
  • Generalization from Limited Data: Because the model is constrained by physics, it generalizes remarkably well. For example, a model trained only on "stretching" data (uniaxial) could accurately predict how the material would behave when "squished" from two sides (equibiaxial).

Key Results

  • High Accuracy: On experimental rubber data, the model achieved prediction errors generally less than 4%.
  • Extreme Efficiency: Through sparsification, the authors reduced complex neural networks down to just ~20 active parameters while maintaining high accuracy. This suggests the model discovered a "minimal" physical representation of the material.
  • Stability: The imposed polyconvexity ensured that the resulting stress-strain curves were smooth and well-behaved, which is essential for using these models in larger engineering simulations (like Finite Element Analysis).

Limitations and Future Work

While the framework is a major step forward, the authors note a few areas for growth:

  • Isotropy: The current models assume the material behaves the same in all directions (isotropic). Future work will aim to include anisotropy, which is crucial for modeling things like muscle fibers or 3D-printed composites.
  • Incompressibility: The paper handles incompressible materials (like rubber) using Lagrange multipliers, but more integrated ways to enforce volume preservation could be explored.
  • Automated Symmetry Learning: The authors suggest that future versions could "learn" the underlying symmetries of a material directly from data, rather than having them pre-defined by the researcher.

Summary updated

Abstract

Machine-learning function representations such as neural networks have proven to be excellent constructs for constitutive modeling due to their flexibility to represent highly nonlinear data and their ability to incorporate constitutive constraints, which also allows them to generalize well to unseen data. In this work, we extend a polyconvex hyperelastic neural network framework to thermo-hyperelasticity by specifying the thermodynamic and material theoretic requirements for an expansion of the Helmholtz free energy expressed in terms of deformation invariants and temperature. Different formulations which a priori ensure polyconvexity with respect to deformation and concavity with respect to temperature are proposed and discussed. The physics-augmented neural networks are furthermore calibrated with a recently proposed sparsification algorithm that not only aims to fit the training data but also penalizes the number of active parameters, which prevents overfitting in the low data regime and promotes generalization. The performance of the proposed framework is demonstrated on synthetic data, which illustrate the expected thermomechanical phenomena, and existing temperature-dependent uniaxial tension and tension-torsion experimental datasets.
BibTeX
@article{fuhg2024polyconvex,
  author = {Jan N. Fuhg and Asghar Jadoon and Oliver Weeger and Daniel Seidl and Reese E. Jones},
  title = {{Polyconvex neural network models of thermoelasticity}},
  journal = {Journal of the Mechanics and Physics of Solids},
  year = {2024},
  doi = {10.1016/j.jmps.2024.105837},
}
Figure