Equilibrium thermodynamics is governed by a simple, elegant rule: isolated systems evolve until they maximize their entropy, settling into a static state of balance. But the real world is rarely isolated. Turbulent fluids, living cells, and hot plasmas are continuously driven by external forces. These non-equilibrium systems do not settle into quiet equilibrium; instead, they form dynamic steady states or follow complex relaxation pathways that continuously process energy.
How do these systems "choose" their configurations when far from equilibrium? The Maximum Entropy Production (MEP) principle offers a powerful answer: out of all possible states or pathways, a non-equilibrium system tends to favor those that maximize the rate of macroscopic entropy production.
The Micro-Macro Link: Path Complexity and Entropy Production
To understand why a system would maximize its rate of entropy production, we must look at the connection between macroscopic thermodynamics and microscopic trajectories. Why should a macroscopic quantity like the rate of heat or entropy dissipation dictate the microscopic configuration of a system?
In Maximum Entropy Production vs. Kolmogorov-Sinai Entropy in a Constrained ASEP Model, Martin Mihelich explores this link using a constrained Asymmetric Simple Exclusion Process (ASEP)—a foundational lattice model used to study particle transport and non-equilibrium dynamics. By independently calculating the macroscopic entropy production and the Kolmogorov-Sinai (KS) entropy of the system, the author discovered that the dynamical rules maximizing both quantities coincide.
This finding provides a vital piece of intuition. KS entropy measures the chaotic complexity and randomness of a system's microscopic trajectories over time. The fact that maximizing macroscopic entropy production yields the exact same dynamical rules as maximizing KS entropy suggests that MEP is not an arbitrary thermodynamic rule. Instead, a system maximizes its macroscopic entropy production precisely because its underlying microscopic dynamics are exploring the available state space as chaotically and thoroughly as possible. Macroscopic entropy production is simply the thermodynamic manifestation of microscopic path complexity.
Resolving the Conservation Paradox
A major hurdle in non-equilibrium physics is that fundamental microscopic equations often conserve entropy, even when the macroscopic behavior clearly looks like a relaxation process. This creates a paradox: how can a system evolve toward a preferred, disordered state if its total information (microscopic entropy) is strictly preserved?
Consider Landau damping, a phenomenon where a collisionless plasma smooths out over time and approaches spatial homogeneity. Because the underlying Vlasov equation governing the plasma is time-reversible, it strictly conserves the microscopic Boltzmann entropy.
Kinetic Level (Vlasov Equation) ---> Hydrodynamic Level (Reduction)
Microscopic Boltzmann Entropy Macroscopic Hydrodynamic Entropy
[STRICTLY CONSERVED] [GROWING / MAXIMIZING]
Michal Pavelka et al. resolve this paradox in Thermodynamic Explanation of Landau Damping by Reduction to Hydrodynamics. By reducing the complex kinetic Vlasov equation to simpler hydrodynamic equations using the Ehrenfest method, the authors demonstrate a crucial distinction between microscopic and macroscopic descriptions. While the microscopic entropy remains constant, a macroscopic hydrodynamic entropy emerges during the reduction process and grows over time. The growth of this macroscopic entropy acts as the thermodynamic driving force that pushes the plasma toward spatial homogeneity. This shows that non-equilibrium relaxation can be understood as a macroscopic entropy maximization process, even when microscopic information is fully preserved.
Bypassing Kinetic Complexity in Complex Networks
If non-equilibrium systems naturally organize themselves to maximize entropy production, we can turn this principle into a predictive tool. In complex networks—such as the metabolic pathways of living cells—modeling behavior traditionally requires knowing hundreds of explicit kinetic rate constants. Measuring these constants experimentally is often impossible, making traditional kinetic modeling intractable.
In Prediction of Metabolite Concentrations, Rate Constants and Post-Translational Regulation Using Maximum Entropy-Based Simulations with Application to Central Metabolism of Neurospora crassa, William R. Cannon et al. leverage the MEP principle to bypass this kinetic bottleneck. Operating under the premise that biological pathways have evolved under selective pressure to optimize thermodynamic efficiency, the authors frame a metabolic network within an ordinary differential equation (ODE) framework.
Instead of tracking down individual rate constants, the authors determine the system's state by finding the maximum entropy distribution of the network. This optimization successfully predicts steady-state metabolite concentrations and infers enzyme regulations without requiring predefined kinetic rates. The method works because the state of maximum entropy production represents the most statistically probable configuration of the network under steady driving forces, allowing researchers to infer microscopic parameters from macroscopic thermodynamic principles.
Is MEP a Fundamental Law or a Heuristic?
While the MEP principle has proven to be an effective predictive tool across fluid dynamics, plasma physics, and biology, its theoretical status remains an open question. Is it a primary law of physics, or an emergent property of an even deeper mechanism?
In Is Turbulence a State of Maximum Energy Dissipation?, Martin Mihelich re-evaluates the principle in the context of fluid turbulence. Turbulent flows are often hypothesized to settle into states that maximize energy dissipation, which serves as a proxy for entropy production. However, the author notes that the mathematical justification for MEP in highly complex systems is rarely rigorous and can be highly sensitive to boundary conditions.
The paper suggests that MEP might be a secondary consequence of a more fundamental principle: minimum mixing time. In systems with symmetries that promote pure mixing, the drive to minimize mixing time naturally steers the system toward states of high dissipation.
Whether viewed as a fundamental law of non-equilibrium systems or an emergent heuristic, the principle of maximum entropy production provides a vital bridge. It connects the intractable, chaotic details of microscopic dynamics to predictable, macroscopic steady states, offering a unified lens for studying systems far from equilibrium.
Key Foundational Work
Maximum Entropy Production vs. Kolmogorov-Sinai Entropy in a Constrained ASEP Model (2014) — contributed 5 concept elements to this direction.
Is Turbulence a State of Maximum Energy Dissipation? (2017) — contributed 4 concept elements to this direction.