Attenuating the fermion sign problem in path integral Monte Carlo simulations using the Bogoliubov inequality and thermodynamic integration

Tobias Dornheim, Michele Invernizzi, Jan Vorberger, Barak HirshbergThe Journal of Chemical Physics 2020 · DOI · arXiv

TL;DR

This paper introduces a novel method to significantly speed up simulations of fermionic systems, which are notoriously difficult due to the "fermion sign problem." By adding a tunable repulsive interaction and using either extrapolation or thermodynamic integration, they achieve speedups of up to $10^6$ while maintaining high accuracy, making previously intractable problems computationally accessible.

What Problem Does This Paper Address?

Simulating the behavior of interacting fermions (particles like electrons that obey the Pauli exclusion principle) is crucial for understanding a vast range of physical systems, from ultracold atomic gases to electrons in quantum dots and warm-dense matter. The primary hurdle in these simulations, particularly using Path Integral Monte Carlo (PIMC) methods, is the "fermion sign problem" (FSP). This problem arises because the fermionic wave function must be antisymmetric under particle exchange, leading to cancellations between positive and negative contributions in the calculations. As a result, the computational cost grows exponentially with system size and decreases in temperature, quickly rendering simulations intractable. Existing methods like the fixed-node approximation offer solutions but rely on approximations for the nodal structure of the wave function. This paper aims to overcome these limitations by developing a more robust and efficient approach to tackle the FSP in PIMC simulations.

Methods

The core of this work builds upon a recent proposal by Hirshberg et al. [64] that uses the Bogoliubov inequality to alleviate the FSP. The authors extend this by introducing a tunable parameter, $\eta$, to a modified Hamiltonian. This modified Hamiltonian includes a repulsive two-body term that mimics the effect of Pauli repulsion, effectively "taming" the sign problem.

Two key post-processing techniques are employed to recover the exact energy of the original system:

  1. Extrapolation based on the Bogoliubov Inequality: The modified Hamiltonian is $H_\eta = \hat{H} + \eta \hat{\phi}$, where $\hat{H}$ is the original Hamiltonian and $\hat{\phi}$ is the added repulsive term. By performing PIMC simulations for various values of $\eta$ (starting from $\eta > 0$ where the sign problem is less severe) and then extrapolating the results to $\eta \to 0$, the authors aim to recover the exact energy of the original system. This is justified by the Bogoliubov inequality, which provides an upper bound on the free energy.
  2. Thermodynamic Integration: This method uses an exact relation to calculate the free energy difference between the original and the modified system. By integrating the expectation value of the perturbation term $\hat{\phi}$ over $\eta$ from 0 to some value, the free energy of the original system can be accurately determined. This approach also requires extrapolation for the perturbation term itself, but not for the entire energy.

The authors specifically use a dipolar short-range repulsion for $\hat{\phi}$, which has been shown to yield a larger average sign compared to Coulomb repulsion.

Datasets

The paper does not introduce new benchmark datasets. Instead, it evaluates its method on well-established model systems:

  • 2D and 3D quantum dots: Electrons confined in harmonic traps with varying Coulomb interaction strengths ($\lambda$).
  • Warm Dense Matter (WDM) conditions: Simulated by varying temperature ($\beta$) and system size ($N$).

The results are compared with existing PIMC data from literature [4, 49] and, in one case, with results from the approximate multi-level blocking (MLB) method [49].

Key Insights and Ideas

  • Tunable Repulsion as a "Sign Problem Tamer": The introduction of a tunable repulsive term ($\eta \hat{\phi}$) is a clever way to effectively reduce the severity of the fermion sign problem. By making the particles "repel" each other more strongly in the simulation, the cancellations that lead to the sign problem are mitigated.
  • Two Paths to the Exact Result: The paper offers two distinct, yet complementary, post-processing techniques (extrapolation and thermodynamic integration) to recover the exact energy from simulations performed with the modified Hamiltonian. This provides robustness and allows for cross-validation.
  • Extrapolation is Surprisingly Robust: While extrapolations can be tricky, the authors found that a simple empirical functional form for the energy as a function of $\eta$ worked remarkably well, even with limited data points at larger $\eta$.
  • Thermodynamic Integration for Enhanced Reliability: The thermodynamic integration approach, being based on an exact relation, is presented as a more reliable method, especially when combined with a good empirical fit for the perturbation term.
  • Significant Speedups Achieved: The most striking insight is the dramatic increase in computational efficiency, with speedups reaching up to $10^6$ in some cases. This opens doors to simulating systems at lower temperatures or larger sizes that were previously out of reach.

Key Results

  • Speedup: The method achieves speedups of up to $10^6$ compared to standard PIMC. For example, in a 2D harmonic trap at $\beta=2$, a speedup exceeding $10^5$ was observed for $\eta=0.5$. For a 3D system at $\beta=5$, the speedup reached $10^6$.
  • Accuracy: The extrapolated and thermodynamically integrated energies were found to be highly accurate, with relative errors of approximately $0.1\%$, which is sufficient for most practical applications.
  • Extended Feasible Range: The method effectively doubles the accessible temperature range (in terms of $\beta$) for simulations compared to standard PIMC.
  • Validation: The results were validated against existing PIMC data and, in one instance, against MLB calculations, showing excellent agreement.

Limitations and Future Work

  • Extrapolation of the Perturbation Term: While the authors found a reliable empirical fit (Eq. 21) for the perturbation term $\phi(\eta)$, this still involves an extrapolation, and its accuracy is crucial for the thermodynamic integration method.
  • Entropic Contribution at Higher Temperatures: At higher temperatures, an entropic contribution to the thermodynamic integration correction emerges, which is a priori unknown. However, the authors found it to be a small fraction of the total difference and empirically linear with $\eta$.
  • Not a Complete Solution to FSP: The authors acknowledge that their approach extends the range of accessible parameters but does not completely eliminate the exponential increase in computational cost at extremely low temperatures.
  • Future Work:
    • Implementing more efficient sampling procedures (e.g., from Ref. [89]) that might require only a single simulation.
  • Adapting the method to calculate other observables beyond energy, such as pair distributions and structure factors.
  • Investigating the use of different repulsive potentials beyond the dipolar one.
  • Applying the method to other systems, particularly warm-dense matter.
  • Generalizing the approach to other simulation methods for fermions.

Summary updated

Abstract

Accurate thermodynamic simulations of correlated fermions using path integral Monte Carlo (PIMC) methods are of paramount importance for many applications such as the description of ultracold atoms, electrons in quantum dots, and warm-dense matter. The main obstacle is the fermion sign problem (FSP), which leads to an exponential increase in computation time both with an increase in the system size and with a decrease in the temperature. Very recently, Hirshberg et al. [J. Chem. Phys. 152, 171102 (2020)] have proposed to alleviate the FSP based on the Bogoliubov inequality. In the present work, we extend this approach by adding a parameter that controls the perturbation, allowing for an extrapolation to the exact result. In this way, we can also use thermodynamic integration to obtain an improved estimate of the fermionic energy. As a test system, we choose electrons in 2D and 3D quantum dots and find in some cases a speed-up exceeding 10<sup>6</sup>, as compared to standard PIMC, while retaining a relative accuracy of ∼0.1%. Our approach is quite general and can readily be adapted to other simulation methods.
BibTeX
@article{dornheim2020attenuating,
  author = {Tobias Dornheim and Michele Invernizzi and Jan Vorberger and Barak Hirshberg},
  title = {{Attenuating the fermion sign problem in path integral Monte Carlo simulations using the Bogoliubov inequality and thermodynamic integration}},
  journal = {The Journal of Chemical Physics},
  year = {2020},
  doi = {10.1063/5.0030760},
}
Figure