Neural Wave Functions for Superfluids

Wan Tong Lou, Halvard Sutterud, Gino Cassella, W. Matthew C. Foulkes, Johannes Knolle, David Pfau, James S. SpencerarXiv 2023 · DOI · OpenReview

TL;DR

Researchers have adapted a powerful neural network-based approach, FermiNet, to study the complex behavior of superfluids. They found the original FermiNet struggled with these systems and introduced a modified "AGPs FermiNet" that significantly improves accuracy, outperforming even advanced quantum Monte Carlo methods and matching experimental results for the unitary Fermi gas.

What Problem Does This Paper Address?

Understanding superfluidity, a state of matter where fluids flow without friction, is a major challenge in condensed matter physics. The unitary Fermi gas (UFG) is a key theoretical model for studying superfluidity, characterized by strong, short-range interactions. However, accurately describing the UFG's ground state properties has been notoriously difficult for traditional computational methods. Existing approaches like mean-field theories are insufficient for strongly interacting systems, while quantum Monte Carlo (QMC) methods, though powerful, can be computationally expensive and sometimes struggle with quantitative accuracy or specific phases. This paper aims to leverage the flexibility of neural networks to develop a more accurate and efficient method for studying such strongly correlated quantum systems.

Methods

The core of this work is the application and modification of the Fermionic Neural Network (FermiNet), a neural network architecture designed to represent fermionic wave functions.

  • Original FermiNet: This approach uses a neural network to generate "FermiNet orbitals," which are then combined into a Slater determinant (or a linear combination of Slater determinants) to form the wave function. This method aims to avoid the need for predefined basis sets and capture complex correlations.
  • Identified Limitation: The authors discovered that the standard FermiNet struggles to accurately describe the superfluid ground state of the unitary Fermi gas, particularly for larger systems. This suggests that the standard antisymmetrization method within FermiNet is insufficient for capturing the strong pairing correlations characteristic of superfluids.
  • Proposed Solution: AGPs FermiNet: To address this, they introduce a modification based on the Antisymmetric Geminal Power Singlet (AGPs) wave function. Instead of building the wave function from single-particle orbitals, the AGPs approach uses "geminals" or pairing functions. The key innovation is using the FermiNet architecture to generate these many-particle geminals. This new "AGPs FermiNet" uses the same neural network architecture but modifies how the outputs are combined to form the wave function, focusing on pairing correlations.
  • Mathematical Proof: The paper includes a mathematical demonstration that the AGPs FermiNet is a strict generalization of the original FermiNet architecture, meaning it can represent all states the original can, and potentially more, with fewer parameters.
  • Variational Monte Carlo (VMC): Both FermiNet approaches are employed within a VMC framework. This method uses the neural network to propose a wave function and then optimizes its parameters (weights and biases) to minimize the system's energy, guided by the variational principle.

Datasets

Not discussed in the paper. The study focuses on simulating a theoretical model (the unitary Fermi gas) rather than training on experimental data.

Key Insights and Ideas

  • Neural Networks for Superfluidity: This work demonstrates that neural networks, specifically FermiNet, can be powerful tools for tackling complex quantum many-body problems like superfluidity, offering a flexible alternative to traditional methods.
  • The Importance of Pairing Correlations: The failure of the standard FermiNet for superfluids highlights the critical role of explicitly capturing pairing correlations. The AGPs approach, by focusing on these pairs, proves much more effective.
  • AGPs FermiNet as a Generalization: The mathematical proof that AGPs FermiNet generalizes the standard FermiNet is significant. It suggests that the AGPs approach is more robust for paired systems and potentially more efficient.
  • Beyond Basis Sets: The continued success of FermiNet-based methods underscores the advantage of neural networks in avoiding the need for predefined basis sets, which can be a bottleneck in traditional quantum chemistry and physics calculations.
  • Unbiased Estimates: The VMC framework used with these neural networks allows for unbiased estimates of various physical quantities, which is a significant advantage over some other QMC methods.

Key Results

  • Improved Accuracy: The AGPs FermiNet significantly outperforms the original Slater FermiNet for the unitary Fermi gas, especially for systems with more than 10 particles.
  • Competitive with State-of-the-Art: The AGPs FermiNet achieves results that are more accurate than fixed-node diffusion Monte Carlo (FN-DMC) for the UFG, matching or even surpassing experimental values for key properties like the condensate fraction.
  • Bertsch Parameter: The AGPs FermiNet yields lower (better) Bertsch parameters (a measure of interaction strength) compared to the Slater FermiNet and FN-DMC. For N=38, their estimate is 0.44(1), consistent with experiments around 0.46-0.47.
  • Pairing Gap Collapse: The Slater FermiNet shows a dramatic collapse in the pairing gap as system size increases, indicating its inability to capture superfluidity. The AGPs FermiNet, while showing some finite-size effects, maintains a consistent pairing gap.
  • Condensate Fraction: The AGPs FermiNet accurately estimates the superfluid condensate fraction (around 0.44 for N=38), a key signature of superfluidity, whereas the Slater FermiNet fails to converge to a meaningful value.

Limitations and Future Work

  • Slater FermiNet Limitations: The primary limitation identified is the failure of the standard Slater FermiNet to accurately describe the superfluid ground state of the unitary Fermi gas for larger systems. This is attributed to the insufficient antisymmetrization method for capturing strong pairing correlations.
  • Finite-Size Errors: While the AGPs FermiNet is significantly better, it still exhibits finite-size errors, as evidenced by oscillations in the pairing gap with system size.
  • Computational Resources: Training for larger systems (N=66) was limited by computational resources, resulting in a less converged training curve compared to smaller systems.
  • Future Work:
    • Extension to Other Superfluids: The authors suggest that the AGPs FermiNet approach can be readily extended to study other paired systems, including molecules, electron-positron systems, electron-hole liquids, and other s-wave superfluids.
  • Non-s-wave and Triplet Pairing: The AGPs FermiNet has a straightforward Pfaffian extension, making it applicable to non-s-wave and triplet pairing systems, such as Helium-3 and high-Tc superconductors.
  • Adaptation to Other Architectures: The method is not limited to the FermiNet architecture and can be adapted to more recent neural network designs like Psiformer, GLOBE, and MOON.
  • Investigating Scaling: Further investigation into how the number of block-diagonal determinants required for the Slater FermiNet scales with system size is suggested, though it becomes computationally prohibitive.

Summary updated

Abstract

Understanding superfluidity remains a major goal of condensed matter physics. Here we tackle this challenge utilizing the recently developed Fermionic neural network (FermiNet) wave function Ansatz [D. Pfau et al., Phys. Rev. Res. 2, 033429 (2020).] for variational Monte Carlo calculations. We study the unitary Fermi gas, a system with strong, short-range, two-body interactions known to possess a superfluid ground state but difficult to describe quantitatively. We demonstrate key limitations of the FermiNet Ansatz in studying the unitary Fermi gas and propose a simple modification based on the idea of an antisymmetric geminal power singlet (AGPs) wave function. The new AGPs FermiNet outperforms the original FermiNet significantly in paired systems, giving results which are more accurate than fixed-node diffusion Monte Carlo and are consistent with experiment. We prove mathematically that the new Ansatz, which only differs from the original Ansatz by the method of antisymmetrization, is a strict generalization of the original FermiNet architecture, despite the use of fewer parameters. Our approach shares several advantages with the original FermiNet: the use of a neural network removes the need for an underlying basis set; and the flexibility of the network yields extremely accurate results within a variational quantum Monte Carlo framework that provides access to unbiased estimates of arbitrary ground-state expectation values. We discuss how the method can be extended to study other superfluids.
BibTeX
@misc{lou2023neural,
  author = {Wan Tong Lou and Halvard Sutterud and Gino Cassella and W. Matthew C. Foulkes and Johannes Knolle and David Pfau and James S. Spencer},
  title = {{Neural Wave Functions for Superfluids}},
  year = {2023},
  eprint = {2305.06989},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2305.06989},
}
Figure