Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2111.10420 · Proceedings of the National Academy of Sciences

Fermionic wave functions from neural-network constrained hidden states

Javier Robledo Moreno, Giuseppe Carleo, Antoine Georges, JAMES M. STOKES

Published Aug 3, 2022• 127 citations
arXivHTMLPDF

Abstract

We introduce a systematically improvable family of variational wave functions for the simulation of strongly correlated fermionic systems. This family consists of Slater determinants in an augmented Hilbert space involving "hidden" additional fermionic degrees of freedom. These determinants are projected onto the physical Hilbert space through a constraint that is optimized, together with the single-particle orbitals, using a neural network parameterization. This construction draws inspiration from the success of hidden-particle representations but overcomes the limitations associated with the mean-field treatment of the constraint often used in this context. Our construction provides an extremely expressive family of wave functions, which is proved to be universal. We apply this construction to the ground-state properties of the Hubbard model on the square lattice, achieving levels of accuracy that are competitive with those of state-of-the-art variational methods.

DOI
10.1073/pnas.2122059119

Related papers

Unifying view of fermionic neural network quantum states: From neural network backflow to hidden fermion determinant states

Zejun Liu, Bryan K. Clark

Among the variational wave functions for fermionic Hamiltonians, neural network backflow (NNBF) and hidden fermion determinant states (HFDS) are two prominent classes that provide accurate approximations to the ground state. Here we develop a unifying view of fermionic neural quantum states casting them all in the framework of NNBF. NNBF wave functions have configuration-dependent single-particle orbitals (SPO) which are parameterized by a neural network. We show that HFDS can be written as a NNBF wave function with a restricted low-rank $r$ additive correction to the SPO times a neural-network generated determinant of an $r\ifmmode\times\else\texttimes\fi{}r$ matrix. Furthermore, we show that in NNBF wave functions, this $r\ifmmode\times\else\texttimes\fi{}r$ determinant can generically be removed when $r$ is less than or equal to the number of fermions, at the cost of further complicating the additive SPO correction increasing its rank by $r$. We numerically and analytically compare additive SPO corrections generated by the product of two matrices with inner dimension $r$. We find that larger $r$ wave functions span a larger space and give evidence that simpler and more direct updates to the SPO's tend to be more expressive and better energetically. These suggest the standard NNBF approach is preferred amongst other related choices. Finally, we uncover that the row selection used to select single-particle orbitals allows significant sign and amplitude modulation between nearby configurations and is partially responsible for the quality of NNBF and HFDS wave functions.

arXiv:2311.09450•Physical review. B./Physical review. B•Sep 12, 2024•20 citations

Neural network–augmented Pfaffian wave-functions for scalable simulations of interacting fermions

Ao Chen, Zhou‐Quan Wan, Anirvan M. Sengupta +2 more

Developing accurate numerical methods for strongly interacting fermions is crucial for improving our understanding of various quantum many-body phenomena, especially unconventional superconductivity. Recently, neural quantum states have emerged as a promising approach for studying correlated fermions, highlighted by the hidden fermion and backflow methods, which use neural networks to model corrections to fermionic quasiparticle orbitals. In this work, we expand these ideas to the space of Pfaffians, a wave-function that naturally expresses superconducting pairings, and propose the hidden fermion Pfaffian state (HFPS), which flexibly represents both unpaired and superconducting phases and scales to large systems with favorable asymptotic complexity. In our numerical experiments, HFPS provides state-of-the-art variational accuracy in different regimes of both the attractive and repulsive Hubbard models. We show that the HFPS is able to capture general phases with and without pairing, and therefore may be a useful tool for modeling phases with unconventional superconductivity.

arXiv:2507.10705•Proceedings of the National Academy of Sciences•Aug 28, 2026•42 citations

Determinant-free fermionic wave function using feed-forward neural networks

Koji Inui, Yasuyuki Kato, Yukitoshi Motome

We propose a general framework for finding the ground state of many-body fermionic systems by using feed-forward neural networks. The anticommutation relation for fermions is usually implemented to a variational wave function by the Slater determinant (or Pfaffian), which is a computational bottleneck because of the numerical cost of $O({N}^{3})$ for $N$ particles. We bypass this bottleneck by explicitly calculating the sign changes associated with particle exchanges in real space and using fully connected neural networks for optimizing the rest parts of the wave function. This reduces the computational cost from $O({N}^{3})$ to $O({N}^{2})$ or less, while the overall cost depends on the number of Monte Carlo samples and the number of parameters in neural networks. We show that the accuracy of the approximation can be improved by optimizing the ``variance'' of the energy simultaneously with the energy itself. We also find that a reweighting method in Monte Carlo sampling can stabilize the calculation. These improvements can be applied to other approaches based on variational Monte Carlo methods. Moreover, we show that the accuracy can be further improved by using the symmetry of the system, the representative states, data preprocessing, and an additional neural network implementing a generalized Gutzwiller-Jastrow factor. We demonstrate the efficiency of the method by applying it to a two-dimensional Hubbard model.

arXiv:2108.08631•Physical Review Research•Nov 19, 2021•35 citations

Neural Gutzwiller-projected variational wave functions

Francesco Ferrari, Federico Becca, Juan Carrasquilla

Variational wave functions have enabled exceptional scientific breakthroughs related to the understanding of novel phases of matter. Examples include the Bardeen-Cooper-Schrieffer theory of superconductivity, the description of the fractional quantum Hall effect through the Laughlin state, and Feynman's variational understanding of large-scale quantum effects in liquid helium. More recently, Gutzwiller-projected wave functions, typically constructed from fermionic degrees of freedom, have been employed to examine quantum spin models in the presence of competing interactions, where exotic phases with no spontaneous symmetry breaking and fractional excitations may exist. In this work, we investigate the aforementioned fermionic wave functions supplemented with neural networks, specifically with the so-called restricted Boltzmann machine (RBM), to boost their accuracy and obtain reliable approximations to the ground state of generic spin models. In particular, we apply our neural augmented fermionic construction to the description of both magnetically ordered and disordered phases of increasing complexity, including cases where the ground state displays a nontrivial sign structure. Even though the RBM state is by far more effective for N\'eel states endowed with a particularly simple sign structure, it provides a significant improvement over the original fermionic state in highly frustrated regimes where a complex sign structure is anticipated, thus marking the path to an understanding of strongly correlated spin models on the lattice via neural Gutzwiller-projected variational wave functions.

arXiv:1906.00463•Physical review. B./Physical review. B•Sep 13, 2019•93 citations

Restricted Boltzmann machine learning for solving strongly correlated quantum systems

Yusuke Nomura, Andrew S. Darmawan, Youhei Yamaji +1 more

We develop a machine learning method to construct accurate ground-state wave functions of strongly interacting and entangled quantum spin as well as fermionic models on lattices. A restricted Boltzmann machine algorithm in the form of an artificial neural network is combined with a conventional variational Monte Carlo method with pair product (geminal) wave functions and quantum number projections. The combination allows an application of the machine learning scheme to interacting fermionic systems. The combined method substantially improves the accuracy beyond that ever achieved by each method separately, in the Heisenberg as well as Hubbard models on square lattices, thus proving its power as a highly accurate quantum many-body solver.

arXiv:1709.06475•Physical review. B./Physical review. B•Nov 29, 2017•347 citations

Traversing quantum many-body Hilbert spaces with neural networks

Douglas Hendry

Understanding strongly correlated quantum many-body systems requires dealing with a largeconfiguration space comprised of a set of all possible measurable configurations. The total number of configurations grows exponentially with the size of the system, which makes exact numerical calculations impossible for even moderately sized systems. Since the advent of high-temperature superconductivity and the subsequent interest in strongly correlated phases of matter, progress in the field has been marked by ingenuity of the field to overcome these computational limitations. The first techniques to emerge were inspired by quantum chemistry and based on exact diagonalization[1], which is limited to small clusters, and different variants of quantum Monte Carlo[2], that suffers from the sign problem in fermionic and frustrated systems. Circa 1992, the density matrix renormalization group (DMRG) [3, 4, 5, 6, 7] became one of the major breakthroughs of the past few decades. Despite the success of DMRG for one-dimensional(1D) and quasi-one-dimensional geometries, extensions to actual two-dimensional systems remain challenging and applications are constrained to long cylinders and strips. One promising alternative is to combine one the oldest methods, variational wave functions (VWFs), with neural networks, which have been used to recently with great success in machine learning. The focus of this dissertation is on developing novel variational Monte Carlo algorithms to make neural network variational wave functions applicable to many problems in quantum many-body physics. These algorithms draw from existing variational wave-function, tensor network, and machine learning methods. We calculate dynamical spectral functions using the vector correction and Chebyshev expansion method. We do finite temperature calculations with minimally entangled thermal states. Finally, we do ground state calculations for the frustrated J1−J2 Heisenberg model. We benchmark these results using restricted Boltzmann machines as the neural network for the the variational wave-functions.--Author's abstract

•Jan 1, 2023•0 citations
We introduce a systematically improvable family of variational wave functions for the simulation of strongly correlated fermionic systems. This family consists of Slater determinants in an augmented Hilbert space involving "hidden" additional fermionic degrees of freedom. These determinants are projected onto the physical Hilbert space through a constraint that is optimized, together with the single-particle orbitals, using a neural network parameterization. This construction draws inspiration from the success of hidden-particle representations but overcomes the limitations associated with the mean-field treatment of the constraint often used in this context. Our construction provides an extremely expressive family of wave functions, which is proved to be universal. We apply this construction to the ground-state properties of the Hubbard model on the square lattice, achieving levels of accuracy that are competitive with those of state-of-the-art variational methods.
Among the variational wave functions for fermionic Hamiltonians, neural network backflow (NNBF) and hidden fermion determinant states (HFDS) are two prominent classes that provide accurate approximations to the ground state. Here we develop a unifying view of fermionic neural quantum states casting them all in the framework of NNBF. NNBF wave functions have configuration-dependent single-particle orbitals (SPO) which are parameterized by a neural network. We show that HFDS can be written as a NNBF wave function with a restricted low-rank rrr additive correction to the SPO times a neural-network generated determinant of an $r\ifmmode\times\else\texttimes\fi{}r$ matrix. Furthermore, we show that in NNBF wave functions, this $r\ifmmode\times\else\texttimes\fi{}r$ determinant can generically be removed when rrr is less than or equal to the number of fermions, at the cost of further complicating the additive SPO correction increasing its rank by rrr. We numerically and analytically compare additive SPO corrections generated by the product of two matrices with inner dimension rrr. We find that larger rrr wave functions span a larger space and give evidence that simpler and more direct updates to the SPO's tend to be more expressive and better energetically. These suggest the standard NNBF approach is preferred amongst other related choices. Finally, we uncover that the row selection used to select single-particle orbitals allows significant sign and amplitude modulation between nearby configurations and is partially responsible for the quality of NNBF and HFDS wave functions.
Developing accurate numerical methods for strongly interacting fermions is crucial for improving our understanding of various quantum many-body phenomena, especially unconventional superconductivity. Recently, neural quantum states have emerged as a promising approach for studying correlated fermions, highlighted by the hidden fermion and backflow methods, which use neural networks to model corrections to fermionic quasiparticle orbitals. In this work, we expand these ideas to the space of Pfaffians, a wave-function that naturally expresses superconducting pairings, and propose the hidden fermion Pfaffian state (HFPS), which flexibly represents both unpaired and superconducting phases and scales to large systems with favorable asymptotic complexity. In our numerical experiments, HFPS provides state-of-the-art variational accuracy in different regimes of both the attractive and repulsive Hubbard models. We show that the HFPS is able to capture general phases with and without pairing, and therefore may be a useful tool for modeling phases with unconventional superconductivity.
We propose a general framework for finding the ground state of many-body fermionic systems by using feed-forward neural networks. The anticommutation relation for fermions is usually implemented to a variational wave function by the Slater determinant (or Pfaffian), which is a computational bottleneck because of the numerical cost of O(N3)O({N}^{3})O(N3) for NNN particles. We bypass this bottleneck by explicitly calculating the sign changes associated with particle exchanges in real space and using fully connected neural networks for optimizing the rest parts of the wave function. This reduces the computational cost from O(N3)O({N}^{3})O(N3) to O(N2)O({N}^{2})O(N2) or less, while the overall cost depends on the number of Monte Carlo samples and the number of parameters in neural networks. We show that the accuracy of the approximation can be improved by optimizing the ``variance'' of the energy simultaneously with the energy itself. We also find that a reweighting method in Monte Carlo sampling can stabilize the calculation. These improvements can be applied to other approaches based on variational Monte Carlo methods. Moreover, we show that the accuracy can be further improved by using the symmetry of the system, the representative states, data preprocessing, and an additional neural network implementing a generalized Gutzwiller-Jastrow factor. We demonstrate the efficiency of the method by applying it to a two-dimensional Hubbard model.
Variational wave functions have enabled exceptional scientific breakthroughs related to the understanding of novel phases of matter. Examples include the Bardeen-Cooper-Schrieffer theory of superconductivity, the description of the fractional quantum Hall effect through the Laughlin state, and Feynman's variational understanding of large-scale quantum effects in liquid helium. More recently, Gutzwiller-projected wave functions, typically constructed from fermionic degrees of freedom, have been employed to examine quantum spin models in the presence of competing interactions, where exotic phases with no spontaneous symmetry breaking and fractional excitations may exist. In this work, we investigate the aforementioned fermionic wave functions supplemented with neural networks, specifically with the so-called restricted Boltzmann machine (RBM), to boost their accuracy and obtain reliable approximations to the ground state of generic spin models. In particular, we apply our neural augmented fermionic construction to the description of both magnetically ordered and disordered phases of increasing complexity, including cases where the ground state displays a nontrivial sign structure. Even though the RBM state is by far more effective for N\'eel states endowed with a particularly simple sign structure, it provides a significant improvement over the original fermionic state in highly frustrated regimes where a complex sign structure is anticipated, thus marking the path to an understanding of strongly correlated spin models on the lattice via neural Gutzwiller-projected variational wave functions.
We develop a machine learning method to construct accurate ground-state wave functions of strongly interacting and entangled quantum spin as well as fermionic models on lattices. A restricted Boltzmann machine algorithm in the form of an artificial neural network is combined with a conventional variational Monte Carlo method with pair product (geminal) wave functions and quantum number projections. The combination allows an application of the machine learning scheme to interacting fermionic systems. The combined method substantially improves the accuracy beyond that ever achieved by each method separately, in the Heisenberg as well as Hubbard models on square lattices, thus proving its power as a highly accurate quantum many-body solver.
Understanding strongly correlated quantum many-body systems requires dealing with a largeconfiguration space comprised of a set of all possible measurable configurations. The total number of configurations grows exponentially with the size of the system, which makes exact numerical calculations impossible for even moderately sized systems. Since the advent of high-temperature superconductivity and the subsequent interest in strongly correlated phases of matter, progress in the field has been marked by ingenuity of the field to overcome these computational limitations. The first techniques to emerge were inspired by quantum chemistry and based on exact diagonalization[1], which is limited to small clusters, and different variants of quantum Monte Carlo[2], that suffers from the sign problem in fermionic and frustrated systems. Circa 1992, the density matrix renormalization group (DMRG) [3, 4, 5, 6, 7] became one of the major breakthroughs of the past few decades. Despite the success of DMRG for one-dimensional(1D) and quasi-one-dimensional geometries, extensions to actual two-dimensional systems remain challenging and applications are constrained to long cylinders and strips. One promising alternative is to combine one the oldest methods, variational wave functions (VWFs), with neural networks, which have been used to recently with great success in machine learning. The focus of this dissertation is on developing novel variational Monte Carlo algorithms to make neural network variational wave functions applicable to many problems in quantum many-body physics. These algorithms draw from existing variational wave-function, tensor network, and machine learning methods. We calculate dynamical spectral functions using the vector correction and Chebyshev expansion method. We do finite temperature calculations with minimally entangled thermal states. Finally, we do ground state calculations for the frustrated J1−J2 Heisenberg model. We benchmark these results using restricted Boltzmann machines as the neural network for the the variational wave-functions.--Author's abstract