Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2002.09246 · Physical review. B./Physical review. B

Efficient neural-network based variational Monte Carlo scheme for direct optimization of excited energy states in frustrated quantum systems

Tanja Đurić, Tomislav Ševa

Published Aug 3, 2020• 9 citations
arXivHTMLPDF

Abstract

We examine applicability of the valence bond basis correlator product state ansatz, equivalent to the restricted Boltzmann machine quantum artificial neural-network ansatz, and variational Monte Carlo method for direct optimization of excited energy states to study properties of strongly correlated and frustrated quantum systems. The energy eigenstates are found by stochastic minimization of the variational function for the energy eigenstates, which allows direct optimization of particular energy state without knowledge of the lower energy states. This approach combined with numerous tensor network or artificial neural-network ansatz wave functions then allows further insight into quantum phases and phase transitions in various strongly correlated models by considering properties of these systems beyond the ground-state properties. Also, the method is in general applicable to any dimension and has no sign instability. An example that we consider is the square lattice ${J}_{1}\ensuremath{-}{J}_{2}$ antiferromagnetic Heisenberg model. The model is one of the most studied models in frustrated quantum magnetism since it is closely related to the disappearance of the antiferromagnetic order in the high-Tc superconducting materials and there is still no agreement about the properties of the system in the highly frustrated regime near ${J}_{2}/{J}_{1}=0.5$. For the ${J}_{1}\ensuremath{-}{J}_{2}$ model, we write the variational ansatz in terms of the two site correlators and in the valence bond basis and calculate the lowest energy eigenstates in the highly frustrated regime near ${J}_{2}/{J}_{1}=0.5$ where the system has a paramagnetic phase. We find that our results are in good agreement with previously obtained results, which confirms applicability of the method to study frustrated spin systems.

DOI
10.1103/physrevb.102.085104

Related papers

Two-dimensional frustrated J1−J2 model studied with neural network quantum states

Kenny Choo, Titus Neupert, Giuseppe Carleo

The use of artificial neural networks to represent quantum wave functions has recently attracted interest as a way to solve complex many-body problems. The potential of these variational parametrizations has been supported by analytical and numerical evidence in controlled benchmarks. While approaching the end of the early research phase in this field, it becomes increasingly important to show how neural-network states perform for models and physical problems that constitute a clear open challenge for other many-body computational methods. In this paper, we start addressing this aspect, concentrating on a presently unsolved model describing two-dimensional frustrated magnets. Using a fully convolutional neural network model as a variational ans\"atz, we study the frustrated spin-1/$2{J}_{1}\text{\ensuremath{-}}{J}_{2}$ Heisenberg model on the square lattice. We demonstrate that the resulting predictions for both ground-state energies and properties are competitive with, and often improve upon, existing state-of-the-art methods. In a relatively small region in the parameter space, corresponding to the maximally frustrated regime, our ans\"atz exhibits comparatively good but not the best performance. The gap between the complexity of the models adopted here and those routinely adopted in deep-learning applications is, however, still substantial, such that further improvements in future generations of neural-network quantum states are likely to be expected.

arXiv:1903.06713•Physical review. B./Physical review. B•Sep 11, 2019•272 citations

Learning the ground state of a non-stoquastic quantum Hamiltonian in a rugged neural network landscape

Marin Bukov, Markus Schmitt, Maxime Dupont

Strongly interacting quantum systems described by non-stoquastic Hamiltonians exhibit rich low-temperature physics. Yet, their study poses a formidable challenge, even for state-of-the-art numerical techniques. Here, we investigate systematically the performance of a class of universal variational wave-functions based on artificial neural networks, by considering the frustrated spin- 1/2 1 / 2 J_1-J_2 J 1 − J 2 Heisenberg model on the square lattice. Focusing on neural network architectures without physics-informed input, we argue in favor of using an ansatz consisting of two decoupled real-valued networks, one for the amplitude and the other for the phase of the variational wavefunction. By introducing concrete mitigation strategies against inherent numerical instabilities in the stochastic reconfiguration algorithm we obtain a variational energy comparable to that reported recently with neural networks that incorporate knowledge about the physical system. Through a detailed analysis of the individual components of the algorithm, we conclude that the rugged nature of the energy landscape constitutes the major obstacle in finding a satisfactory approximation to the ground state wavefunction, and prevents learning the correct sign structure. In particular, we show that in the present setup the neural network expressivity and Monte Carlo sampling are not primary limiting factors.

arXiv:2011.11214•SciPost Physics•Jun 17, 2021•102 citations

Disentangling Tensor Network States with Deep Neural Network

Chaohui Fan, Bo Zhan, Yuntian Gu +5 more

We introduce Neural Tensor Network States ($ν$TNS), a variational many-body wave-function ansatz that integrates deep neural networks with tensor-network architectures. In the $ν$TNS framework, a neural network serves as a disentangler of the wave-function, transforming the physical degrees of freedom into renormalized variables with much less entanglement. The renormalized state is then efficiently encoded by a back-flow tensor network. This construction yields a compact yet highly expressive representation of strongly correlated quantum states. Using convolutional neural networks combined with matrix product states as a concrete implementation, we obtain state-of-the-art variational energies for the spin-$1/2$ $J_1$-$J_2$ Heisenberg model on the square lattice at the highly frustrated point $J_2/J_1=0.5$, for systems up to $20\times 20$ with periodic boundary conditions. Finite-size scaling of spin, dimer, and plaquette correlations exhibits power-law decay without magnetic or valence-bond long-range order, consistent with a gapless quantum spin-liquid ground state at that point.This $ν$TNS framework is flexible and naturally extensible to other neural and tensor-network structures, offering a general platform for investigating strongly correlated quantum many-body systems.

cond-mat.str-elCross-listedarXiv:2603.14425•Mar 17, 2026•7 citations

Simulating a two-dimensional frustrated spin system with fermionic resonating-valence-bond states

Chung-Pin Chou, Hong‐Yi Chen

The frustrated Heisenberg ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ model on a square lattice is numerically investigated by variational Monte Carlo simulations. We propose an antiferromagnetic fermion resonating-valence-bond (AF-fRVB) state that has the ability to examine the entire phase diagram in the ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ model. Two phase transition points, the second order around ${J}_{2}/{J}_{1}=0.45$ and the first order around ${J}_{2}/{J}_{1}=0.6$, can be extracted more clearly than the conventional bosonic RVB state. At the maximally frustrated point $({J}_{2}/{J}_{1}=0.5)$, the AF-fRVB state shows the variational ground-state energy in the thermodynamic limit very close to the one estimated by the projected entangled pair state at the largest bond dimension available. On the other hand, in the frustrated regime $0.4\ensuremath{\lesssim}{J}_{2}/{J}_{1}\ensuremath{\le}0.5$, AF-fRVB states with $\text{ext}\phantom{\rule{0.16em}{0ex}}{s}_{2}$ (using the terminology in the field of iron-based superconductors) and ${d}_{xy}$ pairing symmetries are degenerate in the thermodynamic limit, implying the existence of gapless Dirac excitations in the spinon spectrum.

arXiv:1403.6879•Physical Review B•Jul 22, 2014•15 citations

Correlated valence bond state and its study of the spin-1/2 J1-J2 Anti-ferromagnetic Heisenberg model on a square lattice

Ling Wang

We propose a class of variational wave functions, namely the correlated valence bond states, for the frustrated Hamiltonian in the paramagnetic phase. This class of wave functions admits negative amplitude and the same sub-lattice pairing when a bipartite lattice is considered, thus suffers from the negative sign problem. However if applied to small systems, the sign problem is manageable using the standard variational Monte Carlo method. We optimize the wave functions for the J1-J2 Anti ferromagnetic Heisenberg model on a square lattice in the coupling region J2/J1 \in [0.45 : 0.56] for system sizes L = 4, 6, 8. To calculate the correlation functions and the order parameters for larger systems, we make the extensive Monte Carlo samplings using the variational parameters optimized at system size L = 8. We find that the paramagnetic phase is a gap-less spin liquid in the entire range of J2/J1 \in [0.45 : 0.56] with a gap-less singlet excitation and a gaped triplet excitation.

arXiv:1402.3564•Feb 14, 2014•4 citations

Traversing quantum many-body Hilbert spaces with neural networks

Douglas Hendry

Understanding strongly correlated quantum many-body systems requires dealing with a largeconfiguration space comprised of a set of all possible measurable configurations. The total number of configurations grows exponentially with the size of the system, which makes exact numerical calculations impossible for even moderately sized systems. Since the advent of high-temperature superconductivity and the subsequent interest in strongly correlated phases of matter, progress in the field has been marked by ingenuity of the field to overcome these computational limitations. The first techniques to emerge were inspired by quantum chemistry and based on exact diagonalization[1], which is limited to small clusters, and different variants of quantum Monte Carlo[2], that suffers from the sign problem in fermionic and frustrated systems. Circa 1992, the density matrix renormalization group (DMRG) [3, 4, 5, 6, 7] became one of the major breakthroughs of the past few decades. Despite the success of DMRG for one-dimensional(1D) and quasi-one-dimensional geometries, extensions to actual two-dimensional systems remain challenging and applications are constrained to long cylinders and strips. One promising alternative is to combine one the oldest methods, variational wave functions (VWFs), with neural networks, which have been used to recently with great success in machine learning. The focus of this dissertation is on developing novel variational Monte Carlo algorithms to make neural network variational wave functions applicable to many problems in quantum many-body physics. These algorithms draw from existing variational wave-function, tensor network, and machine learning methods. We calculate dynamical spectral functions using the vector correction and Chebyshev expansion method. We do finite temperature calculations with minimally entangled thermal states. Finally, we do ground state calculations for the frustrated J1−J2 Heisenberg model. We benchmark these results using restricted Boltzmann machines as the neural network for the the variational wave-functions.--Author's abstract

•Jan 1, 2023•0 citations
We examine applicability of the valence bond basis correlator product state ansatz, equivalent to the restricted Boltzmann machine quantum artificial neural-network ansatz, and variational Monte Carlo method for direct optimization of excited energy states to study properties of strongly correlated and frustrated quantum systems. The energy eigenstates are found by stochastic minimization of the variational function for the energy eigenstates, which allows direct optimization of particular energy state without knowledge of the lower energy states. This approach combined with numerous tensor network or artificial neural-network ansatz wave functions then allows further insight into quantum phases and phase transitions in various strongly correlated models by considering properties of these systems beyond the ground-state properties. Also, the method is in general applicable to any dimension and has no sign instability. An example that we consider is the square lattice J1\ensuremath−J2{J}_{1}\ensuremath{-}{J}_{2}J1​\ensuremath−J2​ antiferromagnetic Heisenberg model. The model is one of the most studied models in frustrated quantum magnetism since it is closely related to the disappearance of the antiferromagnetic order in the high-Tc superconducting materials and there is still no agreement about the properties of the system in the highly frustrated regime near J2/J1=0.5{J}_{2}/{J}_{1}=0.5J2​/J1​=0.5. For the J1\ensuremath−J2{J}_{1}\ensuremath{-}{J}_{2}J1​\ensuremath−J2​ model, we write the variational ansatz in terms of the two site correlators and in the valence bond basis and calculate the lowest energy eigenstates in the highly frustrated regime near J2/J1=0.5{J}_{2}/{J}_{1}=0.5J2​/J1​=0.5 where the system has a paramagnetic phase. We find that our results are in good agreement with previously obtained results, which confirms applicability of the method to study frustrated spin systems.
The use of artificial neural networks to represent quantum wave functions has recently attracted interest as a way to solve complex many-body problems. The potential of these variational parametrizations has been supported by analytical and numerical evidence in controlled benchmarks. While approaching the end of the early research phase in this field, it becomes increasingly important to show how neural-network states perform for models and physical problems that constitute a clear open challenge for other many-body computational methods. In this paper, we start addressing this aspect, concentrating on a presently unsolved model describing two-dimensional frustrated magnets. Using a fully convolutional neural network model as a variational ans\"atz, we study the frustrated spin-1/$2{J}_{1}\text{\ensuremath{-}}{J}_{2}$ Heisenberg model on the square lattice. We demonstrate that the resulting predictions for both ground-state energies and properties are competitive with, and often improve upon, existing state-of-the-art methods. In a relatively small region in the parameter space, corresponding to the maximally frustrated regime, our ans\"atz exhibits comparatively good but not the best performance. The gap between the complexity of the models adopted here and those routinely adopted in deep-learning applications is, however, still substantial, such that further improvements in future generations of neural-network quantum states are likely to be expected.
Strongly interacting quantum systems described by non-stoquastic Hamiltonians exhibit rich low-temperature physics. Yet, their study poses a formidable challenge, even for state-of-the-art numerical techniques. Here, we investigate systematically the performance of a class of universal variational wave-functions based on artificial neural networks, by considering the frustrated spin- 1/2 1 / 2 J_1-J_2 J 1 − J 2 Heisenberg model on the square lattice. Focusing on neural network architectures without physics-informed input, we argue in favor of using an ansatz consisting of two decoupled real-valued networks, one for the amplitude and the other for the phase of the variational wavefunction. By introducing concrete mitigation strategies against inherent numerical instabilities in the stochastic reconfiguration algorithm we obtain a variational energy comparable to that reported recently with neural networks that incorporate knowledge about the physical system. Through a detailed analysis of the individual components of the algorithm, we conclude that the rugged nature of the energy landscape constitutes the major obstacle in finding a satisfactory approximation to the ground state wavefunction, and prevents learning the correct sign structure. In particular, we show that in the present setup the neural network expressivity and Monte Carlo sampling are not primary limiting factors.
We introduce Neural Tensor Network States (νννTNS), a variational many-body wave-function ansatz that integrates deep neural networks with tensor-network architectures. In the νννTNS framework, a neural network serves as a disentangler of the wave-function, transforming the physical degrees of freedom into renormalized variables with much less entanglement. The renormalized state is then efficiently encoded by a back-flow tensor network. This construction yields a compact yet highly expressive representation of strongly correlated quantum states. Using convolutional neural networks combined with matrix product states as a concrete implementation, we obtain state-of-the-art variational energies for the spin-1/21/21/2 J1J_1J1​-J2J_2J2​ Heisenberg model on the square lattice at the highly frustrated point J2/J1=0.5J_2/J_1=0.5J2​/J1​=0.5, for systems up to 20×2020\times 2020×20 with periodic boundary conditions. Finite-size scaling of spin, dimer, and plaquette correlations exhibits power-law decay without magnetic or valence-bond long-range order, consistent with a gapless quantum spin-liquid ground state at that point.This νννTNS framework is flexible and naturally extensible to other neural and tensor-network structures, offering a general platform for investigating strongly correlated quantum many-body systems.
The frustrated Heisenberg ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ model on a square lattice is numerically investigated by variational Monte Carlo simulations. We propose an antiferromagnetic fermion resonating-valence-bond (AF-fRVB) state that has the ability to examine the entire phase diagram in the ${J}_{1}\text{\ensuremath{-}}{J}_{2}$ model. Two phase transition points, the second order around J2/J1=0.45{J}_{2}/{J}_{1}=0.45J2​/J1​=0.45 and the first order around J2/J1=0.6{J}_{2}/{J}_{1}=0.6J2​/J1​=0.6, can be extracted more clearly than the conventional bosonic RVB state. At the maximally frustrated point (J2/J1=0.5)({J}_{2}/{J}_{1}=0.5)(J2​/J1​=0.5), the AF-fRVB state shows the variational ground-state energy in the thermodynamic limit very close to the one estimated by the projected entangled pair state at the largest bond dimension available. On the other hand, in the frustrated regime $0.4\ensuremath{\lesssim}{J}_{2}/{J}_{1}\ensuremath{\le}0.5$, AF-fRVB states with exts2\text{ext}\phantom{\rule{0.16em}{0ex}}{s}_{2}exts2​ (using the terminology in the field of iron-based superconductors) and dxy{d}_{xy}dxy​ pairing symmetries are degenerate in the thermodynamic limit, implying the existence of gapless Dirac excitations in the spinon spectrum.
We propose a class of variational wave functions, namely the correlated valence bond states, for the frustrated Hamiltonian in the paramagnetic phase. This class of wave functions admits negative amplitude and the same sub-lattice pairing when a bipartite lattice is considered, thus suffers from the negative sign problem. However if applied to small systems, the sign problem is manageable using the standard variational Monte Carlo method. We optimize the wave functions for the J1-J2 Anti ferromagnetic Heisenberg model on a square lattice in the coupling region J2/J1 \in [0.45 : 0.56] for system sizes L = 4, 6, 8. To calculate the correlation functions and the order parameters for larger systems, we make the extensive Monte Carlo samplings using the variational parameters optimized at system size L = 8. We find that the paramagnetic phase is a gap-less spin liquid in the entire range of J2/J1 \in [0.45 : 0.56] with a gap-less singlet excitation and a gaped triplet excitation.
Understanding strongly correlated quantum many-body systems requires dealing with a largeconfiguration space comprised of a set of all possible measurable configurations. The total number of configurations grows exponentially with the size of the system, which makes exact numerical calculations impossible for even moderately sized systems. Since the advent of high-temperature superconductivity and the subsequent interest in strongly correlated phases of matter, progress in the field has been marked by ingenuity of the field to overcome these computational limitations. The first techniques to emerge were inspired by quantum chemistry and based on exact diagonalization[1], which is limited to small clusters, and different variants of quantum Monte Carlo[2], that suffers from the sign problem in fermionic and frustrated systems. Circa 1992, the density matrix renormalization group (DMRG) [3, 4, 5, 6, 7] became one of the major breakthroughs of the past few decades. Despite the success of DMRG for one-dimensional(1D) and quasi-one-dimensional geometries, extensions to actual two-dimensional systems remain challenging and applications are constrained to long cylinders and strips. One promising alternative is to combine one the oldest methods, variational wave functions (VWFs), with neural networks, which have been used to recently with great success in machine learning. The focus of this dissertation is on developing novel variational Monte Carlo algorithms to make neural network variational wave functions applicable to many problems in quantum many-body physics. These algorithms draw from existing variational wave-function, tensor network, and machine learning methods. We calculate dynamical spectral functions using the vector correction and Chebyshev expansion method. We do finite temperature calculations with minimally entangled thermal states. Finally, we do ground state calculations for the frustrated J1−J2 Heisenberg model. We benchmark these results using restricted Boltzmann machines as the neural network for the the variational wave-functions.--Author's abstract