Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2211.07749 · Physical review. B./Physical review. B

High-accuracy variational Monte Carlo for frustrated magnets with deep neural networks

Christopher Roth, Attila Szabó, Allan H. MacDonald

Published Aug 8, 2023• 77 citations
arXivHTMLPDF

Abstract

Establishing quantum spin liquid physics in microscopic models is a daunting task due to a variety of competing low-energy states, requiring sophisticated computational approaches to find the true ground state. Here, the authors present such a technique, based on neural networks with space-group symmetry, to obtain significantly improved ground-state wave functions of frustrated Heisenberg models. The authors also use this approach to find excited states and provide a blueprint for testing analytical predictions from spin-liquid theories.

DOI
10.1103/physrevb.108.054410

Related papers

Symmetries and Many-Body Excitations with Neural-Network Quantum States

Kenny Choo, Giuseppe Carleo, Nicolas Regnault +1 more

Artificial neural networks have been recently introduced as a general ansatz to represent many-body wave functions. In conjunction with variational Monte Carlo calculations, this ansatz has been applied to find Hamiltonian ground states and their energies. Here, we provide extensions of this method to study excited states, a central task in several many-body quantum calculations. First, we give a prescription that allows us to target eigenstates of a (nonlocal) symmetry of the Hamiltonian. Second, we give an algorithm to compute low-lying excited states without symmetries. We demonstrate our approach with both restricted Boltzmann machines and feed-forward neural networks. Results are shown for the one-dimensional spin-1/2 Heisenberg model, and for the one-dimensional Bose-Hubbard model. When comparing to exact results, we obtain good agreement for a large range of excited-states energies. Interestingly, we find that deep networks typically outperform shallow architectures for high-energy states.

arXiv:1807.03325•Physical Review Letters•Oct 19, 2018•274 citations

Two-dimensional frustrated J1−J2 model studied with neural network quantum states

Kenny Choo, Titus Neupert, Giuseppe Carleo

The use of artificial neural networks to represent quantum wave functions has recently attracted interest as a way to solve complex many-body problems. The potential of these variational parametrizations has been supported by analytical and numerical evidence in controlled benchmarks. While approaching the end of the early research phase in this field, it becomes increasingly important to show how neural-network states perform for models and physical problems that constitute a clear open challenge for other many-body computational methods. In this paper, we start addressing this aspect, concentrating on a presently unsolved model describing two-dimensional frustrated magnets. Using a fully convolutional neural network model as a variational ans\"atz, we study the frustrated spin-1/$2{J}_{1}\text{\ensuremath{-}}{J}_{2}$ Heisenberg model on the square lattice. We demonstrate that the resulting predictions for both ground-state energies and properties are competitive with, and often improve upon, existing state-of-the-art methods. In a relatively small region in the parameter space, corresponding to the maximally frustrated regime, our ans\"atz exhibits comparatively good but not the best performance. The gap between the complexity of the models adopted here and those routinely adopted in deep-learning applications is, however, still substantial, such that further improvements in future generations of neural-network quantum states are likely to be expected.

arXiv:1903.06713•Physical review. B./Physical review. B•Sep 11, 2019•272 citations

Group Convolutional Neural Networks Improve Quantum State Accuracy

Roth, Christopher, Allan H. MacDonald

Neural networks are a promising tool for simulating quantum many body systems. Recently, it has been shown that neural network-based models describe quantum many body systems more accurately when they are constrained to have the correct symmetry properties. In this paper, we show how to create maximally expressive models for quantum states with specific symmetry properties by drawing on literature from the machine learning community. We implement group equivariant convolutional networks (G-CNN) \cite{cohen2016group}, and demonstrate that performance improvements can be achieved without increasing memory use. We show that G-CNNs achieve very good accuracy for Heisenberg quantum spin models in both ordered and spin liquid regimes, and improve the ground state accuracy on the triangular lattice over other variational Monte-Carlo methods.

arXiv:2104.05085•Apr 11, 2021•86 citations

Static and dynamical properties of frustrated spin models

Francesco Ferrari

This thesis is devoted to the numerical investigation of quantum spin models which describe the low-energy physics of frustrated magnets. At extremely low temperatures, these systems can host the so-called spin liquid phase, an unconventional state of matter characterized by a high degree of quantum entanglement and the absence of magnetic order. The experimental identification of the spin liquid phase in actual materials relies on the detection of its distinctive excitations (named spinons), which possess fractional quantum numbers and can be probed by inelastic neutron scattering experiments. From the theoretical point of view, variational methods have been largely employed to tackle ground state properties of frustrated spin models. In particular, variational Monte Carlo techniques based on Gutzwiller-projected fermionic wave functions have been shown to provide accurate results for several frustrated systems. In this thesis, we pursue an extension of this variational scheme to target dynamical spectra, which are directly measured by inelastic neutron scattering experiments. Specifically, we compute the dynamical structure factor by constructing approximate excited states, which are obtained by applying two-spinon operators to the ground state wave function. Our results prove that this variational method can accurately describe the spectral features of different spin systems. Focusing on prototypical frustrated models on the square and triangular lattices, we observe how the dynamical structure factor reflects the phase transition between a magnetically ordered phase with spin wave excitations, to a spin liquid state with fractional degrees of freedom. In addition to spectral properties, we also explore new directions to improve the accuracy of Gutzwiller-projected states by the application of a neural network correlator, in the form of a restricted Boltzmann machine. While this hybrid variational scheme provides a considerable improvement of the variational energy in the case of unfrustrated spin models, less satisfactory results are obtained for frustrated systems, which call for further refinements of the neural network variational Ansätze.

•Oct 25, 2019•1 citation

Ground State Energy Calculations of the Kitaev-Gamma Honeycomb Model Using Neural Quantum States

Sepulveda, Daniel

Quantum spin liquids (QSLs) are highly elusive states of matter that are char- acterized by long range quantum entanglement and the lack of long range magnetic ordering. There are a variety of candidate materials with QSLs as well as model Hamiltonians where exact QSL ground states can be proven. The Kitaev honeycomb model is among the few models with an analytically derived QSL ground state. Ad- ditional interactions such as the Gamma and Heisenberg interactions are included to match real behaviours in candidate Kitaev materials to form the larger JKΓΓ′model. Due to the size of the Hilbert spaces associated with many-body systems, numerical techniques centre around the use of more efficient representations of the wavefunc- tion that reduce the need for exponential parameterization. Neural Quantum States (NQS) are one of the latest additions to the toolkit, making use of neural networks to represent the mapping between spin configurations and their corresponding wave- function amplitudes. By using variational monte carlo (VMC) to derive the ground state, the problem of finding the associated NQS representation translates to a Ma- chine Learning task of minimizing a cost function through gradient descent. Group Convolutional Neural Networks (GCNNs) are one of the latest NQS architectures which construct wavefunction ansatzes that are symmetric to a group of symmetries and have yielded state-of-the-art results in benchmark models. In this thesis, ground state calculations were performed using GCNNs for the Kitaev and Gamma honey- comb models and ground state properties were investigated. In the Kitaev model, optimization was affected by a complicated learning landscape, limiting the conver- gence towards the ground state. Performance improved with the Gamma model for smaller systems but still fell short of confirming an identical stripy patterned ground state found with iDMRG and iPEPS.

•Jan 1, 2025•0 citations

Efficient neural-network based variational Monte Carlo scheme for direct optimization of excited energy states in frustrated quantum systems

Tanja Đurić, Tomislav Ševa

We examine applicability of the valence bond basis correlator product state ansatz, equivalent to the restricted Boltzmann machine quantum artificial neural-network ansatz, and variational Monte Carlo method for direct optimization of excited energy states to study properties of strongly correlated and frustrated quantum systems. The energy eigenstates are found by stochastic minimization of the variational function for the energy eigenstates, which allows direct optimization of particular energy state without knowledge of the lower energy states. This approach combined with numerous tensor network or artificial neural-network ansatz wave functions then allows further insight into quantum phases and phase transitions in various strongly correlated models by considering properties of these systems beyond the ground-state properties. Also, the method is in general applicable to any dimension and has no sign instability. An example that we consider is the square lattice ${J}_{1}\ensuremath{-}{J}_{2}$ antiferromagnetic Heisenberg model. The model is one of the most studied models in frustrated quantum magnetism since it is closely related to the disappearance of the antiferromagnetic order in the high-Tc superconducting materials and there is still no agreement about the properties of the system in the highly frustrated regime near ${J}_{2}/{J}_{1}=0.5$. For the ${J}_{1}\ensuremath{-}{J}_{2}$ model, we write the variational ansatz in terms of the two site correlators and in the valence bond basis and calculate the lowest energy eigenstates in the highly frustrated regime near ${J}_{2}/{J}_{1}=0.5$ where the system has a paramagnetic phase. We find that our results are in good agreement with previously obtained results, which confirms applicability of the method to study frustrated spin systems.

arXiv:2002.09246•Physical review. B./Physical review. B•Aug 3, 2020•9 citations
Establishing quantum spin liquid physics in microscopic models is a daunting task due to a variety of competing low-energy states, requiring sophisticated computational approaches to find the true ground state. Here, the authors present such a technique, based on neural networks with space-group symmetry, to obtain significantly improved ground-state wave functions of frustrated Heisenberg models. The authors also use this approach to find excited states and provide a blueprint for testing analytical predictions from spin-liquid theories.
Artificial neural networks have been recently introduced as a general ansatz to represent many-body wave functions. In conjunction with variational Monte Carlo calculations, this ansatz has been applied to find Hamiltonian ground states and their energies. Here, we provide extensions of this method to study excited states, a central task in several many-body quantum calculations. First, we give a prescription that allows us to target eigenstates of a (nonlocal) symmetry of the Hamiltonian. Second, we give an algorithm to compute low-lying excited states without symmetries. We demonstrate our approach with both restricted Boltzmann machines and feed-forward neural networks. Results are shown for the one-dimensional spin-1/2 Heisenberg model, and for the one-dimensional Bose-Hubbard model. When comparing to exact results, we obtain good agreement for a large range of excited-states energies. Interestingly, we find that deep networks typically outperform shallow architectures for high-energy states.
The use of artificial neural networks to represent quantum wave functions has recently attracted interest as a way to solve complex many-body problems. The potential of these variational parametrizations has been supported by analytical and numerical evidence in controlled benchmarks. While approaching the end of the early research phase in this field, it becomes increasingly important to show how neural-network states perform for models and physical problems that constitute a clear open challenge for other many-body computational methods. In this paper, we start addressing this aspect, concentrating on a presently unsolved model describing two-dimensional frustrated magnets. Using a fully convolutional neural network model as a variational ans\"atz, we study the frustrated spin-1/$2{J}_{1}\text{\ensuremath{-}}{J}_{2}$ Heisenberg model on the square lattice. We demonstrate that the resulting predictions for both ground-state energies and properties are competitive with, and often improve upon, existing state-of-the-art methods. In a relatively small region in the parameter space, corresponding to the maximally frustrated regime, our ans\"atz exhibits comparatively good but not the best performance. The gap between the complexity of the models adopted here and those routinely adopted in deep-learning applications is, however, still substantial, such that further improvements in future generations of neural-network quantum states are likely to be expected.
Neural networks are a promising tool for simulating quantum many body systems. Recently, it has been shown that neural network-based models describe quantum many body systems more accurately when they are constrained to have the correct symmetry properties. In this paper, we show how to create maximally expressive models for quantum states with specific symmetry properties by drawing on literature from the machine learning community. We implement group equivariant convolutional networks (G-CNN) \cite{cohen2016group}, and demonstrate that performance improvements can be achieved without increasing memory use. We show that G-CNNs achieve very good accuracy for Heisenberg quantum spin models in both ordered and spin liquid regimes, and improve the ground state accuracy on the triangular lattice over other variational Monte-Carlo methods.
This thesis is devoted to the numerical investigation of quantum spin models which describe the low-energy physics of frustrated magnets. At extremely low temperatures, these systems can host the so-called spin liquid phase, an unconventional state of matter characterized by a high degree of quantum entanglement and the absence of magnetic order. The experimental identification of the spin liquid phase in actual materials relies on the detection of its distinctive excitations (named spinons), which possess fractional quantum numbers and can be probed by inelastic neutron scattering experiments. From the theoretical point of view, variational methods have been largely employed to tackle ground state properties of frustrated spin models. In particular, variational Monte Carlo techniques based on Gutzwiller-projected fermionic wave functions have been shown to provide accurate results for several frustrated systems. In this thesis, we pursue an extension of this variational scheme to target dynamical spectra, which are directly measured by inelastic neutron scattering experiments. Specifically, we compute the dynamical structure factor by constructing approximate excited states, which are obtained by applying two-spinon operators to the ground state wave function. Our results prove that this variational method can accurately describe the spectral features of different spin systems. Focusing on prototypical frustrated models on the square and triangular lattices, we observe how the dynamical structure factor reflects the phase transition between a magnetically ordered phase with spin wave excitations, to a spin liquid state with fractional degrees of freedom. In addition to spectral properties, we also explore new directions to improve the accuracy of Gutzwiller-projected states by the application of a neural network correlator, in the form of a restricted Boltzmann machine. While this hybrid variational scheme provides a considerable improvement of the variational energy in the case of unfrustrated spin models, less satisfactory results are obtained for frustrated systems, which call for further refinements of the neural network variational Ansätze.
Quantum spin liquids (QSLs) are highly elusive states of matter that are char- acterized by long range quantum entanglement and the lack of long range magnetic ordering. There are a variety of candidate materials with QSLs as well as model Hamiltonians where exact QSL ground states can be proven. The Kitaev honeycomb model is among the few models with an analytically derived QSL ground state. Ad- ditional interactions such as the Gamma and Heisenberg interactions are included to match real behaviours in candidate Kitaev materials to form the larger JKΓΓ′model. Due to the size of the Hilbert spaces associated with many-body systems, numerical techniques centre around the use of more efficient representations of the wavefunc- tion that reduce the need for exponential parameterization. Neural Quantum States (NQS) are one of the latest additions to the toolkit, making use of neural networks to represent the mapping between spin configurations and their corresponding wave- function amplitudes. By using variational monte carlo (VMC) to derive the ground state, the problem of finding the associated NQS representation translates to a Ma- chine Learning task of minimizing a cost function through gradient descent. Group Convolutional Neural Networks (GCNNs) are one of the latest NQS architectures which construct wavefunction ansatzes that are symmetric to a group of symmetries and have yielded state-of-the-art results in benchmark models. In this thesis, ground state calculations were performed using GCNNs for the Kitaev and Gamma honey- comb models and ground state properties were investigated. In the Kitaev model, optimization was affected by a complicated learning landscape, limiting the conver- gence towards the ground state. Performance improved with the Gamma model for smaller systems but still fell short of confirming an identical stripy patterned ground state found with iDMRG and iPEPS.
We examine applicability of the valence bond basis correlator product state ansatz, equivalent to the restricted Boltzmann machine quantum artificial neural-network ansatz, and variational Monte Carlo method for direct optimization of excited energy states to study properties of strongly correlated and frustrated quantum systems. The energy eigenstates are found by stochastic minimization of the variational function for the energy eigenstates, which allows direct optimization of particular energy state without knowledge of the lower energy states. This approach combined with numerous tensor network or artificial neural-network ansatz wave functions then allows further insight into quantum phases and phase transitions in various strongly correlated models by considering properties of these systems beyond the ground-state properties. Also, the method is in general applicable to any dimension and has no sign instability. An example that we consider is the square lattice ${J}_{1}\ensuremath{-}{J}_{2}$ antiferromagnetic Heisenberg model. The model is one of the most studied models in frustrated quantum magnetism since it is closely related to the disappearance of the antiferromagnetic order in the high-Tc superconducting materials and there is still no agreement about the properties of the system in the highly frustrated regime near J2/J1=0.5{J}_{2}/{J}_{1}=0.5J2​/J1​=0.5. For the ${J}_{1}\ensuremath{-}{J}_{2}$ model, we write the variational ansatz in terms of the two site correlators and in the valence bond basis and calculate the lowest energy eigenstates in the highly frustrated regime near J2/J1=0.5{J}_{2}/{J}_{1}=0.5J2​/J1​=0.5 where the system has a paramagnetic phase. We find that our results are in good agreement with previously obtained results, which confirms applicability of the method to study frustrated spin systems.