Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2502.17144 · Physical review. B./Physical review. B

Leveraging recurrence in neural network wavefunctions for large-scale simulations of Heisenberg antiferromagnets on the square lattice

M. Schuyler Moss, Roeland Wiersema, Mohamed Hibat-Allah, Juan Carrasquilla, Roger G. Melko

Published Sep 29, 2025• 18 citations
arXivHTMLPDF

Abstract

Machine-learning-based variational Monte Carlo simulations are a promising approach for targeting quantum many-body ground states, especially in two dimensions and in cases where the ground state is known to have a nontrivial sign structure. While many state-of-the-art variational energies have been reached with these methods for finite-size systems, little work has been done to use these results to extract information about the target state in the thermodynamic limit. In this work, we employ recurrent neural networks (RNNs) as a variational ans\"atze, and leverage their recurrent nature to simulate the ground states of progressively larger systems through iterative retraining. This transfer learning technique allows us to simulate spin-$\frac{1}{2}$ systems on lattices with more than 1,000 spins without beginning optimization from scratch for each system size, thus reducing the demands for computational resources. In this study, we focus on the square-lattice antiferromagnetic Heisenberg model, where it is possible to carefully benchmark our results. We show that we are able to systematically improve the accuracy of the results from our simulations by increasing the training time, and obtain results for finite-sized lattices that are in good agreement with the literature values. Furthermore, we use these results to extract accurate estimates of the ground-state properties in the thermodynamic limit. This work demonstrates that RNN wavefunctions are able to extract accurate information about quantum many-body systems in the thermodynamic limit.

DOI
10.1103/6ccd-wzhz

Related papers

Leveraging recurrence in neural network wavefunctions for large-scale simulations of Heisenberg antiferromagnets on the triangular lattice

M. Schuyler Moss, Roeland Wiersema, Mohamed Hibat-Allah +2 more

Variational Monte Carlo simulations have been crucial for understanding quantum many-body systems, especially when the Hamiltonian is frustrated and the ground-state wavefunction has a nontrivial sign structure. In this paper, we use recurrent neural network (RNN) wavefunction ans\"atze to study the triangular-lattice antiferromagnetic Heisenberg model (TLAHM) for lattice sizes up to $30\ifmmode\times\else\texttimes\fi{}30$. In a recent study [M. S. Moss et al., Phys. Rev. B 112, 134450 (2025)], the authors demonstrated how RNN wavefunctions can be iteratively retrained in order to obtain variational results for multiple lattice sizes with a reasonable amount of compute. That study, which looked at the sign-free, square-lattice antiferromagnetic Heisenberg model, showed favorable scaling properties, allowing accurate finite-size extrapolations to the thermodynamic limit. In contrast, our present results illustrate in detail the relative difficulty in simulating the sign-problematic TLAHM. We find that the accuracy of our simulations can be significantly improved by transforming the Hamiltonian with a judicious choice of basis rotation. We also show that a similar benefit can be achieved by using variational neural annealing, an alternative optimization technique that minimizes a pseudo-free energy. Ultimately, we are able to obtain estimates of the ground-state properties of the TLAHM in the thermodynamic limit that are in close agreement with values in the literature, showing that RNN wavefunctions provide a powerful toolbox for performing finite-size scaling studies for frustrated quantum many-body systems.

arXiv:2505.20406•Physical review. B./Physical review. B•Aug 28, 2025•11 citations

Approaching the Thermodynamic Limit with Neural-Network Quantum States

Luciano Loris Viteritti, Riccardo Rende, Subir Sachdev +1 more

Accessing the thermodynamic-limit properties of strongly correlated quantum matter requires simulations on very large lattices, a regime that remains challenging for numerical methods, especially in frustrated two-dimensional systems. We introduce the Spatial Attention mechanism, a minimal and physically interpretable inductive bias for Neural-Network Quantum States, implemented as a single learned length scale within the Transformer architecture. This bias stabilizes large-scale optimization and enables access to thermodynamic-limit physics through highly accurate simulations on unprecedented system sizes within the Variational Monte Carlo framework. Applied to the spin-$\tfrac12$ triangular-lattice Heisenberg antiferromagnet, our approach achieves state-of-the-art results on clusters of up to $42\times42$ sites. The ability to simulate such large systems allows controlled finite-size scaling of energies and order parameters, enabling the extraction of experimentally relevant quantities such as spin-wave velocities and uniform susceptibilities. In turn, we find extrapolated thermodynamic limit energies systematically better than those obtained with tensor-network approaches such as iPEPS. The resulting magnetization is strongly renormalized, $M_0=0.148(1)$ (about $30\%$ of the classical value), revealing that less accurate variational states systematically overestimate magnetic order. Analysis of the optimized wave function further suggests an intrinsically non-local sign structure, indicating that the sign problem cannot be removed by local basis transformations. We finally demonstrate the generality of the method by obtaining state-of-the-art energies for a $J_1$-$J_2$ Heisenberg model on a $20\times20$ square lattice, outperforming Residual Convolutional Neural Networks.

cond-mat.str-elCross-listedarXiv:2602.02665•Feb 4, 2026•28 citations

Iterative Retraining of Quantum Spin Models Using Recurrent Neural Networks

Roth, Christopher

Modeling quantum many-body systems is enormously challenging due to the exponential scaling of Hilbert dimension with system size. Finding efficient compressions of the wavefunction is key to building scalable models. Here, we introduce iterative retraining, an approach for simulating bulk quantum systems that uses recurrent neural networks (RNNs). By mapping translations in the lattice vector to the time index of an RNN, we are able to efficiently capture the near translational invariance of large lattices. We show that we can use this symmetry mapping to simulate very large systems in one and two dimensions. We do so by 'growing' our model, iteratively retraining the same model on progressively larger lattices until edge effects become negligible. We argue that this scheme generalizes more naturally to higher dimensions than Density Matrix Renormalization Group.

arXiv:2003.06228•Mar 9, 2020•48 citations

Supplementing Recurrent Neural Network Wave Functions with Symmetry and Annealing to Improve Accuracy

Mohamed Hibat-Allah, Roger G. Melko, Juan Carrasquilla

Recurrent neural networks (RNNs) are a class of neural networks that have emerged from the paradigm of artificial intelligence and has enabled lots of interesting advances in the field of natural language processing. Interestingly, these architectures were shown to be powerful ansatze to approximate the ground state of quantum systems. Here, we build over the results of [Phys. Rev. Research 2, 023358 (2020)] and construct a more powerful RNN wave function ansatz in two dimensions. We use symmetry and annealing to obtain accurate estimates of ground state energies of the two-dimensional (2D) Heisenberg model, on the square lattice and on the triangular lattice. We show that our method is superior to Density Matrix Renormalisation Group (DMRG) for system sizes larger than or equal to $14 \times 14$ on the triangular lattice.

arXiv:2207.14314•Jul 28, 2022•42 citations

Parallel Scan Recurrent Neural Quantum States for Scalable Variational Monte Carlo

Ejaaz Merali, Mohamed Hibat-Allah, Mohammad Kohandel +2 more

Neural-network quantum states have emerged as a powerful variational framework for quantum many-body systems, with recent progress often driven by massively parallel architectures such as transformers. Recurrent neural network quantum states, however, are frequently regarded as intrinsically sequential and therefore less scalable. Here we revisit this view by showing that modern recurrent architectures can support fast, accurate, and computationally accessible neural quantum state simulations. Using autoregressive recurrent wave functions together with recent advances in parallelizable recurrence, we develop variational ansätze, called parallel scan recurrent neural quantum states (PSR-NQS), which can be trained efficiently within variational Monte Carlo in one and two spatial dimensions. We demonstrate accurate benchmark results and show that, with iterative retraining, our approach reaches two-dimensional spin lattices as large as $52\times52$ while remaining in agreement with available quantum Monte Carlo data. Our results establish recurrent architectures as a practical and promising route toward scalable neural quantum state simulations with modest computational resources.

cond-mat.str-elCross-listedarXiv:2605.13807•May 14, 2026•4 citations

Many-body neural network wavefunction for a non-Hermitian Ising chain

Lavoisier Wah, Remmy A. M. Zen, Flore K. Kunst

Non-Hermitian (NH) quantum systems have emerged as a powerful framework for describing open quantum systems, nonequilibrium dynamics, and engineered quantum optical materials. However, solving the ground-state properties of NH systems is challenging due to the exponential scaling of the Hilbert space and exotic phenomena such as the emergence of exceptional points. Another challenge arises from the limitations of traditional methods like exact diagonalization (ED). For the past decade, neural networks (NNs) have shown promise in approximating many-body wavefunctions, yet their application to NH systems remains largely unexplored. In this paper, we explore different NN architectures to investigate the ground-state properties of a parity-time-symmetric, one-dimensional NH, transverse field Ising model with a complex spectrum by employing a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), and a multilayer perceptron (MLP). We construct the NN-based many-body wavefunctions and validate our approach by recovering the ground-state properties of the model for small system sizes, finding excellent agreement with ED. Furthermore, for larger system sizes, we demonstrate that the RNN outperforms both the RBM and MLP. However, we show that the accuracy of the RBM and MLP can be significantly improved through transfer learning, allowing them to perform comparably to the RNN for larger system sizes. These results highlight the potential of neural-network-based approaches—particularly for accurately capturing the low-energy physics of NH quantum systems in case of both weak and strong non-Hermiticity.

arXiv:2506.11222•Physical Review Research•Oct 31, 2025•2 citations
Machine-learning-based variational Monte Carlo simulations are a promising approach for targeting quantum many-body ground states, especially in two dimensions and in cases where the ground state is known to have a nontrivial sign structure. While many state-of-the-art variational energies have been reached with these methods for finite-size systems, little work has been done to use these results to extract information about the target state in the thermodynamic limit. In this work, we employ recurrent neural networks (RNNs) as a variational ans"atze, and leverage their recurrent nature to simulate the ground states of progressively larger systems through iterative retraining. This transfer learning technique allows us to simulate spin-12\frac{1}{2}21​ systems on lattices with more than 1,000 spins without beginning optimization from scratch for each system size, thus reducing the demands for computational resources. In this study, we focus on the square-lattice antiferromagnetic Heisenberg model, where it is possible to carefully benchmark our results. We show that we are able to systematically improve the accuracy of the results from our simulations by increasing the training time, and obtain results for finite-sized lattices that are in good agreement with the literature values. Furthermore, we use these results to extract accurate estimates of the ground-state properties in the thermodynamic limit. This work demonstrates that RNN wavefunctions are able to extract accurate information about quantum many-body systems in the thermodynamic limit.
Variational Monte Carlo simulations have been crucial for understanding quantum many-body systems, especially when the Hamiltonian is frustrated and the ground-state wavefunction has a nontrivial sign structure. In this paper, we use recurrent neural network (RNN) wavefunction ans\"atze to study the triangular-lattice antiferromagnetic Heisenberg model (TLAHM) for lattice sizes up to $30\ifmmode\times\else\texttimes\fi{}30$. In a recent study [M. S. Moss et al., Phys. Rev. B 112, 134450 (2025)], the authors demonstrated how RNN wavefunctions can be iteratively retrained in order to obtain variational results for multiple lattice sizes with a reasonable amount of compute. That study, which looked at the sign-free, square-lattice antiferromagnetic Heisenberg model, showed favorable scaling properties, allowing accurate finite-size extrapolations to the thermodynamic limit. In contrast, our present results illustrate in detail the relative difficulty in simulating the sign-problematic TLAHM. We find that the accuracy of our simulations can be significantly improved by transforming the Hamiltonian with a judicious choice of basis rotation. We also show that a similar benefit can be achieved by using variational neural annealing, an alternative optimization technique that minimizes a pseudo-free energy. Ultimately, we are able to obtain estimates of the ground-state properties of the TLAHM in the thermodynamic limit that are in close agreement with values in the literature, showing that RNN wavefunctions provide a powerful toolbox for performing finite-size scaling studies for frustrated quantum many-body systems.
Accessing the thermodynamic-limit properties of strongly correlated quantum matter requires simulations on very large lattices, a regime that remains challenging for numerical methods, especially in frustrated two-dimensional systems. We introduce the Spatial Attention mechanism, a minimal and physically interpretable inductive bias for Neural-Network Quantum States, implemented as a single learned length scale within the Transformer architecture. This bias stabilizes large-scale optimization and enables access to thermodynamic-limit physics through highly accurate simulations on unprecedented system sizes within the Variational Monte Carlo framework. Applied to the spin-12\tfrac1221​ triangular-lattice Heisenberg antiferromagnet, our approach achieves state-of-the-art results on clusters of up to 42×4242\times4242×42 sites. The ability to simulate such large systems allows controlled finite-size scaling of energies and order parameters, enabling the extraction of experimentally relevant quantities such as spin-wave velocities and uniform susceptibilities. In turn, we find extrapolated thermodynamic limit energies systematically better than those obtained with tensor-network approaches such as iPEPS. The resulting magnetization is strongly renormalized, M0=0.148(1)M_0=0.148(1)M0​=0.148(1) (about 30%30\%30% of the classical value), revealing that less accurate variational states systematically overestimate magnetic order. Analysis of the optimized wave function further suggests an intrinsically non-local sign structure, indicating that the sign problem cannot be removed by local basis transformations. We finally demonstrate the generality of the method by obtaining state-of-the-art energies for a J1J_1J1​-J2J_2J2​ Heisenberg model on a 20×2020\times2020×20 square lattice, outperforming Residual Convolutional Neural Networks.
Modeling quantum many-body systems is enormously challenging due to the exponential scaling of Hilbert dimension with system size. Finding efficient compressions of the wavefunction is key to building scalable models. Here, we introduce iterative retraining, an approach for simulating bulk quantum systems that uses recurrent neural networks (RNNs). By mapping translations in the lattice vector to the time index of an RNN, we are able to efficiently capture the near translational invariance of large lattices. We show that we can use this symmetry mapping to simulate very large systems in one and two dimensions. We do so by 'growing' our model, iteratively retraining the same model on progressively larger lattices until edge effects become negligible. We argue that this scheme generalizes more naturally to higher dimensions than Density Matrix Renormalization Group.
Recurrent neural networks (RNNs) are a class of neural networks that have emerged from the paradigm of artificial intelligence and has enabled lots of interesting advances in the field of natural language processing. Interestingly, these architectures were shown to be powerful ansatze to approximate the ground state of quantum systems. Here, we build over the results of [Phys. Rev. Research 2, 023358 (2020)] and construct a more powerful RNN wave function ansatz in two dimensions. We use symmetry and annealing to obtain accurate estimates of ground state energies of the two-dimensional (2D) Heisenberg model, on the square lattice and on the triangular lattice. We show that our method is superior to Density Matrix Renormalisation Group (DMRG) for system sizes larger than or equal to 14×1414 \times 1414×14 on the triangular lattice.
Neural-network quantum states have emerged as a powerful variational framework for quantum many-body systems, with recent progress often driven by massively parallel architectures such as transformers. Recurrent neural network quantum states, however, are frequently regarded as intrinsically sequential and therefore less scalable. Here we revisit this view by showing that modern recurrent architectures can support fast, accurate, and computationally accessible neural quantum state simulations. Using autoregressive recurrent wave functions together with recent advances in parallelizable recurrence, we develop variational ansätze, called parallel scan recurrent neural quantum states (PSR-NQS), which can be trained efficiently within variational Monte Carlo in one and two spatial dimensions. We demonstrate accurate benchmark results and show that, with iterative retraining, our approach reaches two-dimensional spin lattices as large as 52×5252\times5252×52 while remaining in agreement with available quantum Monte Carlo data. Our results establish recurrent architectures as a practical and promising route toward scalable neural quantum state simulations with modest computational resources.
Non-Hermitian (NH) quantum systems have emerged as a powerful framework for describing open quantum systems, nonequilibrium dynamics, and engineered quantum optical materials. However, solving the ground-state properties of NH systems is challenging due to the exponential scaling of the Hilbert space and exotic phenomena such as the emergence of exceptional points. Another challenge arises from the limitations of traditional methods like exact diagonalization (ED). For the past decade, neural networks (NNs) have shown promise in approximating many-body wavefunctions, yet their application to NH systems remains largely unexplored. In this paper, we explore different NN architectures to investigate the ground-state properties of a parity-time-symmetric, one-dimensional NH, transverse field Ising model with a complex spectrum by employing a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), and a multilayer perceptron (MLP). We construct the NN-based many-body wavefunctions and validate our approach by recovering the ground-state properties of the model for small system sizes, finding excellent agreement with ED. Furthermore, for larger system sizes, we demonstrate that the RNN outperforms both the RBM and MLP. However, we show that the accuracy of the RBM and MLP can be significantly improved through transfer learning, allowing them to perform comparably to the RNN for larger system sizes. These results highlight the potential of neural-network-based approaches—particularly for accurately capturing the low-energy physics of NH quantum systems in case of both weak and strong non-Hermiticity.