Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1910.13454

Multi-Layer Restricted Boltzmann Machine Representation of 1D Quantum Many-Body Wave Functions

Huan He, Yunqin Zheng, Bogdan Andrei Bernevig, Germán Sierra

Published Oct 29, 2019• 10 citations
arXivHTMLPDF

Abstract

We consider representing two classes of 1D quantum wave functions of spin systems, including the AKLT and CFT correlator wave functions, in terms of multi-layer restricted Boltzmann machines. In our prescription, the AKLT wave function can be exactly represented by a 2-layer restricted Boltzmann machine with five hidden spins per visible spin. The construction can be generalized to prove that any MPS wave function on $N$ unit cells with finite bond dimension can be approximated by a 2-layer restricted Boltzmann machine with $\mathcal{O}(N)$ hidden spins within an error which scales linearly with $N$. The Haldane-Shastry wave function or a chiral boson CFT correlator wave function, as any Jastrow type of wave functions, can be exactly written as a 1-layer Boltzmann machine with $\mathcal{O}(N^2)$ hidden spins and $N$ visible spins. Applying the cumulant expansion, we further find that the chiral boson CFT correlator wave function (with small vertex operator conformal dimension $α$, i.e., $α<0.1$) can be approximated, within 99.9\% accuracy up to 22 visible spins, by a 1-layer RBM with $\mathcal{O}(N)$ hidden spins. The cumulant expansion also leads us to a physically inspiring result in which the hidden spins of the restricted Boltzmann machine can be interpreted as the conformal tower of the chiral boson CFT on the cylinder.

DOI
10.48550/arxiv.1910.13454

Related papers

Neural-Network Quantum States for Spin-1 Systems: Spin-Basis and Parameterization Effects on Compactness of Representations

Michael Y. Pei, Stephen R. L. Clark

Neural network quantum states (NQS) have been widely applied to spin-1/2 systems, where they have proven to be highly effective. The application to systems with larger on-site dimension, such as spin-1 or bosonic systems, has been explored less and predominantly using spin-1/2 Restricted Boltzmann Machines (RBMs) with a one-hot/unary encoding. Here, we propose a more direct generalization of RBMs for spin-1 that retains the key properties of the standard spin-1/2 RBM, specifically trivial product states representations, labeling freedom for the visible variables and gauge equivalence to the tensor network formulation. To test this new approach, we present variational Monte Carlo (VMC) calculations for the spin-1 anti-ferromagnetic Heisenberg (AFH) model and benchmark it against the one-hot/unary encoded RBM demonstrating that it achieves the same accuracy with substantially fewer variational parameters. Furthermore, we investigate how the hidden unit complexity of NQS depend on the local single-spin basis used. Exploiting the tensor network version of our RBM we construct an analytic NQS representation of the Affleck-Kennedy-Lieb-Tasaki (AKLT) state in the xyz spin-1 basis using only M=2N hidden units, compared to M∼O(N2) required in the Sz basis. Additional VMC calculations provide strong evidence that the AKLT state in fact possesses an exact compact NQS representation in the xyz basis with only M=N hidden units. These insights help to further unravel how to most effectively adapt the NQS framework for more complex quantum systems.

arXiv:2105.08579•Entropy•Jul 9, 2021•9 citations

Accuracy of restricted Boltzmann machines for the one-dimensional $J_1-J_2$ Heisenberg model

Luciano Loris Viteritti, Francesco Ferrari, Federico Becca

Neural networks have been recently proposed as variational wave functions for quantum many-body systems [G. Carleo and M. Troyer, Science 355, 602 (2017)]. In this work, we focus on a specific architecture, known as restricted Boltzmann machine (RBM), and analyse its accuracy for the spin-1/2 J_1-J_2 J 1 − J 2 antiferromagnetic Heisenberg model in one spatial dimension. The ground state of this model has a non-trivial sign structure, especially for J_2/J_1>0.5 J 2 / J 1 > 0.5 , forcing us to work with complex-valued RBMs. Two variational Ansätze are discussed: one defined through a fully complex RBM, and one in which two different real-valued networks are used to approximate modulus and phase of the wave function. In both cases, translational invariance is imposed by considering linear combinations of RBMs, giving access also to the lowest-energy excitations at fixed momentum k. We perform a systematic study on small clusters to evaluate the accuracy of these wave functions in comparison to exact results, providing evidence for the supremacy of the fully complex RBM. Our calculations show that this kind of Ansätze is very flexible and describes both gapless and gapped ground states, also capturing the incommensurate spin-spin correlations and low-energy spectrum for J_2/J_1>0.5 J 2 / J 1 > 0.5 . The RBM results are also compared to the ones obtained with Gutzwiller-projected fermionic states, often employed to describe quantum spin models [F. Ferrari, A. Parola, S. Sorella and F. Becca, Phys. Rev. B 97, 235103 (2018)]. Contrary to the latter class of variational states, the fully-connected structure of RBMs hampers the transferability of the wave function from small to large clusters, implying an increase in the computational cost with the system size.

arXiv:2202.07576•SciPost Physics•May 19, 2022•37 citations

Specialising neural-network quantum states for the Bose Hubbard model

Michael Y. Pei, Stephen R. L. Clark

Abstract Projected variational wavefunctions such as the Gutzwiller, many-body correlator and Jastrow ansatzes have provided crucial insight into the nature of superfluid-Mott insulator transition in the Bose Hubbard model (BHM) in two or more spatial dimensions. However, these ansatzes have no obvious tractable and systematic way of being improved. A promising alternative is to use Neural-network quantum states (NQS) based on Restricted Boltzmann Machines (RBMs). With binary visible and hidden units NQS have proven to be a highly effective at describing quantum states of interacting spin- 1 2 lattice systems. The application of NQS to bosonic systems has so far been based on one-hot encoding from machine learning where the multi-valued site occupation is distributed across several binary-valued visible units of an RBM. Compared to spin- 1 2 systems one-hot encoding greatly increases the number of variational parameters whilst also making their physical interpretation opaque. Here we revisit the construction of NQS for bosonic systems by reformulating a one-hot encoded RBM into a correlation operator applied to a reference state, analogous to the structure of the projected variational ansatzes. In this form we then propose a number of specialisations of the RBM motivated by the physics of the BHM and the ability to capture exactly the projected variational ansatzes. We analyse in detail the variational performance of these new RBM variants for a 10 × 10 BHM, using both a standard Bose condensate state and a pre-optimised Jastrow + many-body correlator state as the reference state of the calculation. Several of our new ansatzes give robust results as nearly good as one-hot encoding across the regimes of the BHM, but at a substantially reduced cost. Such specialised NQS are thus primed tackle bosonic lattice problems beyond the accuracy of classic variational wavefunctions.

arXiv:2402.15424•Journal of Physics B Atomic Molecular and Optical Physics•Sep 23, 2024•9 citations

Constructing exact representations of quantum many-body systems with deep neural networks

Giuseppe Carleo, Yusuke Nomura, Masatoshi Imada

Obtaining accurate properties of many-body interacting quantum matter is a long-standing challenge in theoretical physics and chemistry, rooting into the complexity of the many-body wave-function. Classical representations of many-body states constitute a key tool for both analytical and numerical approaches to interacting quantum problems. Here, we introduce a technique to construct classical representations of many-body quantum systems based on artificial neural networks. Our constructions are based on the deep Boltzmann machine architecture, in which two layers of hidden neurons mediate quantum correlations. The approach reproduces the exact imaginary-time evolution for many-body lattice Hamiltonians, is completely deterministic, and yields networks with a polynomially-scaling number of neurons. We provide examples where physical properties of spin Hamiltonians can be efficiently obtained. Also, we show how systematic improvements upon existing restricted Boltzmann machines ansatze can be obtained. Our method is an alternative to the standard path integral and opens new routes in representing quantum many-body states.

arXiv:1802.09558•Nature Communications•Dec 10, 2018•201 citations

Quantum boltzmann machine :emergence & applications

Miguel Francisco Aldana Páez

Lately, there has been an extensive state-of-the-art research in Machine Learning methods, due to their important features such as universality in approximations and dimensional reduction. In this way, the present work aims at exploiting these properties of Machine Learning on physical many-body problems, in which a restricted Boltzmann Machine (RBM) is trained with quantum Monte Carlo data to best represent the ground state of an N spin system under the transverse field Ising model Hamiltonian in one dimension. During the path coursed along the development of this project, we first review classical well-implemented methods such as the single-layer perceptron, multi-layer perceptron for the XOR problem with back-propagation algorithm, discrete Hopfield network for pattern reconstruction, continuous Hopfield network with Simulated Annealing for solving the traveling salesman problem with 10 cities and the Boltzmann machine for feature extraction. Then, we review a few aspects of what is called a Quantum Boltzmann Machine and the basics of the transverse field Ising model. Finally, we train an RBM consisting of N visible neurons, hidden density neurons alpha=M/N=2 and 1-step contrastive divergence (CD_1), by minimizing the Kullbach-Liebler divergence of the RBM and the training data set coming from the algorithmic variant of quantum Monte Carlo, known as discrete Path-Integral Monte Carlo. For this last step, we use Trotter-Suzuki decomposition with m Trotter slices and the Wolff-s cluster algorithm. After training the RBM, we calculate magnetic observables based on the RBM-s wave-function such as longitudinal and transverse magnetization, for different values of transverse field and we do an estimation of the critical field at which the transverse Ising model system suffers a quantum phase transition from ferromagnet to paramagnet

•Jan 1, 2018•0 citations

Compact neural-network quantum state representations of Jastrow and stabilizer states

Michael Y. Pei, Stephen R Clark

Abstract Neural-network quantum states (NQSs) have become a powerful tool in many-body physics. Of the numerous possible architectures in which neural-networks can encode amplitudes of quantum states the simplicity of the complex restricted Boltzmann machine (RBM) has proven especially useful for both numerical and analytical studies. In particular devising exact NQS representations for important classes of states, like Jastrow and stabilizer states, has provided useful clues into the strengths and limitations of the RBM based NQS. However, current constructions for a system of N spins generate NQS with M ∼ O(N 2) hidden units that are very sparsely connected. This makes them rather atypical NQS compared to those commonly generated by numerical optimisation. Here we focus on compact NQS, denoting NQS with a hidden unit density α = M/N ⩽ 1 but with system-extensive hidden-visible unit connectivity. By unifying Jastrow and stabilizer states we introduce a new exact representation that requires at most M = N − 1 hidden units, illustrating how highly expressive α ⩽ 1 can be. Owing to their structural similarity to numerical NQS solutions our result provides useful insights and could pave the way for more families of quantum states to be represented exactly by compact NQS.

arXiv:2103.09146•Journal of Physics A Mathematical and Theoretical•Aug 19, 2021•13 citations
We consider representing two classes of 1D quantum wave functions of spin systems, including the AKLT and CFT correlator wave functions, in terms of multi-layer restricted Boltzmann machines. In our prescription, the AKLT wave function can be exactly represented by a 2-layer restricted Boltzmann machine with five hidden spins per visible spin. The construction can be generalized to prove that any MPS wave function on NNN unit cells with finite bond dimension can be approximated by a 2-layer restricted Boltzmann machine with O(N)\mathcal{O}(N)O(N) hidden spins within an error which scales linearly with NNN. The Haldane-Shastry wave function or a chiral boson CFT correlator wave function, as any Jastrow type of wave functions, can be exactly written as a 1-layer Boltzmann machine with O(N2)\mathcal{O}(N^2)O(N2) hidden spins and NNN visible spins. Applying the cumulant expansion, we further find that the chiral boson CFT correlator wave function (with small vertex operator conformal dimension ααα, i.e., α<0.1α<0.1α<0.1) can be approximated, within 99.9% accuracy up to 22 visible spins, by a 1-layer RBM with O(N)\mathcal{O}(N)O(N) hidden spins. The cumulant expansion also leads us to a physically inspiring result in which the hidden spins of the restricted Boltzmann machine can be interpreted as the conformal tower of the chiral boson CFT on the cylinder.
Neural network quantum states (NQS) have been widely applied to spin-1/2 systems, where they have proven to be highly effective. The application to systems with larger on-site dimension, such as spin-1 or bosonic systems, has been explored less and predominantly using spin-1/2 Restricted Boltzmann Machines (RBMs) with a one-hot/unary encoding. Here, we propose a more direct generalization of RBMs for spin-1 that retains the key properties of the standard spin-1/2 RBM, specifically trivial product states representations, labeling freedom for the visible variables and gauge equivalence to the tensor network formulation. To test this new approach, we present variational Monte Carlo (VMC) calculations for the spin-1 anti-ferromagnetic Heisenberg (AFH) model and benchmark it against the one-hot/unary encoded RBM demonstrating that it achieves the same accuracy with substantially fewer variational parameters. Furthermore, we investigate how the hidden unit complexity of NQS depend on the local single-spin basis used. Exploiting the tensor network version of our RBM we construct an analytic NQS representation of the Affleck-Kennedy-Lieb-Tasaki (AKLT) state in the xyz spin-1 basis using only M=2N hidden units, compared to M∼O(N2) required in the Sz basis. Additional VMC calculations provide strong evidence that the AKLT state in fact possesses an exact compact NQS representation in the xyz basis with only M=N hidden units. These insights help to further unravel how to most effectively adapt the NQS framework for more complex quantum systems.
Accuracy of restricted Boltzmann machines for the one-dimensional J1−J2J_1-J_2J1​−J2​ Heisenberg model
Neural networks have been recently proposed as variational wave functions for quantum many-body systems [G. Carleo and M. Troyer, Science 355, 602 (2017)]. In this work, we focus on a specific architecture, known as restricted Boltzmann machine (RBM), and analyse its accuracy for the spin-1/2 J_1-J_2 J 1 − J 2 antiferromagnetic Heisenberg model in one spatial dimension. The ground state of this model has a non-trivial sign structure, especially for J_2/J_1>0.5 J 2 / J 1 > 0.5 , forcing us to work with complex-valued RBMs. Two variational Ansätze are discussed: one defined through a fully complex RBM, and one in which two different real-valued networks are used to approximate modulus and phase of the wave function. In both cases, translational invariance is imposed by considering linear combinations of RBMs, giving access also to the lowest-energy excitations at fixed momentum k. We perform a systematic study on small clusters to evaluate the accuracy of these wave functions in comparison to exact results, providing evidence for the supremacy of the fully complex RBM. Our calculations show that this kind of Ansätze is very flexible and describes both gapless and gapped ground states, also capturing the incommensurate spin-spin correlations and low-energy spectrum for J_2/J_1>0.5 J 2 / J 1 > 0.5 . The RBM results are also compared to the ones obtained with Gutzwiller-projected fermionic states, often employed to describe quantum spin models [F. Ferrari, A. Parola, S. Sorella and F. Becca, Phys. Rev. B 97, 235103 (2018)]. Contrary to the latter class of variational states, the fully-connected structure of RBMs hampers the transferability of the wave function from small to large clusters, implying an increase in the computational cost with the system size.
Abstract Projected variational wavefunctions such as the Gutzwiller, many-body correlator and Jastrow ansatzes have provided crucial insight into the nature of superfluid-Mott insulator transition in the Bose Hubbard model (BHM) in two or more spatial dimensions. However, these ansatzes have no obvious tractable and systematic way of being improved. A promising alternative is to use Neural-network quantum states (NQS) based on Restricted Boltzmann Machines (RBMs). With binary visible and hidden units NQS have proven to be a highly effective at describing quantum states of interacting spin- 1 2 lattice systems. The application of NQS to bosonic systems has so far been based on one-hot encoding from machine learning where the multi-valued site occupation is distributed across several binary-valued visible units of an RBM. Compared to spin- 1 2 systems one-hot encoding greatly increases the number of variational parameters whilst also making their physical interpretation opaque. Here we revisit the construction of NQS for bosonic systems by reformulating a one-hot encoded RBM into a correlation operator applied to a reference state, analogous to the structure of the projected variational ansatzes. In this form we then propose a number of specialisations of the RBM motivated by the physics of the BHM and the ability to capture exactly the projected variational ansatzes. We analyse in detail the variational performance of these new RBM variants for a 10 × 10 BHM, using both a standard Bose condensate state and a pre-optimised Jastrow + many-body correlator state as the reference state of the calculation. Several of our new ansatzes give robust results as nearly good as one-hot encoding across the regimes of the BHM, but at a substantially reduced cost. Such specialised NQS are thus primed tackle bosonic lattice problems beyond the accuracy of classic variational wavefunctions.
Obtaining accurate properties of many-body interacting quantum matter is a long-standing challenge in theoretical physics and chemistry, rooting into the complexity of the many-body wave-function. Classical representations of many-body states constitute a key tool for both analytical and numerical approaches to interacting quantum problems. Here, we introduce a technique to construct classical representations of many-body quantum systems based on artificial neural networks. Our constructions are based on the deep Boltzmann machine architecture, in which two layers of hidden neurons mediate quantum correlations. The approach reproduces the exact imaginary-time evolution for many-body lattice Hamiltonians, is completely deterministic, and yields networks with a polynomially-scaling number of neurons. We provide examples where physical properties of spin Hamiltonians can be efficiently obtained. Also, we show how systematic improvements upon existing restricted Boltzmann machines ansatze can be obtained. Our method is an alternative to the standard path integral and opens new routes in representing quantum many-body states.
Lately, there has been an extensive state-of-the-art research in Machine Learning methods, due to their important features such as universality in approximations and dimensional reduction. In this way, the present work aims at exploiting these properties of Machine Learning on physical many-body problems, in which a restricted Boltzmann Machine (RBM) is trained with quantum Monte Carlo data to best represent the ground state of an N spin system under the transverse field Ising model Hamiltonian in one dimension. During the path coursed along the development of this project, we first review classical well-implemented methods such as the single-layer perceptron, multi-layer perceptron for the XOR problem with back-propagation algorithm, discrete Hopfield network for pattern reconstruction, continuous Hopfield network with Simulated Annealing for solving the traveling salesman problem with 10 cities and the Boltzmann machine for feature extraction. Then, we review a few aspects of what is called a Quantum Boltzmann Machine and the basics of the transverse field Ising model. Finally, we train an RBM consisting of N visible neurons, hidden density neurons alpha=M/N=2 and 1-step contrastive divergence (CD_1), by minimizing the Kullbach-Liebler divergence of the RBM and the training data set coming from the algorithmic variant of quantum Monte Carlo, known as discrete Path-Integral Monte Carlo. For this last step, we use Trotter-Suzuki decomposition with m Trotter slices and the Wolff-s cluster algorithm. After training the RBM, we calculate magnetic observables based on the RBM-s wave-function such as longitudinal and transverse magnetization, for different values of transverse field and we do an estimation of the critical field at which the transverse Ising model system suffers a quantum phase transition from ferromagnet to paramagnet
Abstract Neural-network quantum states (NQSs) have become a powerful tool in many-body physics. Of the numerous possible architectures in which neural-networks can encode amplitudes of quantum states the simplicity of the complex restricted Boltzmann machine (RBM) has proven especially useful for both numerical and analytical studies. In particular devising exact NQS representations for important classes of states, like Jastrow and stabilizer states, has provided useful clues into the strengths and limitations of the RBM based NQS. However, current constructions for a system of N spins generate NQS with M ∼ O(N 2) hidden units that are very sparsely connected. This makes them rather atypical NQS compared to those commonly generated by numerical optimisation. Here we focus on compact NQS, denoting NQS with a hidden unit density α = M/N ⩽ 1 but with system-extensive hidden-visible unit connectivity. By unifying Jastrow and stabilizer states we introduce a new exact representation that requires at most M = N − 1 hidden units, illustrating how highly expressive α ⩽ 1 can be. Owing to their structural similarity to numerical NQS solutions our result provides useful insights and could pave the way for more families of quantum states to be represented exactly by compact NQS.