Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1907.11333 · New Journal of Physics

Entanglement area law for shallow and deep quantum neural network states

Zhian Jia, Lu Wei, Yu-Chun Wu, Guang‐Can Guo, Guo‐Ping Guo

Published Mar 23, 2020• 13 citations
arXivHTMLPDF

Abstract

Abstract A study of the artificial neural network representation of quantum many-body states is presented. The locality and entanglement properties of states for shallow and deep quantum neural networks are investigated in detail. By introducing the notion of local quasi-product states, for which the locally connected shallow feed-forward neural network states and restricted Boltzmann machine states are special cases, we show that Rényi entanglement entropies of all these states obey the entanglement area law. Besides, we also investigate the entanglement features of deep Boltzmann machine states and show that locality constraints imposed on the neural networks make the states obey the entanglement area law. Finally, as an application, we apply the notion of Rényi entanglement entropy to understand the power of neural networks, and show that image classification problems can be efficiently solved must obey the area law.

DOI
10.1088/1367-2630/ab8262

Related papers

Efficient representation of quantum many-body states with deep neural networks

Xun Gao, L.-M. Duan

Part of the challenge for quantum many-body problems comes from the difficulty of representing large-scale quantum states, which in general requires an exponentially large number of parameters. Neural networks provide a powerful tool to represent quantum many-body states. An important open question is what characterizes the representational power of deep and shallow neural networks, which is of fundamental interest due to the popularity of deep learning methods. Here, we give a proof that, assuming a widely believed computational complexity conjecture, a deep neural network can efficiently represent most physical states, including the ground states of many-body Hamiltonians and states generated by quantum dynamics, while a shallow network representation with a restricted Boltzmann machine cannot efficiently represent some of those states.One of the challenges in studies of quantum many-body physics is finding an efficient way to record the large system wavefunctions. Here the authors present an analysis of the capabilities of recently-proposed neural network representations for storing physically accessible quantum states.

arXiv:1701.05039•Nature Communications•Sep 18, 2017•410 citations

Bound on Entanglement in Neural Quantum States

Nisarga Paul

Variational wave functions offer a practical route around the exponential complexity of many-body Hilbert spaces, but their expressive power is often sharply constrained. Matrix product states, for instance, are efficient but limited to area law entangled states. Neural quantum states (NQS) are widely believed to overcome such limitations, yet little is known about their fundamental constraints. Here we prove that feed-forward neural quantum states acting on n spins with k scalar nonlinearities, under certain analyticity assumptions, obey a bound on entanglement entropy for any subregion: S≤cklog n, for a constant c. This establishes an NQS analog of the area law constraint for matrix product states and rules out volume law entanglement for NQS with O(1) nonlinearities. We demonstrate analytically and numerically that the scaling with n is tight for a wide variety of NQS. Our Letter establishes a fundamental constraint on NQS that applies broadly across different network designs, while reinforcing their substantial expressive power.

arXiv:2510.11797•Physical Review Letters•Mar 10, 2026•9 citations

Entanglement transition in deep neural quantum states

Giacomo Passetti, Dante Marvin Kennes

Despite the huge theoretical potential of neural quantum states, their use in describing generic, highly-correlated quantum many-body systems still often poses practical difficulties. Customized network architectures are under active investigation to address these issues. For a guided search of suited network architectures a deepened understanding of the link between neural network properties and attributes of the physical system one is trying to describe, is imperative. Drawing inspiration from the field of machine learning, in this work we show how information propagation in deep neural networks impacts the physical entanglement properties of deep neural quantum states. In fact, we link a previously identified information propagation phase transition of a neural network to a similar transition of entanglement in neural quantum states. With this bridge we can identify optimal neural quantum state hyperparameter regimes for representing area as well as volume law entangled states. The former are easily accessed by alternative methods, such as tensor network representations, at least in low physical dimensions, while the latter are challenging to describe generally due to their extensive quantum entanglement. This advance of our understanding of network configurations for accurate quantum state representation helps to develop effective representations to deal with volume-law quantum states, and we apply these findings to describe the ground state (area law state) vs. the excited state (volume law state) properties of the prototypical next-nearest neighbor spin-1/2 Heisenberg model.

arXiv:2312.11941•Jan 1, 2023•4 citations

Can Neural Quantum States Learn Volume-Law Ground States?

Giacomo Passetti, Damian Hofmann, Pit Neitemeier +3 more

We study whether neural quantum states based on multilayer feed-forward networks can find ground states which exhibit volume-law entanglement entropy. As a testbed, we employ the paradigmatic Sachdev-Ye-Kitaev model. We find that both shallow and deep feed-forward networks require an exponential number of parameters in order to represent the ground state of this model. This demonstrates that sufficiently complicated quantum states, although being physical solutions to relevant models and not pathological cases, can still be difficult to learn to the point of intractability at larger system sizes. Hence, the variational neural network approach offers no benefits over exact diagonalization methods in this case. This highlights the importance of further investigations into the physical properties of quantum states amenable to an efficient neural representation.

arXiv:2212.02204•Physical Review Letters•Jul 17, 2023•32 citations

Entanglement Entropy of Target Functions for Image Classification and Convolutional Neural Network

Zhang, Ya-Hui

The success of deep convolutional neural network (CNN) in computer vision especially image classification problems requests a new information theory for function of image, instead of image itself. In this article, after establishing a deep mathematical connection between image classification problem and quantum spin model, we propose to use entanglement entropy, a generalization of classical Boltzmann-Shannon entropy, as a powerful tool to characterize the information needed for representation of general function of image. We prove that there is a sub-volume-law bound for entanglement entropy of target functions of reasonable image classification problems. Therefore target functions of image classification only occupy a small subspace of the whole Hilbert space. As a result, a neural network with polynomial number of parameters is efficient for representation of such target functions of image. The concept of entanglement entropy can also be useful to characterize the expressive power of different neural networks. For example, we show that to maintain the same expressive power, number of channels $D$ in a convolutional neural network should scale with the number of convolution layers $n_c$ as $D\sim D_0^{\frac{1}{n_c}}$. Therefore, deeper CNN with large $n_c$ is more efficient than shallow ones.

arXiv:1710.05520•Oct 16, 2017•10 citations

Quantum Entanglement in Deep Learning Architectures

Yoav Levine, Or Sharir, Nadav Cohen +1 more

Modern deep learning has enabled unprecedented achievements in various domains. Nonetheless, employment of machine learning for wave function representations is focused on more traditional architectures such as restricted Boltzmann machines (RBMs) and fully connected neural networks. In this Letter, we establish that contemporary deep learning architectures, in the form of deep convolutional and recurrent networks, can efficiently represent highly entangled quantum systems. By constructing tensor network equivalents of these architectures, we identify an inherent reuse of information in the network operation as a key trait which distinguishes them from standard tensor network-based representations, and which enhances their entanglement capacity. Our results show that such architectures can support volume-law entanglement scaling, polynomially more efficiently than presently employed RBMs. Thus, beyond a quantification of the entanglement capacity of leading deep learning architectures, our analysis formally motivates a shift of trending neural-network-based wave function representations closer to the state-of-the-art in machine learning.

arXiv:1803.09780•Physical Review Letters•Feb 12, 2019•256 citations
Abstract A study of the artificial neural network representation of quantum many-body states is presented. The locality and entanglement properties of states for shallow and deep quantum neural networks are investigated in detail. By introducing the notion of local quasi-product states, for which the locally connected shallow feed-forward neural network states and restricted Boltzmann machine states are special cases, we show that Rényi entanglement entropies of all these states obey the entanglement area law. Besides, we also investigate the entanglement features of deep Boltzmann machine states and show that locality constraints imposed on the neural networks make the states obey the entanglement area law. Finally, as an application, we apply the notion of Rényi entanglement entropy to understand the power of neural networks, and show that image classification problems can be efficiently solved must obey the area law.
Part of the challenge for quantum many-body problems comes from the difficulty of representing large-scale quantum states, which in general requires an exponentially large number of parameters. Neural networks provide a powerful tool to represent quantum many-body states. An important open question is what characterizes the representational power of deep and shallow neural networks, which is of fundamental interest due to the popularity of deep learning methods. Here, we give a proof that, assuming a widely believed computational complexity conjecture, a deep neural network can efficiently represent most physical states, including the ground states of many-body Hamiltonians and states generated by quantum dynamics, while a shallow network representation with a restricted Boltzmann machine cannot efficiently represent some of those states.One of the challenges in studies of quantum many-body physics is finding an efficient way to record the large system wavefunctions. Here the authors present an analysis of the capabilities of recently-proposed neural network representations for storing physically accessible quantum states.
Variational wave functions offer a practical route around the exponential complexity of many-body Hilbert spaces, but their expressive power is often sharply constrained. Matrix product states, for instance, are efficient but limited to area law entangled states. Neural quantum states (NQS) are widely believed to overcome such limitations, yet little is known about their fundamental constraints. Here we prove that feed-forward neural quantum states acting on n spins with k scalar nonlinearities, under certain analyticity assumptions, obey a bound on entanglement entropy for any subregion: S≤cklog n, for a constant c. This establishes an NQS analog of the area law constraint for matrix product states and rules out volume law entanglement for NQS with O(1) nonlinearities. We demonstrate analytically and numerically that the scaling with n is tight for a wide variety of NQS. Our Letter establishes a fundamental constraint on NQS that applies broadly across different network designs, while reinforcing their substantial expressive power.
Despite the huge theoretical potential of neural quantum states, their use in describing generic, highly-correlated quantum many-body systems still often poses practical difficulties. Customized network architectures are under active investigation to address these issues. For a guided search of suited network architectures a deepened understanding of the link between neural network properties and attributes of the physical system one is trying to describe, is imperative. Drawing inspiration from the field of machine learning, in this work we show how information propagation in deep neural networks impacts the physical entanglement properties of deep neural quantum states. In fact, we link a previously identified information propagation phase transition of a neural network to a similar transition of entanglement in neural quantum states. With this bridge we can identify optimal neural quantum state hyperparameter regimes for representing area as well as volume law entangled states. The former are easily accessed by alternative methods, such as tensor network representations, at least in low physical dimensions, while the latter are challenging to describe generally due to their extensive quantum entanglement. This advance of our understanding of network configurations for accurate quantum state representation helps to develop effective representations to deal with volume-law quantum states, and we apply these findings to describe the ground state (area law state) vs. the excited state (volume law state) properties of the prototypical next-nearest neighbor spin-1/2 Heisenberg model.
We study whether neural quantum states based on multilayer feed-forward networks can find ground states which exhibit volume-law entanglement entropy. As a testbed, we employ the paradigmatic Sachdev-Ye-Kitaev model. We find that both shallow and deep feed-forward networks require an exponential number of parameters in order to represent the ground state of this model. This demonstrates that sufficiently complicated quantum states, although being physical solutions to relevant models and not pathological cases, can still be difficult to learn to the point of intractability at larger system sizes. Hence, the variational neural network approach offers no benefits over exact diagonalization methods in this case. This highlights the importance of further investigations into the physical properties of quantum states amenable to an efficient neural representation.
The success of deep convolutional neural network (CNN) in computer vision especially image classification problems requests a new information theory for function of image, instead of image itself. In this article, after establishing a deep mathematical connection between image classification problem and quantum spin model, we propose to use entanglement entropy, a generalization of classical Boltzmann-Shannon entropy, as a powerful tool to characterize the information needed for representation of general function of image. We prove that there is a sub-volume-law bound for entanglement entropy of target functions of reasonable image classification problems. Therefore target functions of image classification only occupy a small subspace of the whole Hilbert space. As a result, a neural network with polynomial number of parameters is efficient for representation of such target functions of image. The concept of entanglement entropy can also be useful to characterize the expressive power of different neural networks. For example, we show that to maintain the same expressive power, number of channels DDD in a convolutional neural network should scale with the number of convolution layers ncn_cnc​ as D∼D01ncD\sim D_0^{\frac{1}{n_c}}D∼D0nc​1​​. Therefore, deeper CNN with large ncn_cnc​ is more efficient than shallow ones.
Modern deep learning has enabled unprecedented achievements in various domains. Nonetheless, employment of machine learning for wave function representations is focused on more traditional architectures such as restricted Boltzmann machines (RBMs) and fully connected neural networks. In this Letter, we establish that contemporary deep learning architectures, in the form of deep convolutional and recurrent networks, can efficiently represent highly entangled quantum systems. By constructing tensor network equivalents of these architectures, we identify an inherent reuse of information in the network operation as a key trait which distinguishes them from standard tensor network-based representations, and which enhances their entanglement capacity. Our results show that such architectures can support volume-law entanglement scaling, polynomially more efficiently than presently employed RBMs. Thus, beyond a quantification of the entanglement capacity of leading deep learning architectures, our analysis formally motivates a shift of trending neural-network-based wave function representations closer to the state-of-the-art in machine learning.