Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1711.09079

Critically excited states with enhanced memory and pattern recognition capacities in quantum brain networks: Lesson from black holes

Gia Dvali

Published Nov 24, 2017• 28 citations
arXivHTMLPDF

Abstract

We implement a mechanism - originally proposed as a model for the large memory storage capacity of black holes - in quantum neural networks and show that an exponentially increased capacity of pattern storage and recognition is achieved in certain critically excited states, without involvement of synaptic plasticity. We consider a simple network of N interconnected quantum neurons with weak excitatory synaptic connections. We show that for frozen synaptic weights there exist the critical states of enhanced memory storage capacity. These states are achieved thanks to the high excitation levels of some of the neurons, which - despite of feeble synaptic connections - dramatically lower the response threshold of the remaining weaker-excited neurons. As a results, the latter neurons acquire a capacity to store an exponentially large number of patterns within a narrow energy gap. The stored patterns can be recognized and retrieved with perfect response under the influence of arbitrarily soft input stimuli. In sharp contrast, under the same stimuli the recall is absent in the ground-state of the system. The lesson is that the state with the highest micro-state entropy and memory storage capacity is not necessarily a local minimum of energy, but rather an excited critical state. The considered phenomenon has a smooth classical limit and can serve for achieving an enhanced memory storage capacity in classical brain networks.

DOI
10.48550/arxiv.1711.09079

Related papers

Finding critical states of enhanced memory capacity in attractive cold bosons

Gia Dvali, Marco Michel, Sebastian Zell

We discuss a class of quantum theories which exhibit a sharply increased memory storage capacity due to emergent gapless degrees of freedom. Their realization, both theoretical and experimental, is of great interest. On the one hand, such systems are motivated from a quantum information point of view. On the other hand, they can provide a framework for simulating systems with enhanced capacity of pattern storage, such as black holes and neural networks. In this paper, we develop an analytic method that enables us to find critical states with increased storage capabilities in a generic system of cold bosons with weak attractive interactions. The enhancement of memory capacity arises when the occupation number N of certain modes reaches a critical level. Such modes, via negative energy couplings, assist others in becoming effectively gapless. This leads to degenerate microstates labeled by the occupation numbers of the nearly-gapless modes. In the limit of large N , they become exactly gapless and their decoherence time diverges. In this way, a system becomes an ideal storer of quantum information. We demonstrate our method on a prototype model of N attractive cold bosons contained in a one-dimensional box with Dirichlet boundary conditions. Although we limit ourselves to a truncated system, we observe a rich structure of quantum phases with a critical point of enhanced memory capacity.

arXiv:1805.10292•EPJ Quantum Technology•Mar 25, 2019•32 citations

High-Capacity Quantum Associative Memories

M. C. Diamantini, Carlo A. Trugenberger

We review our models of quantum associative memories that represent the “quantization” of fully coupled neural networks like the Hopfield model. The idea is to replace the classical irreversible attractor dynamics driven by an Ising model with pattern-dependent weights by the reversible rotation of an input quantum state onto an output quantum state consisting of a linear superposition with probability amplitudes peaked on the stored pattern closest to the input in Hamming distance, resulting in a high probability of measuring a memory pattern very similar to the input. The unitary operator implementing this transformation can be formulated as a sequence of one-qubit and two-qubit elementary quantum gates and is thus the exponential of an ordered quantum Ising model with sequential operations and with pattern-dependent interactions, exactly as in the classical case. Probabilistic quantum memories, that make use of postselection of the measurement result of control qubits, overcome the famed linear storage limitation of their classical counterparts because they permit to completely eliminate crosstalk and spurious memories. The number of control qubits plays the role of an inverse fictitious temperature. The accuracy of pattern retrieval can be tuned by lowering the fictitious temperature under a critical value for quantum content association while the complexity of the retrieval algorithm remains polynomial for any number of patterns polynomial in the number of qubits. These models thus solve the capacity shortage problem of classical associative memories, providing a polynomial improvement in capacity. The price to pay is the probabilistic nature of information retrieval.

arXiv:1506.01231•Journal of Applied Mathematics and Physics•Jan 1, 2016•9 citations

Optimal storage capacity of quantum Hopfield neural networks

Lukas Bödeker, Eliana Fiorelli, Markus Müller

Quantum neural networks form one pillar of the emergent field of quantum machine learning. Here quantum generalizations of classical networks realizing associative memories---capable of retrieving patterns, or memories, from corrupted initial states---have been proposed. It is a challenging open problem to analyze quantum associative memories with an extensive number of patterns and to determine the maximal number of patterns the quantum networks can reliably store, i.e., their storage capacity. In this work, we propose and explore a general method for evaluating the maximal storage capacity of quantum neural network models. By generalizing what is known as Gardner's approach in the classical realm, we exploit the theory of classical spin glasses for deriving the optimal storage capacity of quantum networks with quenched pattern variables. As an example, we apply our method to an open-system quantum associative memory formed of interacting spin-1/2 particles realizing coupled artificial neurons. The system undergoes a Markovian time evolution resulting from a dissipative retrieval dynamics that competes with a coherent quantum dynamics. We map out the nonequilibrium phase diagram and study the effect of temperature and Hamiltonian dynamics on the storage capacity. Our method opens an avenue for a systematic characterization of the storage capacity of quantum associative memories.

arXiv:2210.07894•Physical Review Research•May 1, 2023•13 citations

Storage capacity and learning capability of quantum neural networks

Maciej Lewenstein, Aikaterini Gratsea, Andreu Riera-Campeny +3 more

Abstract We study the storage capacity of quantum neural networks (QNNs), described by completely positive trace preserving (CPTP) maps acting on an N-dimensional Hilbert space. We demonstrate that attractor QNNs can store in a non-trivial manner up to N linearly independent pure states. For n qubits, QNNs can reach an exponential storage capacity, O ( 2 n ) , clearly outperforming standard classical neural networks whose storage capacity scales linearly with the number of neurons n. We estimate, employing the Gardner program, the relative volume of CPTP maps with M ⩽ N stationary states and show that this volume decreases exponentially with M and shrinks to zero for M ⩾ N + 1. We generalize our results to QNNs storing mixed states as well as input–output relations for feed-forward QNNs. Our approach opens the path to relate storage properties of QNNs to the quantum features of the input–output states. This paper is dedicated to the memory of Peter Wittek.

arXiv:2011.06113•Quantum Science and Technology•Jun 1, 2021•30 citations

Quantum Neural Networks with Non-Markovian Dynamics

Jincheng Zhang

This paper investigates the potential of quantum neural networks (QNNs) enhanced by non-Markovian dynamics. Traditional Markovian QNNs suffer from limitations in capturing long-range dependencies, a crucial aspect in complex data processing. We propose a novel QNN architecture that incorporates quantum memory and entanglement to facilitate non-Markovian information processing. This approach allows the network to retain and utilize the entire past history of the input, fundamentally altering the dynamics of information flow. Through theoretical analysis and mathematical formulations, we demonstrate how this architecture can significantly improve the network's ability to learn and represent complex patterns, particularly those exhibiting long-range correlations. Specifically, we introduce a modified update rule leveraging the concept of quantum memory and entanglement, expressed as: $ \Delta w_{ij} = \alpha \cdot E[\rho(t)|x_1, x_2, ..., x_K] \cdot \langle \psi_i | \rho(t) | \psi_j \rangle - (1 - \alpha) \cdot w_{ij}$ Where: * $ \Delta w_{ij}$ is the change in the synaptic weight between neurons *i* and *j*. * $\alpha$ is the learning rate. * $E[\rho(t)|x_1, x_2, ..., x_K]$ represents the expected state of the quantum memory at time *t*, given the entire input sequence $x_1, x_2, ..., x_K$. * $\rho(t)$ is the density matrix representing the quantum state at time *t*. * $\langle \psi_i | \rho(t) | \psi_j \rangle$ is the inner product between the quantum states $\psi_i$ and $\psi_j$ within the density matrix $\rho(t)$. * $w_{ij}$ is the current synaptic weight between neurons *i* and *j*. The core of our innovation lies in the utilization of quantum memory, modeled as a quantum state $\rho(t)$, which retains information about the entire past sequence. The entanglement between neurons further enables correlated updates, bypassing the limitations of Markovian models that only consider immediate dependencies. We explore the impact of varying the strength of entanglement and the capacity of the quantum memory on the network's performance using mathematical models. The results suggest a significant improvement in accuracy and convergence speed compared to standard Markovian QNNs when dealing with datasets exhibiting long-range dependencies. Further investigation into the scalability and practical implementation of this architecture is warranted.

•Aug 29, 2026•0 citations

FROM CLASSICAL NEURAL NETWORKS TO QUANTUM NEURAL NETWORKS

Brunello Tirozzi

First I give a brief description of the classical Hopfield model introducing the fundamental concepts of patterns, retrieval, pattern recognition, neural dynamics, capacity and describe the fundamental results obtained in this field by Amit, Gutfreund and Sompolinsky, 1 using the non rigorous method of replica and the rigorous version given by Pastur, Shcherbina, Tirozzi 2 using the cavity method. Then I give a formulation of the theory of Quantum Neural Networks (QNN) in terms of the XY model with Hebbian interaction. The problem of retrieval and storage is discussed. The retrieval states are the states of the minimum energy. I apply the estimates found by Lieb 3 which give lower and upper bound of the free-energy and expectation of the observables of the quantum model. I discuss also some experiment and the search of ground state using Monte Carlo Dynamics applied to the equivalent classical two dimensional Ising model constructed by Suzuki et al. 6 At the end there is a list of open problems.

•Sep 27, 2012•0 citations
We implement a mechanism - originally proposed as a model for the large memory storage capacity of black holes - in quantum neural networks and show that an exponentially increased capacity of pattern storage and recognition is achieved in certain critically excited states, without involvement of synaptic plasticity. We consider a simple network of N interconnected quantum neurons with weak excitatory synaptic connections. We show that for frozen synaptic weights there exist the critical states of enhanced memory storage capacity. These states are achieved thanks to the high excitation levels of some of the neurons, which - despite of feeble synaptic connections - dramatically lower the response threshold of the remaining weaker-excited neurons. As a results, the latter neurons acquire a capacity to store an exponentially large number of patterns within a narrow energy gap. The stored patterns can be recognized and retrieved with perfect response under the influence of arbitrarily soft input stimuli. In sharp contrast, under the same stimuli the recall is absent in the ground-state of the system. The lesson is that the state with the highest micro-state entropy and memory storage capacity is not necessarily a local minimum of energy, but rather an excited critical state. The considered phenomenon has a smooth classical limit and can serve for achieving an enhanced memory storage capacity in classical brain networks.
We discuss a class of quantum theories which exhibit a sharply increased memory storage capacity due to emergent gapless degrees of freedom. Their realization, both theoretical and experimental, is of great interest. On the one hand, such systems are motivated from a quantum information point of view. On the other hand, they can provide a framework for simulating systems with enhanced capacity of pattern storage, such as black holes and neural networks. In this paper, we develop an analytic method that enables us to find critical states with increased storage capabilities in a generic system of cold bosons with weak attractive interactions. The enhancement of memory capacity arises when the occupation number N of certain modes reaches a critical level. Such modes, via negative energy couplings, assist others in becoming effectively gapless. This leads to degenerate microstates labeled by the occupation numbers of the nearly-gapless modes. In the limit of large N , they become exactly gapless and their decoherence time diverges. In this way, a system becomes an ideal storer of quantum information. We demonstrate our method on a prototype model of N attractive cold bosons contained in a one-dimensional box with Dirichlet boundary conditions. Although we limit ourselves to a truncated system, we observe a rich structure of quantum phases with a critical point of enhanced memory capacity.
We review our models of quantum associative memories that represent the “quantization” of fully coupled neural networks like the Hopfield model. The idea is to replace the classical irreversible attractor dynamics driven by an Ising model with pattern-dependent weights by the reversible rotation of an input quantum state onto an output quantum state consisting of a linear superposition with probability amplitudes peaked on the stored pattern closest to the input in Hamming distance, resulting in a high probability of measuring a memory pattern very similar to the input. The unitary operator implementing this transformation can be formulated as a sequence of one-qubit and two-qubit elementary quantum gates and is thus the exponential of an ordered quantum Ising model with sequential operations and with pattern-dependent interactions, exactly as in the classical case. Probabilistic quantum memories, that make use of postselection of the measurement result of control qubits, overcome the famed linear storage limitation of their classical counterparts because they permit to completely eliminate crosstalk and spurious memories. The number of control qubits plays the role of an inverse fictitious temperature. The accuracy of pattern retrieval can be tuned by lowering the fictitious temperature under a critical value for quantum content association while the complexity of the retrieval algorithm remains polynomial for any number of patterns polynomial in the number of qubits. These models thus solve the capacity shortage problem of classical associative memories, providing a polynomial improvement in capacity. The price to pay is the probabilistic nature of information retrieval.
Quantum neural networks form one pillar of the emergent field of quantum machine learning. Here quantum generalizations of classical networks realizing associative memories---capable of retrieving patterns, or memories, from corrupted initial states---have been proposed. It is a challenging open problem to analyze quantum associative memories with an extensive number of patterns and to determine the maximal number of patterns the quantum networks can reliably store, i.e., their storage capacity. In this work, we propose and explore a general method for evaluating the maximal storage capacity of quantum neural network models. By generalizing what is known as Gardner's approach in the classical realm, we exploit the theory of classical spin glasses for deriving the optimal storage capacity of quantum networks with quenched pattern variables. As an example, we apply our method to an open-system quantum associative memory formed of interacting spin-1/2 particles realizing coupled artificial neurons. The system undergoes a Markovian time evolution resulting from a dissipative retrieval dynamics that competes with a coherent quantum dynamics. We map out the nonequilibrium phase diagram and study the effect of temperature and Hamiltonian dynamics on the storage capacity. Our method opens an avenue for a systematic characterization of the storage capacity of quantum associative memories.
Abstract We study the storage capacity of quantum neural networks (QNNs), described by completely positive trace preserving (CPTP) maps acting on an N-dimensional Hilbert space. We demonstrate that attractor QNNs can store in a non-trivial manner up to N linearly independent pure states. For n qubits, QNNs can reach an exponential storage capacity, O ( 2 n ) , clearly outperforming standard classical neural networks whose storage capacity scales linearly with the number of neurons n. We estimate, employing the Gardner program, the relative volume of CPTP maps with M ⩽ N stationary states and show that this volume decreases exponentially with M and shrinks to zero for M ⩾ N + 1. We generalize our results to QNNs storing mixed states as well as input–output relations for feed-forward QNNs. Our approach opens the path to relate storage properties of QNNs to the quantum features of the input–output states. This paper is dedicated to the memory of Peter Wittek.
This paper investigates the potential of quantum neural networks (QNNs) enhanced by non-Markovian dynamics. Traditional Markovian QNNs suffer from limitations in capturing long-range dependencies, a crucial aspect in complex data processing. We propose a novel QNN architecture that incorporates quantum memory and entanglement to facilitate non-Markovian information processing. This approach allows the network to retain and utilize the entire past history of the input, fundamentally altering the dynamics of information flow. Through theoretical analysis and mathematical formulations, we demonstrate how this architecture can significantly improve the network's ability to learn and represent complex patterns, particularly those exhibiting long-range correlations. Specifically, we introduce a modified update rule leveraging the concept of quantum memory and entanglement, expressed as: $ \Delta w_{ij} = \alpha \cdot E[\rho(t)|x_1, x_2, ..., x_K] \cdot \langle \psi_i | \rho(t) | \psi_j \rangle - (1 - \alpha) \cdot w_{ij}$ Where: * $ \Delta w_{ij}$ is the change in the synaptic weight between neurons *i* and *j*. * α\alphaα is the learning rate. * E[ρ(t)∣x1,x2,...,xK]E[\rho(t)|x_1, x_2, ..., x_K]E[ρ(t)∣x1​,x2​,...,xK​] represents the expected state of the quantum memory at time *t*, given the entire input sequence x1,x2,...,xKx_1, x_2, ..., x_Kx1​,x2​,...,xK​. * ρ(t)\rho(t)ρ(t) is the density matrix representing the quantum state at time *t*. * ⟨ψi∣ρ(t)∣ψj⟩\langle \psi_i | \rho(t) | \psi_j \rangle⟨ψi​∣ρ(t)∣ψj​⟩ is the inner product between the quantum states ψi\psi_iψi​ and ψj\psi_jψj​ within the density matrix ρ(t)\rho(t)ρ(t). * wijw_{ij}wij​ is the current synaptic weight between neurons *i* and *j*. The core of our innovation lies in the utilization of quantum memory, modeled as a quantum state ρ(t)\rho(t)ρ(t), which retains information about the entire past sequence. The entanglement between neurons further enables correlated updates, bypassing the limitations of Markovian models that only consider immediate dependencies. We explore the impact of varying the strength of entanglement and the capacity of the quantum memory on the network's performance using mathematical models. The results suggest a significant improvement in accuracy and convergence speed compared to standard Markovian QNNs when dealing with datasets exhibiting long-range dependencies. Further investigation into the scalability and practical implementation of this architecture is warranted.
First I give a brief description of the classical Hopfield model introducing the fundamental concepts of patterns, retrieval, pattern recognition, neural dynamics, capacity and describe the fundamental results obtained in this field by Amit, Gutfreund and Sompolinsky, 1 using the non rigorous method of replica and the rigorous version given by Pastur, Shcherbina, Tirozzi 2 using the cavity method. Then I give a formulation of the theory of Quantum Neural Networks (QNN) in terms of the XY model with Hebbian interaction. The problem of retrieval and storage is discussed. The retrieval states are the states of the minimum energy. I apply the estimates found by Lieb 3 which give lower and upper bound of the free-energy and expectation of the observables of the quantum model. I discuss also some experiment and the search of ground state using Monte Carlo Dynamics applied to the equivalent classical two dimensional Ising model constructed by Suzuki et al. 6 At the end there is a list of open problems.