Quantum accelerated approach to the thermal state of classical all-to-all connected spin systems with applications to pattern retrieval in the Hopfield neural network
Eliana Fiorelli, Pietro Rotondo, Matteo Marcuzzi, Juan P. Garrahan, Igor Lesanovsky
We explore the question as to whether quantum effects can yield a speedup of the nonequilibrium evolution of fully connected quadratic spin models towards a classical thermal state. In our approach we exploit the fact that the thermal state of a spin system can be mapped onto a node-free quantum state whose coefficients are given by thermal weights. This perspective permits the construction of a dissipative yet quantum dynamics which encodes in its stationary state the thermal state of the original problem. We show for the case of an all-to-all connected Ising spin model that an appropriate transformation of this dissipative dynamics allows us to interpolate between a regime in which the order parameter obeys the classical equations of motion under Glauber dynamics and a quantum regime with an accelerated transient timescale before approaching stationarity. We show that this effect enables, in principle, a speedup of pattern retrieval in a Hopfield neural network.
We explore the question as to whether quantum effects can yield a speedup of the nonequilibrium evolution of fully connected quadratic spin models towards a classical thermal state. In our approach we exploit the fact that the thermal state of a spin system can be mapped onto a node-free quantum state whose coefficients are given by thermal weights. This perspective permits the construction of a dissipative yet quantum dynamics which encodes in its stationary state the thermal state of the original problem. We show for the case of an all-to-all connected Ising spin model that an appropriate transformation of this dissipative dynamics allows us to interpolate between a regime in which the order parameter obeys the classical equations of motion under Glauber dynamics and a quantum regime with an accelerated transient timescale before approaching stationarity. We show that this effect enables, in principle, a speedup of pattern retrieval in a Hopfield neural network.
Nowadays, the research field of Machine Learning (ML) is undergoing a rapid expansion. In addition, in the last decades, within the research area of quantum computation, several quantum protocols and algorithms have shown the ability to outperform their classical counterparts. In the light of these twofold advances, a frontier field investigating the potentiality of quantum implementations of ML architectures arose. Among the latter, many efforts are concentrated on Artificial Neural Networks (ANNs), which represent a highly successful ML architecture. This thesis focuses on characterizing and understanding the role of quantum effects on the behavior of an instance of ANN, the so-called Hopfield Neural Network (HNN). The HNN is an example of an associative memory model and it permits the recognition, or retrieval, of patterns, such as letters of an alphabet. Formally, it can be described in terms of a classical spin network with an all-to-all interaction, ruled by a stochastic dynamics. Its relatively intuitive behavior, and its physical description make the HNN being a good candidate for a theoretical investigation of its possible quantum generalizations. In the first part of our work we deal with the implementation of fully connected Ising models, such as the HNN one, in terms of quantum systems. To this end, we refer to the cases where the theory of Open Quantum System (OQS) is exploited for engineering steady states of out-of-equilibrium dynamics. This paradigm allows us to build a dissipative - yet quantum - dynamics which encodes in its stationary state the thermal state of the original (classical) problem. Such a construction gives us the chance to address the question as to whether the quantum description could lead to a speed-up in reaching the shared stationary state with respect to the classical counterpart. We show that a suitable choice of the parameters allows the system to switch between a classical regime and a quantum one, the latter being characterized by an accelerated approach towards the long-time limit state. In the second part of our work we focus on practically relevant implementations of quantum systems that can show analogies with the HNN model. To this end, we consider spin-boson models as described by the Dicke Hamiltonian. Indeed, at strong spin-boson interaction couplings, and when the latter are additionally characterized by disorder, the equilibrium Dicke model is able to reproduce the retrieval mechanism typical of HNNs. When dissipation is included, the theoretical description becomes more challenging. We analyze the open, disordered Dicke model by employing some perturbative techniques in order to deal with the out-of-equilibrium dynamics at strong coupling. As a result, we are able to highlight similarities and differences between the quantum model and HNNs.
Abstract We introduce and analyze an open quantum generalization of the q-state Potts-Hopfield neural network (NN), which is an associative memory model based on multi-level classical spins. The dynamics of this many-body system is formulated in terms of a Markovian master equation of Lindblad type, which allows to incorporate both probabilistic classical and coherent quantum processes on an equal footing. By employing a mean field description we investigate how classical fluctuations due to temperature and quantum fluctuations effectuated by coherent spin rotations affect the ability of the network to retrieve stored memory patterns. We construct the corresponding phase diagram, which in the low temperature regime displays pattern retrieval in analogy to the classical Potts-Hopfield NN. When increasing quantum fluctuations, however, a limit cycle phase emerges, which has no classical counterpart. This shows that quantum effects can qualitatively alter the structure of the stationary state manifold with respect to the classical model, and potentially allow one to encode and retrieve novel types of patterns.
We review our models of quantum associative memories that represent the “quantization” of fully coupled neural networks like the Hopfield model. The idea is to replace the classical irreversible attractor dynamics driven by an Ising model with pattern-dependent weights by the reversible rotation of an input quantum state onto an output quantum state consisting of a linear superposition with probability amplitudes peaked on the stored pattern closest to the input in Hamming distance, resulting in a high probability of measuring a memory pattern very similar to the input. The unitary operator implementing this transformation can be formulated as a sequence of one-qubit and two-qubit elementary quantum gates and is thus the exponential of an ordered quantum Ising model with sequential operations and with pattern-dependent interactions, exactly as in the classical case. Probabilistic quantum memories, that make use of postselection of the measurement result of control qubits, overcome the famed linear storage limitation of their classical counterparts because they permit to completely eliminate crosstalk and spurious memories. The number of control qubits plays the role of an inverse fictitious temperature. The accuracy of pattern retrieval can be tuned by lowering the fictitious temperature under a critical value for quantum content association while the complexity of the retrieval algorithm remains polynomial for any number of patterns polynomial in the number of qubits. These models thus solve the capacity shortage problem of classical associative memories, providing a polynomial improvement in capacity. The price to pay is the probabilistic nature of information retrieval.
Quantum neural networks form one pillar of the emergent field of quantum machine learning. Here quantum generalizations of classical networks realizing associative memories---capable of retrieving patterns, or memories, from corrupted initial states---have been proposed. It is a challenging open problem to analyze quantum associative memories with an extensive number of patterns and to determine the maximal number of patterns the quantum networks can reliably store, i.e., their storage capacity. In this work, we propose and explore a general method for evaluating the maximal storage capacity of quantum neural network models. By generalizing what is known as Gardner's approach in the classical realm, we exploit the theory of classical spin glasses for deriving the optimal storage capacity of quantum networks with quenched pattern variables. As an example, we apply our method to an open-system quantum associative memory formed of interacting spin-1/2 particles realizing coupled artificial neurons. The system undergoes a Markovian time evolution resulting from a dissipative retrieval dynamics that competes with a coherent quantum dynamics. We map out the nonequilibrium phase diagram and study the effect of temperature and Hamiltonian dynamics on the storage capacity. Our method opens an avenue for a systematic characterization of the storage capacity of quantum associative memories.
First I give a brief description of the classical Hopfield model introducing the fundamental concepts of patterns, retrieval, pattern recognition, neural dynamics, capacity and describe the fundamental results obtained in this field by Amit, Gutfreund and Sompolinsky, 1 using the non rigorous method of replica and the rigorous version given by Pastur, Shcherbina, Tirozzi 2 using the cavity method. Then I give a formulation of the theory of Quantum Neural Networks (QNN) in terms of the XY model with Hebbian interaction. The problem of retrieval and storage is discussed. The retrieval states are the states of the minimum energy. I apply the estimates found by Lieb 3 which give lower and upper bound of the free-energy and expectation of the observables of the quantum model. I discuss also some experiment and the search of ground state using Monte Carlo Dynamics applied to the equivalent classical two dimensional Ising model constructed by Suzuki et al. 6 At the end there is a list of open problems.
We introduce the quantum vector Hopfield network, in which patterns are formed by orientations of quantum vector spins; quantum dynamics arise intrinsically from the non-commutativity of the spin operators. We derive the equations of state and the phase diagrams for this network as well as its classical counterpart. We find that quantum fluctuations, surprisingly, stabilize the stored patterns. Both the critical retrieval temperature and the target pattern overlap are enhanced relative to the classical network. Additionally, we find that this enhancement grows with pattern loading up to network capacity. We interpret this effect as an analog of quantum order-by-disorder, a mechanism by which quantum fluctuations promote the formation of ordered phases. These findings offer a new route to quantum-enhanced associative memory.