One of the primary applications of classical Boltzmann machines is generative modeling, wherein the goal is to tune the parameters of a model distribution so that it closely approximates a target distribution. Training relies on estimating the gradient of the relative entropy between the target and model distributions, a task that is well understood when the classical Boltzmann machine has both visible and hidden units. For some years now, it has been an obstacle to generalize this finding to quantum state learning with quantum Boltzmann machines that have both visible and hidden units. In this paper, I derive an analytical expression for the gradient of the quantum relative entropy between a target quantum state and the reduced state of the visible units of a quantum Boltzmann machine. Crucially, this expression is amenable to estimation on a quantum computer, as it involves modular-flow-generated unitary rotations reminiscent of those appearing in my prior work on rotated Petz recovery maps. This leads to a quantum algorithm for gradient estimation in this setting. I then specialize the setting to quantum visible units and classical hidden units, and vice versa; I also provide analytical expressions for the gradients, along with quantum algorithms for estimating them. Finally, I replace the quantum relative entropy objective function with the Petz-Tsallis relative entropy; here I develop an analytical expression for the gradient and sketch a quantum algorithm for estimating it, as an application of an independent derivation of a formula for the derivative of the matrix power function, which also involves modular-flow-generated unitary rotations. Ultimately, this paper demarcates progress in training quantum Boltzmann machines with visible and hidden units for generative modeling and quantum state learning.
One of the primary applications of classical Boltzmann machines is generative modeling, wherein the goal is to tune the parameters of a model distribution so that it closely approximates a target distribution. Training relies on estimating the gradient of the relative entropy between the target and model distributions, a task that is well understood when the classical Boltzmann machine has both visible and hidden units. For some years now, it has been an obstacle to generalize this finding to quantum state learning with quantum Boltzmann machines that have both visible and hidden units. In this paper, I derive an analytical expression for the gradient of the quantum relative entropy between a target quantum state and the reduced state of the visible units of a quantum Boltzmann machine. Crucially, this expression is amenable to estimation on a quantum computer, as it involves modular-flow-generated unitary rotations reminiscent of those appearing in my prior work on rotated Petz recovery maps. This leads to a quantum algorithm for gradient estimation in this setting. I then specialize the setting to quantum visible units and classical hidden units, and vice versa; I also provide analytical expressions for the gradients, along with quantum algorithms for estimating them. Finally, I replace the quantum relative entropy objective function with the Petz-Tsallis relative entropy; here I develop an analytical expression for the gradient and sketch a quantum algorithm for estimating it, as an application of an independent derivation of a formula for the derivative of the matrix power function, which also involves modular-flow-generated unitary rotations. Ultimately, this paper demarcates progress in training quantum Boltzmann machines with visible and hidden units for generative modeling and quantum state learning.
One of the primary applications of classical Boltzmann machines is generative modeling, wherein the goal is to tune the parameters of a model distribution so that it closely approximates a target distribution. Training relies on estimating the gradient of the relative entropy between the target and model distributions, a task that is well understood when the classical Boltzmann machine has both visible and hidden units. For some years now, it has been an obstacle to generalize this finding to quantum state learning with quantum Boltzmann machines that have both visible and hidden units. In this paper, I derive an analytical expression for the gradient of the quantum relative entropy between a target quantum state and the reduced state of the visible units of a quantum Boltzmann machine. Crucially, this expression is amenable to estimation on a quantum computer, as it involves modular-flow-generated unitary rotations reminiscent of those appearing in my prior work on rotated Petz recovery maps. This leads to a quantum algorithm for gradient estimation in this setting. I then specialize the setting to quantum visible units and classical hidden units, and vice versa, and provide analytical expressions for the gradients, along with quantum algorithms for estimating them. Finally, I replace the quantum relative entropy objective function with the Petz-Tsallis relative entropy; here I develop an analytical expression for the gradient and sketch a quantum algorithm for estimating it, as an application of an independent derivation of a formula for the derivative of the matrix power function, which also involves modular-flow-generated unitary rotations. Ultimately, this work demarcates progress in training quantum Boltzmann machines with visible and hidden units for generative modeling and quantum state learning.
Born-rule generative modeling, a central task in quantum machine learning, seeks to learn probability distributions that can be efficiently sampled by measuring complex quantum states. One hope is for quantum models to efficiently capture probability distributions that are difficult to learn and simulate by classical means alone. Quantum Boltzmann machines were proposed about one decade ago for this purpose, yet efficient training methods have remained elusive. In this paper, I overcome this obstacle by proposing a practical solution that trains quantum Boltzmann machines for Born-rule generative modeling. Two key ingredients in the proposal are the Donsker-Varadhan variational representation of the classical relative entropy and the quantum Boltzmann gradient estimator of [Patel et al., arXiv:2410.12935]. I present the main result for a more general ansatz known as an evolved quantum Boltzmann machine [Minervini et al., arXiv:2501.03367], which combines parameterized real- and imaginary-time evolution. I also show how to extend the findings to other distinguishability measures beyond relative entropy. Finally, I present four different hybrid quantum-classical algorithms for the minimax optimization underlying training, and I discuss their theoretical convergence guarantees.
In this article we provide a method for fully quantum generative training of quantum Boltzmann machines with both visible and hidden units while using quantum relative entropy as an objective. This is significant because prior methods were not able to do so due to mathematical challenges posed by the gradient evaluation. We present two novel methods for solving this problem. The first proposal addresses it, for a class of restricted quantum Boltzmann machines with mutually commuting Hamiltonians on the hidden units, by using a variational upper bound on the quantum relative entropy. The second one uses high-order divided difference methods and linear-combinations of unitaries to approximate the exact gradient of the relative entropy for a generic quantum Boltzmann machine. Both methods are efficient under the assumption that Gibbs state preparation is efficient and that the Hamiltonian are given by a sparse row-computable matrix.
Thermal states play a fundamental role in various areas of physics, and they are becoming increasingly important in quantum information science, with applications related to semidefinite programming, quantum Boltzmann machine learning, Hamiltonian learning, and the related task of estimating the parameters of a Hamiltonian. Here we establish formulas underlying the basic geometry of parameterized thermal states, and we delineate quantum algorithms for estimating the values of these formulas. More specifically, we establish formulas for the Fisher--Bures and Kubo--Mori information matrices of parameterized thermal states, and our quantum algorithms for estimating their matrix elements involve a combination of classical sampling, Hamiltonian simulation, and the Hadamard test. These results have applications in developing a natural gradient descent algorithm for quantum Boltzmann machine learning, which takes into account the geometry of thermal states, and in establishing fundamental limitations on the ability to estimate the parameters of a Hamiltonian, when given access to thermal-state samples. For the latter task, and for the special case of estimating a single parameter, we sketch an algorithm that realizes a measurement that is asymptotically optimal for the estimation task. We finally stress that the natural gradient descent algorithm developed here can be used for any machine learning problem that employs the quantum Boltzmann machine ansatz.
We introduce evolved quantum Boltzmann machines as a variational ansatz for quantum optimization and learning tasks. Given two parameterized Hamiltonians G(θ) and H(ϕ), an evolved quantum Boltzmann machine consists of preparing a thermal state of the first Hamiltonian G(θ) followed by unitary evolution according to the second Hamiltonian H(ϕ). Alternatively, one can think of it as first realizing imaginary time evolution according to G(θ) followed by real time evolution according to H(ϕ). After defining this ansatz, we provide analytical expressions for the gradient vector and illustrate their application in ground-state energy estimation and generative modeling, showing how the gradient for these tasks can be estimated by means of quantum algorithms that involve classical sampling, Hamiltonian simulation, and the Hadamard test. We also establish analytical expressions for the Fisher-Bures, Wigner-Yanase, and Kubo-Mori information matrix elements of evolved quantum Boltzmann machines, as well as quantum algorithms for estimating each of them, which leads to at least three different general natural gradient descent algorithms based on this ansatz. Along the way, we establish a broad generalization of the main result of [Luo, Proc. Am. Math. Soc. 132, 885 (2004)], proving that the Fisher-Bures and Wigner-Yanase information matrices of general parameterized families of states differ by no more than a factor of two in the matrix (Loewner) order, making them essentially interchangeable for training when using natural gradient descent.
Quantum machine learning is at the crossroads of two of the most exciting current areas of research: quantum computing and classical machine learning. Although the field is still in its infancy, the body of literature is already large enough to warrant several review articles [1–3]. This short survey focuses on a selection of significant recent results on the subtopic of quantum neural networks, an area that hopes to build on the enormous impact that classical neural networks have had. In particular, we concentrate on quantum generalizations of popular neural-network concepts such as Boltzmann machines, generative adversarial networks and autoencoders, as well as applications of classical neural networks to quantum information and vice versa. Examples of Boltzmann machines. In a fully connected Boltzmann machine, connections exist between all visible and hidden neurons. In a restricted Boltzmann machine (RBM), there are no connections between neurons of the same type. A deep Boltzmann machine (DBM) consists of adding one or more additional layers of hidden neurons to an RBM, with no connections between neurons in the same layer. The energy-based nature of BMs gives a natural framework for considering quantum generalizations of their behavior. The BM energy function is equivalent to the Hamiltonian of a simple Ising model and one might hope that more general Hamiltonians allowed by quantum mechanics could explain certain data sets better than classically. Amin et al. [4] adopt this approach, and take the so-called transverse field Ising Hamiltonian as the energy function. This increased generality brings certain difficulties, however, as the transverse field term makes training the quantum Boltzmann machine (QBM) non-trivial. Although the general scaling and performance of QBMs is not yet well understood, for certain small-size examples the authors observe that their QBMs can learn data distributions better than classical BMs. Kieferova and Wiebe [5] extend the formalism of Amin et al. and consider more general Hamiltonians that, unlike the transverse Ising model, are not in general believed to be classically efficiently simulatable. Furthermore, they propose new methods for training that allow for parameters corresponding to quantum terms to be learned. Finally, their QBM enables a form of quantum-state tomography that can learn non-classical data, and also generate copies of the reconstructed state. Again, small-scale numerical evidence suggests that their proposals may provide an advantage over classical BMs, although their tendency to overfit data must be investigated further. The practical value of BMs, either classical or quantum, relies in part on the ease with which they are trained. This in turn depends on sampling efficiently from the Boltzmann distribution. Classically this can be done approximately only for the special case of restricted Boltzmann machines (RBM), i.e. where connections are between visible and hidden units, and no connections exist between neurons of the same type. Wiebe et al. [6] propose two quantum algorithms for Boltzmann sampling, based on starting from a state corresponding to the product distribution that is closest to the target Boltzmann distribution. While small-scale numerical studies are encouraging, true bounds on the running time of their algorithms rely on a problem-dependent parameter κ, the scaling of which is hard to estimate. The hope remains though that empirically their algorithms work well in practice, even for multi-layer and fully connected BMs. The expressive power of BMs for compactly representing complicated probability distributions has led to another line of investigation, namely their use for representing quantum many-body wave functions. The authors apply this technique to two prototypical spin models and achieve high accuracy in both ground-state estimation and dynamical evolution, improving on existing state-of-the-art techniques. Their results indicate that RBM states can capture complex many-body correlations in an efficient manner—evidence reinforced by the work of Deng et al. [8], who show that certain topological quantum states in one, two and three dimensions can be represented by RBM states with a number of parameters only linear in the system size. In a subsequent study, however, Gao and Duan [9] prove that although RBM states can indeed represent many highly entangled states, their expressive power is limited in that they cannot represent arbitrary states generated by polynomial-sized quantum circuits, nor those that are the ground states of k-local Hamiltonians with polynomial-sized energy gaps, unless the polynomial hierarchy from computational complexity theory collapses. On the other hand, they show that these two important classes of states can be efficiently represented by a deep Boltzmann machine of three layers. Intriguingly though, another paper by Deng et al. [10] gives an analytic construction of a family of RBM states with a number of parameters linear in the system size that exhibits maximal volume-law entanglement, and that cannot be represented efficiently by either matrix product states (MPS) or tensor-network (TN) states. This shows that the expressive power of even efficiently parametrized RBM states is not limited by entanglement in the same way that other popular compact representations are. This gives the hope that RBM states may prove a valuable tool in understanding entangled quantum systems intractable by traditional methods. Levine et al. [11] establish another connection between the many-body wave function and neural networks, this time in the form of convolutional arithmetic circuits (ConvAC), a variant of the popular convolutional neural networks in widespread use today. By proving a one-to-one equivalence between a ConvAC circuit and TN quantum states, the authors are able to use tools from quantum information theory to analyze the entanglement present in the corresponding TN, and quantify the neural network's ability to model complex correlations between its inputs. This in turn can be used to obtain bounds on the expressivity of a given ConvAC architecture and be of practical use in choosing network parameters tailored to the data. While ConvAC are not widely used in practice, the authors empirically validate that the insights gained can be applied successfully to more common convolutional neural-network designs. Generative adversarial networks (GAN) are machine-learning algorithms in which two players—a generator and a discriminator—compete against each another. The generator's goal is to create and send fake data samples to the discriminator and maximize the probability that the discriminator erroneously believes that the sample comes from some true data distribution. The discriminator attempts to discern real from fake data as best as possible. Under reasonable assumptions the game converges to a point where the discriminator is unable to discriminate with probability greater than 1/2 (i.e. no better than random guessing), and the generator in fact has learned to generate data from the true distribution. Lloyd and Weedbrook [12] consider the natural extension in which one or both of the generator and discriminator are equipped with quantum information processors. When the data to be learned are a quantum state and both parties have quantum processors, the authors show that the unique end point of the adversarial game also coincides with the generator producing a quantum state corresponding to the true data statistics, and the discriminator unable to discern true from false data better than random guessing. They further argue that a different outcome may hold when the true samples are produced by the measurement of some quantum state, and the generator is purely classical. The concept of quantum supremacy is based on the assumption that there exist probability distributions accessible to a quantum computer that no classical computer can efficiently sample from. If the true data correspond to one of these distributions, then no classical generator can efficiently generate fake data reproducing the true statistics and, in principle, the discriminator can successfully discriminate true from fake data. However, whether the discriminator can efficiently find the measurements required to do so is unclear. Quantum-computing techniques have also found applications in autoencoders—neural networks where a larger number of input and output neurons are connected via a smaller number of intermediary latent neurons. The goal is to tune the weights of the network so that a training set of classical bit strings can be approximately recovered after being passed through the autoencoder. Romero et al. [13] consider instead a training set of quantum states, and ask whether a quantum circuit with a similar bottleneck structure can compress and approximately recover the data. The circuits that they consider consist of gates chosen from some set of parametrized unitary operations, and arranged in some fixed order. The parameters are then optimized classically so that the circuit best predicts the training-set labels. The authors demonstrate the validity of this approach by showing that ground states of the Hubbard model and certain molecules can indeed be compressed and recovered by such circuits. However, in general, the performance of such quantum autoencoders will be highly dependent on the kind of programmable circuit on which they are based, and at present there does not seem to be a structured way of determining this. Quantum neural networks are still in their infancy and, while the above works are important steps towards bridging our understanding between classical neural networks and quantum computing, many questions remain unanswered. If the expressivity of Boltzmann machine states is not restricted by entanglement in the same way that MPS and tensor-network states are, what is the best way of understanding their limitations? How can physicists use the correspondence between ConvAC and TN to their advantage in finding efficient, expressive representations of many-body wave functions? Can classical data distributions be learned more efficiently by quantum GAN than classical GAN? Whatever the outcome of these and many other related questions, this promises to be an exciting and active area of research in the years to come.