Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1711.03357 · British Machine Vision Conference (BMVC)

Compact Neural Networks based on the Multiscale Entanglement Renormalization Ansatz

Andrew Hallam, Edward Grant, Vid Stojevic, Simone Severini B, Andrew G. Green

Published Nov 9, 2017• 11 citations
arXivHTMLPDF

Abstract

This paper demonstrates a method for tensorizing neural networks based upon an efficient way of approximating scale invariant quantum states, the Multi-scale Entanglement Renormalization Ansatz (MERA). We employ MERA as a replacement for the fully connected layers in a convolutional neural network and test this implementation on the CIFAR-10 and CIFAR-100 datasets. The proposed method outperforms factorization using tensor trains, providing greater compression for the same level of accuracy and greater accuracy for the same level of compression. We demonstrate MERA layers with 14000 times fewer parameters and a reduction in accuracy of less than 1% compared to the equivalent fully connected layers, scaling like O(N).

DOI
10.48550/arxiv.1711.03357

Related papers

Simulating quantum circuits using the multi-scale entanglement renormalization ansatz

A. V. Berezutskii, I. A. Luchnikov, Aleksey K. Fedorov

Understanding the limiting capabilities of classical methods in simulating complex quantum systems is of paramount importance for quantum technologies. Although many advanced approaches have been proposed and recently used to challenge quantum advantage experiments, novel efficient methods for the approximate simulation of complex quantum systems are still in high demand. Here, we propose a scalable technique for approximate simulations of intermediate-size quantum circuits on the basis of the multi-scale entanglement renormalization ansatz (MERA) and Riemannian optimization. The MERA is a tensor network, whose geometry together with orthogonality constraints imposed on its tensors allow approximating many-body quantum states lying beyond the area-law scaling of the entanglement entropy. We benchmark the proposed technique for brick-wall quantum circuits of up to 243 qubits with various depths up to 20 layers. Our approach paves a way to exploring efficient simulation techniques for quantum many-body systems.

arXiv:2112.14046•Physical Review Research•Jan 16, 2025•8 citations

Entanglement compression in scale space: From the multiscale entanglement renormalization ansatz to matrix product operators

Karel Van Acoleyen, Andrew Hallam, Matthias Bal +3 more

The multiscale entanglement renormalization ansatz (MERA) provides a constructive algorithm for realizing wave functions that are inherently scale invariant. Unlike conformally invariant partition functions, however, the finite bond dimension $\ensuremath{\chi}$ of the MERA provides a cutoff in the fields that can be realized. In this paper, we demonstrate that this cutoff is equivalent to the one obtained when approximating a thermal state of a critical Hamiltonian with a matrix product operator (MPO) of finite bond dimension $\ensuremath{\chi}$. This is achieved by constructing an explicit mapping between the isometries of the MERA and the local tensors of the MPO. In terms of energy scales, our results show that a finite bond dimension MERA is equivalent to introducing both an infrared and an ultraviolet scale, characterizing relevant and irrelevant perturbations on the underlying conformal field theory.

arXiv:1912.10572•Physical review. B./Physical review. B•Oct 15, 2020•3 citations

Insights on Building Quantum Convolutional Neural Networks

S. Sony Priya, R. I. Minu

The convolutional neural network (CNN) is a widely recognized model in computer vision due to its capability to utilize data correlation effectively. However, CNNs often face challenges when training on large datasets or dimensions. To address this, the Quantum Convolutional Neural Network (QCNN) introduces an innovative solution for CNN-based problems, specifically within quantum computing frameworks. By integrating CNN architecture into quantum environments, QCNN enhances the model's overall efficiency and functionality. This approach marks an initial effort to propose a solution for classification challenges in quantum physics and chemistry. Furthermore, the study highlights a computational method utilizing the Multi-scale Entanglement Renormalization Ansatz (MERA) with logarithmic depth O(log(n)). Experiments conducted using the TensorFlow Quantum platform on the MNIST dataset demonstrate that QCNNs can achieve faster learning compared to conventional CNNs.

Advances in computational intelligence and robotics book series•Apr 17, 2025•0 citations

Deep Learning in Quantum Physics

Blázquez García, Raúl

Over the past few years a number of proofs have emerged revealing the many connections between the methods used in quantum-many body physics and those in machine learning. In particular, much attention has been given to tensor networks (TNs) and deep learning architectures which exhibit striking similarities. Finding those similarities has helped us gain a better understanding on why deep learning architectures have so much expressive efficiency. Recently, machine learning techniques have been used to approximate many-body physics problems. Conversely, TNs have been used for machine learning tasks. For example, state-of-the-art research has used one-dimensional TNs to solve image recognition problems with very limited scalability. The scalability problem, however, can be overcomed by using a two-dimensional hierarchical TNs and a training algorithm derived from the multipartite entanglement renormalization ansatz (MERA). Here we give further analysis of the inner structural resemblance between such hierarchical tensor networks (TNs) and pretrained convolutional neural networks (CNNs): this was achieved by analyzing their abstraction power layer by layer.

•Oct 27, 2017•0 citations

TensorNetwork on TensorFlow: Entanglement Renormalization for quantum critical lattice models

Martin Ganahl, Ashley Milsted, Stefan Leichenauer +2 more

We use TensorNetwork [C. Roberts et al., arXiv: 1905.01330], a recently developed API for performing tensor network contractions using accelerated backends such as TensorFlow, to implement an optimization algorithm for the Multi-scale Entanglement Renormalization Ansatz (MERA). We use the MERA to approximate the ground state wave function of the infinite, one-dimensional transverse field Ising model at criticality, and extract conformal data from the optimized ansatz. Comparing run times of the optimization on CPUs vs. GPU, we report a very significant speed-up, up to a factor of 200, of the optimization algorithm when run on a GPU.

arXiv:1906.12030•Jun 28, 2019•4 citations

Hierarchical representations in machine learning and many-body quantum physics

Raúl Blázquez García

Over the past few years a number of proofs have emerged revealing the many connections between the methods used in quantum-many body physics and those in machine learning. In particular, much attention has been given to tensor networks (TNs) and deep learning architectures which exhibit striking similarities. Finding those similarities has helped us gain a better understanding on why deep learning architectures have so much expressive efficiency. Recently, machine learning techniques have been used to approximate many-body physics problems. Conversely, TNs have been used for machine learning tasks. For example, state-of-the-art research has used one-dimensional TNs to solve image recognition problems with very limited scalability. The scalability problem, however, can be overcomed by using a two-dimensional hierarchical TNs and a training algorithm derived from the multipartite entanglement renormalization ansatz (MERA). Here we give further analysis of the inner structural resemblance between such hierarchical tensor networks (TNs) and pretrained convolutional neural networks (CNNs): this was achieved by analyzing their abstraction power layer by layer.

•Oct 27, 2017•0 citations
This paper demonstrates a method for tensorizing neural networks based upon an efficient way of approximating scale invariant quantum states, the Multi-scale Entanglement Renormalization Ansatz (MERA). We employ MERA as a replacement for the fully connected layers in a convolutional neural network and test this implementation on the CIFAR-10 and CIFAR-100 datasets. The proposed method outperforms factorization using tensor trains, providing greater compression for the same level of accuracy and greater accuracy for the same level of compression. We demonstrate MERA layers with 14000 times fewer parameters and a reduction in accuracy of less than 1% compared to the equivalent fully connected layers, scaling like O(N).
Understanding the limiting capabilities of classical methods in simulating complex quantum systems is of paramount importance for quantum technologies. Although many advanced approaches have been proposed and recently used to challenge quantum advantage experiments, novel efficient methods for the approximate simulation of complex quantum systems are still in high demand. Here, we propose a scalable technique for approximate simulations of intermediate-size quantum circuits on the basis of the multi-scale entanglement renormalization ansatz (MERA) and Riemannian optimization. The MERA is a tensor network, whose geometry together with orthogonality constraints imposed on its tensors allow approximating many-body quantum states lying beyond the area-law scaling of the entanglement entropy. We benchmark the proposed technique for brick-wall quantum circuits of up to 243 qubits with various depths up to 20 layers. Our approach paves a way to exploring efficient simulation techniques for quantum many-body systems.
The multiscale entanglement renormalization ansatz (MERA) provides a constructive algorithm for realizing wave functions that are inherently scale invariant. Unlike conformally invariant partition functions, however, the finite bond dimension $\ensuremath{\chi}$ of the MERA provides a cutoff in the fields that can be realized. In this paper, we demonstrate that this cutoff is equivalent to the one obtained when approximating a thermal state of a critical Hamiltonian with a matrix product operator (MPO) of finite bond dimension $\ensuremath{\chi}$. This is achieved by constructing an explicit mapping between the isometries of the MERA and the local tensors of the MPO. In terms of energy scales, our results show that a finite bond dimension MERA is equivalent to introducing both an infrared and an ultraviolet scale, characterizing relevant and irrelevant perturbations on the underlying conformal field theory.
The convolutional neural network (CNN) is a widely recognized model in computer vision due to its capability to utilize data correlation effectively. However, CNNs often face challenges when training on large datasets or dimensions. To address this, the Quantum Convolutional Neural Network (QCNN) introduces an innovative solution for CNN-based problems, specifically within quantum computing frameworks. By integrating CNN architecture into quantum environments, QCNN enhances the model's overall efficiency and functionality. This approach marks an initial effort to propose a solution for classification challenges in quantum physics and chemistry. Furthermore, the study highlights a computational method utilizing the Multi-scale Entanglement Renormalization Ansatz (MERA) with logarithmic depth O(log(n)). Experiments conducted using the TensorFlow Quantum platform on the MNIST dataset demonstrate that QCNNs can achieve faster learning compared to conventional CNNs.
Over the past few years a number of proofs have emerged revealing the many connections between the methods used in quantum-many body physics and those in machine learning. In particular, much attention has been given to tensor networks (TNs) and deep learning architectures which exhibit striking similarities. Finding those similarities has helped us gain a better understanding on why deep learning architectures have so much expressive efficiency. Recently, machine learning techniques have been used to approximate many-body physics problems. Conversely, TNs have been used for machine learning tasks. For example, state-of-the-art research has used one-dimensional TNs to solve image recognition problems with very limited scalability. The scalability problem, however, can be overcomed by using a two-dimensional hierarchical TNs and a training algorithm derived from the multipartite entanglement renormalization ansatz (MERA). Here we give further analysis of the inner structural resemblance between such hierarchical tensor networks (TNs) and pretrained convolutional neural networks (CNNs): this was achieved by analyzing their abstraction power layer by layer.
We use TensorNetwork [C. Roberts et al., arXiv: 1905.01330], a recently developed API for performing tensor network contractions using accelerated backends such as TensorFlow, to implement an optimization algorithm for the Multi-scale Entanglement Renormalization Ansatz (MERA). We use the MERA to approximate the ground state wave function of the infinite, one-dimensional transverse field Ising model at criticality, and extract conformal data from the optimized ansatz. Comparing run times of the optimization on CPUs vs. GPU, we report a very significant speed-up, up to a factor of 200, of the optimization algorithm when run on a GPU.
Over the past few years a number of proofs have emerged revealing the many connections between the methods used in quantum-many body physics and those in machine learning. In particular, much attention has been given to tensor networks (TNs) and deep learning architectures which exhibit striking similarities. Finding those similarities has helped us gain a better understanding on why deep learning architectures have so much expressive efficiency. Recently, machine learning techniques have been used to approximate many-body physics problems. Conversely, TNs have been used for machine learning tasks. For example, state-of-the-art research has used one-dimensional TNs to solve image recognition problems with very limited scalability. The scalability problem, however, can be overcomed by using a two-dimensional hierarchical TNs and a training algorithm derived from the multipartite entanglement renormalization ansatz (MERA). Here we give further analysis of the inner structural resemblance between such hierarchical tensor networks (TNs) and pretrained convolutional neural networks (CNNs): this was achieved by analyzing their abstraction power layer by layer.