Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2104.13264 · SciPost Physics

Collective Monte Carlo updates through tensor network renormalization

Miguel Frías-Pérez, Michael Mariën, David Pérez-García, Mari Carmen Bañuls, S. Iblisdir

Published May 22, 2023• 20 citations
arXivHTMLPDF

Abstract

We introduce a Metropolis-Hastings Markov chain for Boltzmann distributions of classical spin systems. It relies on approximate tensor network contractions to propose correlated collective updates at each step of the evolution. We present benchmark computations for a wide variety of instances of the two-dimensional Ising model, including ferromagnetic, antiferromagnetic, (fully) frustrated and Edwards-Anderson spin glass instances, and we show that, with modest computational effort, our Markov chain achieves sizeable acceptance rates, even in the vicinity of critical points. In each of the situations we have considered, the Markov chain compares well with other Monte Carlo schemes such as the Metropolis or Wolff’s algorithm: equilibration times appear to be reduced by a factor that varies between 40 40 and 2000 2000 , depending on the model and the observable being monitored. We also present an extension to three spatial dimensions, and demonstrate that it exhibits fast equilibration for finite ferro- and antiferromagnetic instances. Additionally, and although it is originally designed for a square lattice of finite degrees of freedom with open boundary conditions, the proposed scheme can be used as such, or with slight modifications, to study triangular lattices, systems with continuous degrees of freedom, matrix models, a confined gas of hard spheres, or to deal with arbitrary boundary conditions.

DOI
10.21468/scipostphys.14.5.123

Related papers

Tensor-Network Markov-Chain Monte Carlo: Efficient Sampling of Three-Dimensional Spin Glasses

Tao Chen, Jing Liu, Youjin Deng +1 more

Sampling equilibrium configurations of three-dimensional (3D) spin glasses with quenched disorder remains a fundamental challenge in statistical physics. The rugged energy landscape, pronounced critical slowing down, and intrinsic ergodicity breaking render standard Monte Carlo methods severely inefficient, particularly for large systems at low temperatures. In this Letter, we introduce the tensor-network Markov-chain Monte Carlo (TNMCMC) approach to address the issue. By formulating large-scale collective updates via tensor-network contractions on 2D lattice slices, TNMCMC yields unbiased samples of the Boltzmann distribution while substantially reducing autocorrelation times relative to conventional MCMC approaches. Numerical benchmarks on 3D spin glasses demonstrate that the method systematically mitigates critical slowing down. Furthermore, application to three- and four-state 3D Potts models shows that TNMCMC can traverse the exponential free-energy barriers of first-order phase transitions that typically hinder local MC updates. These results establish TNMCMC as a promising numerical framework capable of addressing important 3D problems in statistical physics and beyond, such as the precise computation of low-temperature thermodynamic properties of three-dimensional spin glasses and the decoding of quantum error-correcting codes with a three-dimensional topology.

arXiv:2509.23945•Physical Review Letters•Aug 12, 2026•8 citations

Tensor network Monte Carlo simulations for the two-dimensional random-bond Ising model

Tao Chen, Erdong Guo, Wanzhou Zhang +2 more

Disordered lattice spin systems are crucial in both theoretical and applied physics. However, understanding their properties poses significant challenges to Monte Carlo simulations. In this work, we investigate the two-dimensional random-bond Ising model using the recently proposed tensor network Monte Carlo (TNMC) method. This method generates biased samples from conditional probabilities computed via tensor network contractions and corrects the bias using the Metropolis scheme. Consequently, the proposals provided by tensor networks function as block updates for Monte Carlo simulations. Through extensive numerical experiments, we demonstrate that TNMC simulations can be performed on lattices as large as $1024\ifmmode\times\else\texttimes\fi{}1024$ spins with moderate computational resources, a substantial increase from the previous maximum size of $64\ifmmode\times\else\texttimes\fi{}64$ in Markov-chain Monte Carlo. Notably, we observe an almost complete absence of critical slowing down, enabling the efficient collection of unbiased samples and averaging over a large number of random realizations of bond disorders. We successfully pinpoint the multicritical point along the Nishimori line with significant precision and accurately determined the bulk and surface critical exponents. Our findings suggest that TNMC is a highly efficient algorithm for exploring disordered and frustrated systems in two dimensions.

arXiv:2409.06538•Physical review. B./Physical review. B•Mar 4, 2025•20 citations

BatchTNMC: Efficient sampling of two-dimensional spin glasses using tensor network Monte Carlo

Tao Chen, Jingtong Zhang, Liu, Jing +2 more

Efficient sampling of two-dimensional statistical physics systems remains a central challenge in computational statistical physics. Traditional Markov chain Monte Carlo (MCMC) methods, including cluster algorithms, provide only partial solutions, as their efficiency collapses for large systems in the presence of frustration and quenched disorder. The recently proposed Tensor Network Monte Carlo (TNMC) method offers a promising alternative, yet its original implementation suffers from inefficiencies due to the lack of scalable parallel sampling. In this work, we introduce BatchTNMC, a GPU-optimized and parallelized implementation of TNMC tailored for large-scale simulations of two-dimensional spin glasses. By leveraging batch processing and parallel sampling across multiple disorder realizations, our implementation achieves speedups of up to five orders of magnitude compared with the original serial scheme. Benchmarking on two-dimensional spin glasses demonstrates dramatic gains in efficiency: for instance, on a single GPU, BatchTNMC concurrently produces 1000 uncorrelated and unbiased samples across 1000 disorder realizations on $1024\times 1024$ lattices in just 3.3 hours, with an acceptance probability of 37%. These results establish BatchTNMC as a scalable and powerful computational framework for the study of two-dimensional disordered spin glass systems.

arXiv:2509.19006•Sep 23, 2025•7 citations

Tensor network Monte Carlo study of the J1-J2 Ising model on the square lattice

Wanying Zheng, Tao Chen, Youjin Deng +1 more

The frustrated square-lattice J1-J2 Ising model exhibits rich magnetic phases, yet its phase transitions remain difficult to characterize due to critical slowing down in conventional Monte Carlo and truncation errors inherent to tensor renormalization group methods. We develop a tensor-network Monte Carlo (TNMC) algorithm for this frustrated model, which supports both open and periodic boundary conditions. For periodic lattices, we use a sweeping block-update strategy that updates spin blocks while fixing surrounding spins. To boost efficiency, we couple our sampler with histogram reweighting, and test each technique standalone to validate these independent optimizations. We perform extensive finite-size scaling analyses at g=0.55 and g=1.0, extracting apparent critical temperatures and effective thermal exponents from Binder-cumulant data. Our method offers an efficient, nearly bias-free path for large-scale simulations of J1-J2-type frustrated magnets under periodic boundaries and generalizes readily to other frustrated spin lattices.

arXiv:2610.25270•Oct 18, 2026•0 citations

A Unified Framework for Cluster Methods with Tensor Networks

Erdong Guo, David Draper

Markov Chain Monte Carlo (MCMC), and Tensor Networks (TN) are two powerful frameworks for numerically investigating many-body systems, each offering distinct advantages. MCMC, with its flexibility and theoretical consistency, is well-suited for simulating arbitrary systems by sampling. TN, on the other hand, provides a powerful tensor-based language for capturing the entanglement properties intrinsic to many-body systems, offering a universal representation of these systems. In this work, we leverage the computational strengths of TN to design a versatile cluster MCMC sampler. Specifically, we propose a general framework for constructing tensor-based cluster MCMC methods, enabling arbitrary cluster updates by utilizing TNs to compute the distributions required in the MCMC sampler. Our framework unifies several existing cluster algorithms as special cases and allows for natural extensions. We demonstrate our method by applying it to the simulation of the two-dimensional Edwards-Anderson Model and the three-dimensional Ising Model. This work is dedicated to the memory of Prof. David Draper.

arXiv:2409.04729•Sep 7, 2024•1 citation

Monte Carlo simulation of classical Heisenberg model in three dimensions

Ville Jantunen

We study the efficiency and theory behind various Markov chain Monte Carlo update methods (later MCMC) in the classical Heisenberg model in three dimensions. Classical Heisenberg model is a model in statistical physics that describes ferromagnetic phenomena. Classical Heisenberg model is a generalization of the Ising model where the spin is three dimensional unit vector instead of scalar -1 or 1. Both models show a second order phase transition which is the main reason we are interested in these models. The transition in our case describes the loss of magnetization of a ferromagnet as it is heated to its Curie temperature. Monte Carlo simulating the Classical Heisenberg model uses the same MCMC update methods as the Ising model. We introduce the theoretical background of Metropolis, Overrelaxation, and Wolff single cluster updates and study the dynamic critical exponents of Metropolis and Wolff updates. Results of this study are as expected: metropolis suffers from critical slowing down near the phase transition temperature and the autocorrelation time scales to L^5.08 , where L^3 is the size of the lattice. Wolff single cluster update avoids critical slowing down and scales very well with autocorrelation time scaling to L^3.28 . Even though Wolff update scales much better it has its downsides. Parallelization is a very important factor in modern scientific computing and Wolff update is very tricky to parallelize where as Metropolis parallelizes very well. Usually we can avoid this problem by running multiple instances of the simulation at the same time as varying simulation parameters such as the temperature. For large lattices the problems is that getting moderate results requires a lot of time.

Työväentutkimus Vuosikirja•Jan 1, 2017•0 citations
We introduce a Metropolis-Hastings Markov chain for Boltzmann distributions of classical spin systems. It relies on approximate tensor network contractions to propose correlated collective updates at each step of the evolution. We present benchmark computations for a wide variety of instances of the two-dimensional Ising model, including ferromagnetic, antiferromagnetic, (fully) frustrated and Edwards-Anderson spin glass instances, and we show that, with modest computational effort, our Markov chain achieves sizeable acceptance rates, even in the vicinity of critical points. In each of the situations we have considered, the Markov chain compares well with other Monte Carlo schemes such as the Metropolis or Wolff’s algorithm: equilibration times appear to be reduced by a factor that varies between 40 40 and 2000 2000 , depending on the model and the observable being monitored. We also present an extension to three spatial dimensions, and demonstrate that it exhibits fast equilibration for finite ferro- and antiferromagnetic instances. Additionally, and although it is originally designed for a square lattice of finite degrees of freedom with open boundary conditions, the proposed scheme can be used as such, or with slight modifications, to study triangular lattices, systems with continuous degrees of freedom, matrix models, a confined gas of hard spheres, or to deal with arbitrary boundary conditions.
Sampling equilibrium configurations of three-dimensional (3D) spin glasses with quenched disorder remains a fundamental challenge in statistical physics. The rugged energy landscape, pronounced critical slowing down, and intrinsic ergodicity breaking render standard Monte Carlo methods severely inefficient, particularly for large systems at low temperatures. In this Letter, we introduce the tensor-network Markov-chain Monte Carlo (TNMCMC) approach to address the issue. By formulating large-scale collective updates via tensor-network contractions on 2D lattice slices, TNMCMC yields unbiased samples of the Boltzmann distribution while substantially reducing autocorrelation times relative to conventional MCMC approaches. Numerical benchmarks on 3D spin glasses demonstrate that the method systematically mitigates critical slowing down. Furthermore, application to three- and four-state 3D Potts models shows that TNMCMC can traverse the exponential free-energy barriers of first-order phase transitions that typically hinder local MC updates. These results establish TNMCMC as a promising numerical framework capable of addressing important 3D problems in statistical physics and beyond, such as the precise computation of low-temperature thermodynamic properties of three-dimensional spin glasses and the decoding of quantum error-correcting codes with a three-dimensional topology.
Disordered lattice spin systems are crucial in both theoretical and applied physics. However, understanding their properties poses significant challenges to Monte Carlo simulations. In this work, we investigate the two-dimensional random-bond Ising model using the recently proposed tensor network Monte Carlo (TNMC) method. This method generates biased samples from conditional probabilities computed via tensor network contractions and corrects the bias using the Metropolis scheme. Consequently, the proposals provided by tensor networks function as block updates for Monte Carlo simulations. Through extensive numerical experiments, we demonstrate that TNMC simulations can be performed on lattices as large as $1024\ifmmode\times\else\texttimes\fi{}1024$ spins with moderate computational resources, a substantial increase from the previous maximum size of $64\ifmmode\times\else\texttimes\fi{}64$ in Markov-chain Monte Carlo. Notably, we observe an almost complete absence of critical slowing down, enabling the efficient collection of unbiased samples and averaging over a large number of random realizations of bond disorders. We successfully pinpoint the multicritical point along the Nishimori line with significant precision and accurately determined the bulk and surface critical exponents. Our findings suggest that TNMC is a highly efficient algorithm for exploring disordered and frustrated systems in two dimensions.
Efficient sampling of two-dimensional statistical physics systems remains a central challenge in computational statistical physics. Traditional Markov chain Monte Carlo (MCMC) methods, including cluster algorithms, provide only partial solutions, as their efficiency collapses for large systems in the presence of frustration and quenched disorder. The recently proposed Tensor Network Monte Carlo (TNMC) method offers a promising alternative, yet its original implementation suffers from inefficiencies due to the lack of scalable parallel sampling. In this work, we introduce BatchTNMC, a GPU-optimized and parallelized implementation of TNMC tailored for large-scale simulations of two-dimensional spin glasses. By leveraging batch processing and parallel sampling across multiple disorder realizations, our implementation achieves speedups of up to five orders of magnitude compared with the original serial scheme. Benchmarking on two-dimensional spin glasses demonstrates dramatic gains in efficiency: for instance, on a single GPU, BatchTNMC concurrently produces 1000 uncorrelated and unbiased samples across 1000 disorder realizations on 1024×10241024\times 10241024×1024 lattices in just 3.3 hours, with an acceptance probability of 37%. These results establish BatchTNMC as a scalable and powerful computational framework for the study of two-dimensional disordered spin glass systems.
The frustrated square-lattice J1-J2 Ising model exhibits rich magnetic phases, yet its phase transitions remain difficult to characterize due to critical slowing down in conventional Monte Carlo and truncation errors inherent to tensor renormalization group methods. We develop a tensor-network Monte Carlo (TNMC) algorithm for this frustrated model, which supports both open and periodic boundary conditions. For periodic lattices, we use a sweeping block-update strategy that updates spin blocks while fixing surrounding spins. To boost efficiency, we couple our sampler with histogram reweighting, and test each technique standalone to validate these independent optimizations. We perform extensive finite-size scaling analyses at g=0.55 and g=1.0, extracting apparent critical temperatures and effective thermal exponents from Binder-cumulant data. Our method offers an efficient, nearly bias-free path for large-scale simulations of J1-J2-type frustrated magnets under periodic boundaries and generalizes readily to other frustrated spin lattices.
Markov Chain Monte Carlo (MCMC), and Tensor Networks (TN) are two powerful frameworks for numerically investigating many-body systems, each offering distinct advantages. MCMC, with its flexibility and theoretical consistency, is well-suited for simulating arbitrary systems by sampling. TN, on the other hand, provides a powerful tensor-based language for capturing the entanglement properties intrinsic to many-body systems, offering a universal representation of these systems. In this work, we leverage the computational strengths of TN to design a versatile cluster MCMC sampler. Specifically, we propose a general framework for constructing tensor-based cluster MCMC methods, enabling arbitrary cluster updates by utilizing TNs to compute the distributions required in the MCMC sampler. Our framework unifies several existing cluster algorithms as special cases and allows for natural extensions. We demonstrate our method by applying it to the simulation of the two-dimensional Edwards-Anderson Model and the three-dimensional Ising Model. This work is dedicated to the memory of Prof. David Draper.
We study the efficiency and theory behind various Markov chain Monte Carlo update methods (later MCMC) in the classical Heisenberg model in three dimensions. Classical Heisenberg model is a model in statistical physics that describes ferromagnetic phenomena. Classical Heisenberg model is a generalization of the Ising model where the spin is three dimensional unit vector instead of scalar -1 or 1. Both models show a second order phase transition which is the main reason we are interested in these models. The transition in our case describes the loss of magnetization of a ferromagnet as it is heated to its Curie temperature. Monte Carlo simulating the Classical Heisenberg model uses the same MCMC update methods as the Ising model. We introduce the theoretical background of Metropolis, Overrelaxation, and Wolff single cluster updates and study the dynamic critical exponents of Metropolis and Wolff updates. Results of this study are as expected: metropolis suffers from critical slowing down near the phase transition temperature and the autocorrelation time scales to L^5.08 , where L^3 is the size of the lattice. Wolff single cluster update avoids critical slowing down and scales very well with autocorrelation time scaling to L^3.28 . Even though Wolff update scales much better it has its downsides. Parallelization is a very important factor in modern scientific computing and Wolff update is very tricky to parallelize where as Metropolis parallelizes very well. Usually we can avoid this problem by running multiple instances of the simulation at the same time as varying simulation parameters such as the temperature. For large lattices the problems is that getting moderate results requires a lot of time.