Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1011.4421 · Journal of Statistical Mechanics Theory and Experiment

Mutual information in classical spin models

Johannes Wilms, Matthias Troyer, Frank Verstraete

Published Oct 10, 2011• 52 citations
arXivHTMLPDF

Abstract

The total many-body correlations present in finite temperature classical spin systems are studied using the concept of mutual information. As opposed to zero-temperature quantum phase transitions, the total correlations are not maximal at the phase transition, but reach a maximum in the high-temperature paramagnetic phase. The Shannon mutual information and the Renyi mutual information in both Ising and Potts models in two dimensions are calculated numerically by combining matrix product state algorithms and Monte Carlo sampling techniques.

DOI
10.1088/1742-5468/2011/10/p10011

Related papers

Critical scaling of the mutual information in two-dimensional disordered Ising models

P V Sriluckshmy, Ipsita Mandal

Abstract Rényi mutual information, computed from second Rényi entropies, can identify classical phase transitions from their finite-size scaling at critical points. We apply this technique to examine the presence or absence of finite temperature phase transitions in various two-dimensional models on a square lattice, which are extensions of the conventional Ising model by adding a quenched disorder. When the quenched disorder causes the nearest neighbor bonds to be both ferromagnetic and antiferromagnetic, (a) a spin glass phase exists only at zero temperature, and (b) a ferromagnetic phase exists at a finite temperature when the antiferromagnetic bond distributions are sufficiently dilute. Furthermore, finite temperature paramagnetic-ferromagnetic transitions can also occur when the disordered bonds involve only ferromagnetic couplings of random strengths. In our numerical simulations, the ‘zero temperature only’ phase transitions are identified when there is no consistent finite-size scaling of the Rényi mutual information curves, while for finite temperature critical points, the curves can identify the critical temperature T c by their crossings at T c and 2 T c .

arXiv:1711.02352•Journal of Statistical Mechanics Theory and Experiment•Apr 1, 2018•9 citations

Detecting classical phase transitions with Renyi mutual information

Jason Iaconis, Stephen Inglis, Ann B. Kallin +1 more

By developing a method to represent the Renyi entropies via a replica trick on classical statistical mechanical systems, we introduce a procedure to calculate the Renyi mutual information (RMI) in any Monte Carlo simulation. Through simulations on several classical models, we demonstrate that the RMI can detect finite-temperature critical points, and even identify their universality class, without knowledge of an order parameter or other thermodynamic estimators. Remarkably, in addition to critical points mediated by symmetry breaking, the RMI is able to detect topological vortex-unbinding transitions, as we explicitly demonstrate on simulations of the $XY$ model.

arXiv:1210.2403•Physical Review B•May 28, 2013•59 citations

Finite-size scaling of mutual information in Monte Carlo simulations: Application to the spin- 12 XXZ model

Roger G. Melko, Ann B. Kallin, Matthew B. Hastings

We develop a quantum Monte Carlo procedure to compute the Renyi mutual information of an interacting quantum many-body system at nonzero temperature. Performing simulations on a spin-$\frac{1}{2}$ $XXZ$ model, we observe that for a subregion of fixed size embedded in a system of size $L$, the mutual information converges at large $L$ to a limiting function which displays nonmonotonic temperature behavior corresponding to the onset of correlations. For a region of size $L/2$ embedded in a system of size $L$, the mutual information divided by $L$ converges to a limiting function of temperature, with apparently nontrivial corrections near critical points.

arXiv:1007.2182•Physical Review B•Sep 17, 2010•93 citations

Wang-Landau method for calculating Rényi entropies in finite-temperature quantum Monte Carlo simulations

Stephen Inglis, Roger G. Melko

We implement a Wang-Landau sampling technique in quantum Monte Carlo (QMC) simulations for the purpose of calculating the Rényi entanglement entropies and associated mutual information. The algorithm converges an estimate for an analog to the density of states for stochastic series expansion QMC, allowing a direct calculation of Rényi entropies without explicit thermodynamic integration. We benchmark results for the mutual information on two-dimensional (2D) isotropic and anisotropic Heisenberg models, a 2D transverse field Ising model, and a three-dimensional Heisenberg model, confirming a critical scaling of the mutual information in cases with a finite-temperature transition. We discuss the benefits and limitations of broad sampling techniques compared to standard importance sampling methods.

arXiv:1207.5052•Physical Review E•Jan 22, 2013•52 citations

Classical mutual information in mean-field spin glass models

Vincenzo Alba, Stephen Inglis, Lode Pollet

We investigate the classical R\'enyi entropy ${S}_{n}$ and the associated mutual information ${\mathcal{I}}_{n}$ in the Sherrington-Kirkpatrick (S-K) model, which is the paradigm model of mean-field spin glasses. Using classical Monte Carlo simulations and analytical tools we investigate the S-K model in the $n$-sheet booklet. This is achieved by gluing together $n$ independent copies of the model, and it is the main ingredient for constructing the R\'enyi entanglement-related quantities. We find a glassy phase at low temperatures, whereas at high temperatures the model exhibits paramagnetic behavior, consistent with the regular S-K model. The temperature of the paramagnetic-glassy transition depends nontrivially on the geometry of the booklet. At high temperatures we provide the exact solution of the model by exploiting the replica symmetry. This is the permutation symmetry among the fictitious replicas that are used to perform disorder averages (via the replica trick). In the glassy phase the replica symmetry has to be broken. Using a generalization of the Parisi solution, we provide analytical results for ${S}_{n}$ and ${\mathcal{I}}_{n}$ and for standard thermodynamic quantities. Both ${S}_{n}$ and ${\mathcal{I}}_{n}$ exhibit a volume law in the whole phase diagram. We characterize the behavior of the corresponding densities, ${S}_{n}/N$ and ${\mathcal{I}}_{n}/N$, in the thermodynamic limit. Interestingly, at the critical point the mutual information does not exhibit any crossing for different system sizes, in contrast with local spin models.

arXiv:1507.01274•Physical review. B./Physical review. B•Mar 4, 2016•11 citations

Finite-temperature mutual information in a simple phase transition

Johannes Wilms, Julien Vidal, Frank Verstraete +1 more

We study the finite-temperature behavior of the Lipkin–Meshkov–Glick model with a focus on correlation properties as measured by the mutual information. The latter, which quantifies the amount of both classical and quantum correlations, is computed exactly in the two limiting cases of vanishing magnetic field and vanishing temperature. For all other situations, numerical results provide evidence of a finite mutual information at all temperatures except at criticality. There, it diverges as the logarithm of the system size, with a prefactor that can take only two values, depending on whether the critical temperature vanishes or not. Our work provides a simple example in which the mutual information appears as a powerful tool to detect finite-temperature phase transitions, contrary to entanglement measures such as the concurrence.

arXiv:1111.5225•Journal of Statistical Mechanics Theory and Experiment•Jan 30, 2012•86 citations
The total many-body correlations present in finite temperature classical spin systems are studied using the concept of mutual information. As opposed to zero-temperature quantum phase transitions, the total correlations are not maximal at the phase transition, but reach a maximum in the high-temperature paramagnetic phase. The Shannon mutual information and the Renyi mutual information in both Ising and Potts models in two dimensions are calculated numerically by combining matrix product state algorithms and Monte Carlo sampling techniques.
Abstract Rényi mutual information, computed from second Rényi entropies, can identify classical phase transitions from their finite-size scaling at critical points. We apply this technique to examine the presence or absence of finite temperature phase transitions in various two-dimensional models on a square lattice, which are extensions of the conventional Ising model by adding a quenched disorder. When the quenched disorder causes the nearest neighbor bonds to be both ferromagnetic and antiferromagnetic, (a) a spin glass phase exists only at zero temperature, and (b) a ferromagnetic phase exists at a finite temperature when the antiferromagnetic bond distributions are sufficiently dilute. Furthermore, finite temperature paramagnetic-ferromagnetic transitions can also occur when the disordered bonds involve only ferromagnetic couplings of random strengths. In our numerical simulations, the ‘zero temperature only’ phase transitions are identified when there is no consistent finite-size scaling of the Rényi mutual information curves, while for finite temperature critical points, the curves can identify the critical temperature T c by their crossings at T c and 2 T c .
By developing a method to represent the Renyi entropies via a replica trick on classical statistical mechanical systems, we introduce a procedure to calculate the Renyi mutual information (RMI) in any Monte Carlo simulation. Through simulations on several classical models, we demonstrate that the RMI can detect finite-temperature critical points, and even identify their universality class, without knowledge of an order parameter or other thermodynamic estimators. Remarkably, in addition to critical points mediated by symmetry breaking, the RMI is able to detect topological vortex-unbinding transitions, as we explicitly demonstrate on simulations of the XYXYXY model.
We develop a quantum Monte Carlo procedure to compute the Renyi mutual information of an interacting quantum many-body system at nonzero temperature. Performing simulations on a spin-12\frac{1}{2}21​ XXZXXZXXZ model, we observe that for a subregion of fixed size embedded in a system of size LLL, the mutual information converges at large LLL to a limiting function which displays nonmonotonic temperature behavior corresponding to the onset of correlations. For a region of size L/2L/2L/2 embedded in a system of size LLL, the mutual information divided by LLL converges to a limiting function of temperature, with apparently nontrivial corrections near critical points.
We implement a Wang-Landau sampling technique in quantum Monte Carlo (QMC) simulations for the purpose of calculating the Rényi entanglement entropies and associated mutual information. The algorithm converges an estimate for an analog to the density of states for stochastic series expansion QMC, allowing a direct calculation of Rényi entropies without explicit thermodynamic integration. We benchmark results for the mutual information on two-dimensional (2D) isotropic and anisotropic Heisenberg models, a 2D transverse field Ising model, and a three-dimensional Heisenberg model, confirming a critical scaling of the mutual information in cases with a finite-temperature transition. We discuss the benefits and limitations of broad sampling techniques compared to standard importance sampling methods.
We investigate the classical R\'enyi entropy Sn{S}_{n}Sn​ and the associated mutual information In{\mathcal{I}}_{n}In​ in the Sherrington-Kirkpatrick (S-K) model, which is the paradigm model of mean-field spin glasses. Using classical Monte Carlo simulations and analytical tools we investigate the S-K model in the nnn-sheet booklet. This is achieved by gluing together nnn independent copies of the model, and it is the main ingredient for constructing the R\'enyi entanglement-related quantities. We find a glassy phase at low temperatures, whereas at high temperatures the model exhibits paramagnetic behavior, consistent with the regular S-K model. The temperature of the paramagnetic-glassy transition depends nontrivially on the geometry of the booklet. At high temperatures we provide the exact solution of the model by exploiting the replica symmetry. This is the permutation symmetry among the fictitious replicas that are used to perform disorder averages (via the replica trick). In the glassy phase the replica symmetry has to be broken. Using a generalization of the Parisi solution, we provide analytical results for Sn{S}_{n}Sn​ and In{\mathcal{I}}_{n}In​ and for standard thermodynamic quantities. Both Sn{S}_{n}Sn​ and In{\mathcal{I}}_{n}In​ exhibit a volume law in the whole phase diagram. We characterize the behavior of the corresponding densities, Sn/N{S}_{n}/NSn​/N and In/N{\mathcal{I}}_{n}/NIn​/N, in the thermodynamic limit. Interestingly, at the critical point the mutual information does not exhibit any crossing for different system sizes, in contrast with local spin models.
We study the finite-temperature behavior of the Lipkin–Meshkov–Glick model with a focus on correlation properties as measured by the mutual information. The latter, which quantifies the amount of both classical and quantum correlations, is computed exactly in the two limiting cases of vanishing magnetic field and vanishing temperature. For all other situations, numerical results provide evidence of a finite mutual information at all temperatures except at criticality. There, it diverges as the logarithm of the system size, with a prefactor that can take only two values, depending on whether the critical temperature vanishes or not. Our work provides a simple example in which the mutual information appears as a powerful tool to detect finite-temperature phase transitions, contrary to entanglement measures such as the concurrence.