We study the statistical physics of the classical Ising model in the so-called α -Rényi ensemble, a finite-temperature thermal state approximation that minimizes a modified free energy based on the α -Rényi entropy. We begin by characterizing its critical behavior in mean-field theory in different regimes of the Rényi index α . Next, we re-introduce correlations and consider the model in one and two dimensions, presenting analytical arguments for the former and devising a Monte Carlo approach to the study of the latter. Remarkably, we find that while mean-field predicts a continuous phase transition below a threshold index value of α ∼ 1.303 and a first-order transition above it, the Monte Carlo results in two dimensions point to a continuous transition at all α . We conclude by performing a variational minimization of the α -Rényi free energy using a recurrent neural network (RNN) where we find that the RNN performs well in two dimensions when compared to the Monte Carlo simulations. Our work highlights the potential opportunities and limitations associated with the use of the α -Rényi ensemble formalism in probing the thermodynamic equilibrium properties of classical and quantum systems.
We study the statistical physics of the classical Ising model in the so-called α -Rényi ensemble, a finite-temperature thermal state approximation that minimizes a modified free energy based on the α -Rényi entropy. We begin by characterizing its critical behavior in mean-field theory in different regimes of the Rényi index α . Next, we re-introduce correlations and consider the model in one and two dimensions, presenting analytical arguments for the former and devising a Monte Carlo approach to the study of the latter. Remarkably, we find that while mean-field predicts a continuous phase transition below a threshold index value of α ∼ 1.303 and a first-order transition above it, the Monte Carlo results in two dimensions point to a continuous transition at all α . We conclude by performing a variational minimization of the α -Rényi free energy using a recurrent neural network (RNN) where we find that the RNN performs well in two dimensions when compared to the Monte Carlo simulations. Our work highlights the potential opportunities and limitations associated with the use of the α -Rényi ensemble formalism in probing the thermodynamic equilibrium properties of classical and quantum systems.
Although entanglement is a well studied property in the context of quantum systems, the ability to measure it in Monte Carlo methods is relatively new. \nThrough measures of the Renyi entanglement entropy and mutual information one is able to examine and characterize criticality, pinpoint phase transitions, and probe universality. \nWe describe the most basic algorithms for calculating these quantities in straightforward Monte Carlo methods and state of the art techniques used in high performance computing. \nThis description emphasizes the core principal of these measurements and allows one to both build an intuition for these quantities and how they are useful in numerical studies. \n \nUsing the Renyi entanglement entropy we demonstrate the ability to detect thermal phase transitions in the Ising model and XY model without use of an order parameter. \nThe scaling near the critical point also shows signatures identifying the universality class of the model. \nImproved methods are explored using extended ensemble techniques that can increase calculation efficiency, and show good agreement with the standard approach. \nWe explore the "ratio trick" at finite temperature and use it to explore the quantum critical fan of the one dimensional transverse field Ising model, showing agreement with finite temperature and finite size scaling from field theory. \nThis same technique is used at zero temperature to explore the geometric dependence of the entanglement entropy and examine the universal scaling functions in the two dimensional transverse field Ising model. \nAll of this shows the multitude of ways in which the study of the Renyi entanglement entropy can be efficiently and practically used in conventional and exotic condensed matter systems, and should serve as a reference for those wishing to use it as a tool.
We combine machine-learning techniques with Monte Carlo (MC) simulations and finite-size scaling (FSS) to study continuous and first-order phase transitions in Ising, Blume-Capel, and Ising-metamagnet spin models. We go beyond earlier studies that had concentrated on obtaining the correlation-length exponent ν. In particular, we show (a) how to combine neural networks (NNs), trained with data from MC simulations of Ising-type spin models on finite lattices, with FSS to obtain both thermal magnetic exponents y_{t}=1/ν and y_{h}, respectively, at both critical and tricritical points, (b) how to obtain the NN counterpart of two-scale-factor universality at an Ising-type critical point, and (c) how to get FSS at a first-order transition. We also obtain the FSS forms for the output of our trained NNs as functions of both the temperature and the magnetic field.
In recent years Machine Learning has proved to be successful in many technological applications and scientific tasks, such as image and speech recognition, natural language
understanding and more. In this work we apply both supervised and unsupervised Machine Learning to three key problems in statistical physics: design of Hamiltonian from data,
phase recognition and study of critical properties of a system undergoing phase transition.
As an example of model design, we use a dataset with spin configurations and corresponding energies randomly sampled from a one dimensional Ising model. We then make two
guesses for the correct Hamiltonian: the former involving interactions of spins with an external local field, the latter involving two body interactions among spins.
The coupling constants are determined with a linear penalized regression, comparing the effects of L1 and L2 penalization terms of the cost function. We pay specific attention
to the problem of overfitting and to the validation process, which is critical for accepting or rejecting the proposed model.
The phase recognition problem is faced with the two dimensional Ising and XY models as examples. After showing the limits of a simple softmax regression for this task,
we build suitable neural networks to overcome these limits. In particular, a feed forward network is built and the learning process is investigated for the Ising model;
while a more sophisticated convolutional network is proposed for the XY model in order to detect local topological structures.
The last part of the work is dedicated to the unsupervised study of phase transitions, and the determination of critical properties (order parameter, critical
temperature, critical exponents). The discussed techniques are Principal Component Analysis (PCA) for dimensional reduction and K-means clustering for organizing data into
subsets with specific properties. PCA is applied to the two dimensional Ising, Potts and XY models, and it is used to find suitable order parameters. The study of the
proposed order parameter as a function of temperature provides evidence of phase transition, and a finite size scaling allows to extrapolate both the critical temperature
in the thermodynamic limit, and the ν critical exponent for the correlation length. K-means clustering is applied to equilibrium configurations of the two dimensional
Ising model, before and after the dimensional reduction, and the critical temperature is estimated. Moreover, a clustering of relaxation curves of magnetization in a
Monte Carlo dynamics is used to build a phase diagram on the parameter space of temperature and magnetic field.
A synergy of C++, Python and Wolfram Mathematica 12.0 is used throughout this work in order to sample input datasets and to build and control customized neural networks
and learning tools. The most relevant codes are provided in the appendix.
We propose the construction of thermodynamic ensembles that minimize the R\'enyi free energy, as an alternative to Gibbs states. For large systems, the local properties of these R\'enyi ensembles coincide with those of thermal equilibrium and they can be used as approximations to thermal states. We provide algorithms to find tensor network approximations to the 2-R\'enyi ensemble. In particular, a matrix-product-state representation can be found by using gradient-based optimization on Riemannian manifolds or via a nonlinear evolution which yields the desired state as a fixed point. We analyze the performance of the algorithms and the properties of the ensembles on one-dimensional spin chains.
Establishing the nature of a quantum phase transition in finite-size simulations—whether continuous, first order, or weakly first order—is a fundamental challenge in quantum many-body computation. The weakly first-order transition is particularly elusive: its anomalously large correlation length invariably mimics a continuous critical point at accessible system sizes, and no unified finite-size scaling theory has existed to distinguish these scenarios under realistic computational constraints. In this work, we address this problem by introducing a finite-size scaling framework based on the Rényi thermal entropy (RTE) and its derivative (DRTE). We derive the finite-size scaling forms for the RTE and DRTE at continuous, first-order, and weakly first-order quantum phase transitions and show that the DRTE isolates the universal contribution of the free energy and strengthens the characteristics of various phase transitions in finite sizes. Using quantum Monte Carlo simulations, we demonstrate accurate data collapse and extraction of critical exponents at ( 2 + 1 )-dimensional O ( N ) critical points. Most importantly, the DRTE provides a definitive signature of weakly first-order transitions at visitable sizes—a zero crossing and a double-peak structure—which we observe in the debated deconfined quantum criticality candidates such as the J − Q and SU(8) J 1 − J 2 models. Our approach offers a general, order-parameter-agnostic, and numerically efficient diagnostic tool, resolving long-standing ambiguities between continuous and weakly first-order scenarios in the finite-size simulations.
Renyi entropy with multiple disjoint intervals are computed from the improved swapping operations by two methods: One is from the direct diagonalization of the Hamiltonian and the other one is from the state-of-the-art machine learning method with neural networks. We use the paradigmatic transverse-field Ising model in one dimension to demonstrate the strategy of the improved swapping operation. In particular, we study the second Renyi entropy with two, three, and four disjoint intervals. We find that the results from the above two methods match each other very well within errors, which indicates that the machine learning method is applicable for calculating the Renyi entropy with multiple disjoint intervals. Moreover, as the magnetic field increases, the Renyi entropy grows as well until the system arrives at the critical point of the phase transition. However, as the magnetic field exceeds the critical value, the Renyi entropy will decrease since the system enters the paramagnetic phase. Overall, these results match the theoretical predictions very well and demonstrate the high accuracy of the machine learning methods with neural networks.