Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1912.09005

Optimal Real-Space Renormalization-Group Transformations with Artificial Neural Networks

Jui-Hui Chung, Ying-Jer Kao

Published Dec 19, 2019• 3 citations
arXivHTMLPDF

Abstract

We introduce a general method for optimizing real-space renormalization-group transformations to study the critical properties of a classical system. The scheme is based on minimizing the Kullback-Leibler divergence between the distribution of the system and the normalized normalizing factor of the transformation parametrized by a restricted Boltzmann machine. We compute the thermal critical exponent of the two-dimensional Ising model using the trained optimal projector and obtain a very accurate thermal critical exponent $y_t=1.0001(11)$ after the first step of the transformation.

DOI
10.48550/arxiv.1912.09005

Related papers

Neural Monte Carlo renormalization group

Jui-Hui Chung, Ying-Jer Kao

The key idea behind the renormalization group (RG) transformation is that properties of physical systems with very different microscopic makeups can be characterized by a few universal parameters.However, finding a systematic way to construct RG transformation for particular systems remains difficult due to the many possible choices of the weight factors in the RG procedure.Here we show, by identifying the conditional distribution in the restricted Boltzmann machine and the weight factor distribution in the RG procedure, that a valid real-space RG transformation can be learned without prior knowledge of the physical system.This neural Monte Carlo RG algorithm allows for direct computation of the RG flow and critical exponents.Our results establish a solid connection between the RG transformation in physics and the deep architecture in machine learning, paving the way for further interdisciplinary research.

arXiv:2010.05703•Physical Review Research•Jun 22, 2021•23 citations

Optimization of Real-Space Renormalization-Group Transformations

Robert H. Swendsen

A general method for optimizing real-space renormalization-group transformations is presented. It is applicable to both spin systems and lattice gauge theories, with use of Monte Carlo computer simulations. It provides substantial improvement in the convergence of critical exponents for the $d=3$ Ising model.

Physical Review Letters•Jun 25, 1984•51 citations

Inverse Monte Carlo Renormalization Group Transformations for Critical Phenomena

Dorit Ron, Robert H. Swendsen, Achi Brandt

We introduce a computationally stable inverse Monte Carlo renormalization group transformation method that provides a number of advantages for the calculation of critical properties. We are able to simulate the fixed point of a renormalization group for arbitrarily large lattices without critical slowing down. The log-log scaling plots obtained with this method show remarkable linearity, leading to accurate estimates for critical exponents. We illustrate this method with calculations in two- and three-dimensional Ising models for a variety of renormalization group transformations.

Physical Review Letters•Dec 18, 2002•36 citations

Adding machine learning within Hamiltonians: Renormalization group transformations, symmetry breaking and restoration

Dimitrios Bachtis, Gert Aarts A, Biagio Lucini A

We present a physical interpretation of machine learning functions, opening up the possibility to control properties of statistical systems via the inclusion of these functions in Hamiltonians.In particular, we include the predictive function of a neural network, designed for phase classification, as a conjugate variable coupled to an external field within the Hamiltonian of a system.Results in the two-dimensional Ising model evidence that the field can induce an order-disorder phase transition by breaking or restoring the symmetry, in contrast with the field of the conventional order parameter which causes explicit symmetry breaking.The critical behavior is then studied by proposing a Hamiltonian-agnostic reweighting approach and forming a renormalization group mapping on quantities derived from the neural network.Accurate estimates of the critical point and of the critical exponents related to the operators that govern the divergence of the correlation length are provided.We conclude by discussing how the method provides an essential step toward bridging machine learning and physics.

arXiv:2010.00054•Physical Review Research•Feb 10, 2021•19 citations

Restricted Boltzmann Machine Flows and The Critical Temperature of Ising models

Rodrigo Veiga, Renato Vicente

We explore alternative experimental setups for the iterative sampling (flow) from Restricted Boltzmann Machines (RBM) mapped on the temperature space of square lattice Ising models by a neural network thermometer. This framework has been introduced to explore connections between RBM-based deep neural networks and the Renormalization Group (RG). It has been found that, under certain conditions, the flow of an RBM trained with Ising spin configurations approaches in the temperature space a value around the critical one: $ k_B T_c / J \approx 2.269$. In this paper we consider datasets with no information about model topology to argue that a neural network thermometer is not an accurate way to detect whether the RBM has learned scale invariance or not.

arXiv:2006.10176•Jun 17, 2020•4 citations

Field Theory Renormalization of the Excluded Volume Problem and Optimal Real Space Renormalization of the Ising Model.

Jeffrey J. Prentis

This dissertation involves the renormalization group theory and its application to two systems exhibiting renormalization symmetry. Both the real space and the field theoretic formulations of the renormalization group theory are discussed. A continuum of real space renormalization transformations is used to study the critical behavior of the two-dimensional Ising model. We find that there exists an optimal transformation that produces sharply more accurate critical properties that the others. We establish a set of conditions that characterize the optimal transformation. These conditions suggest criteria that could enable one to control a given real space renormalization approximation. Field theory renormalization is used to exploit the renormalization symmetry in the excluded volume problem. We develop a self-contained formalism that incorporates the concepts and methods of field theory renormalization directly into the language of the excluded volume problem. This formalism avoids the Lagrangian model isomorphism, thereby providing a simpler and more natural framework for underst and ing the excluded volume problem from first principles. This formalism is used to investigate the spatial correlations in a large self-repelling ring polymer. In particular, we find that the ratio of the radius of gyration of a ring polymer to that of a linear polymer having the same number of monomers is a universal quantity whose value we calculate to first order in (epsilon) (TBOND) 4 - (dimension of space). In addition, we study the mutual excluded volume characterizing a system of two chains with different lengths. The renormalization of the polymer perturbation theory through two-loop order enables us to calculate the universal value of the interpenetration function to second order in (epsilon). Our renormalization group results are in very good agreement with the results obtained from numerical and experimental studies of rings and chains in three dimensional space. We also discuss the connection between real space and field theory renormalization. We outline the basic conceptual ideas that underlie the general theory of renormalization and illustrate how each of these ideas is realized in the real space and the field theoretic formulations.

•Mar 1, 1982•0 citations
We introduce a general method for optimizing real-space renormalization-group transformations to study the critical properties of a classical system. The scheme is based on minimizing the Kullback-Leibler divergence between the distribution of the system and the normalized normalizing factor of the transformation parametrized by a restricted Boltzmann machine. We compute the thermal critical exponent of the two-dimensional Ising model using the trained optimal projector and obtain a very accurate thermal critical exponent yt=1.0001(11)y_t=1.0001(11)yt​=1.0001(11) after the first step of the transformation.
The key idea behind the renormalization group (RG) transformation is that properties of physical systems with very different microscopic makeups can be characterized by a few universal parameters.However, finding a systematic way to construct RG transformation for particular systems remains difficult due to the many possible choices of the weight factors in the RG procedure.Here we show, by identifying the conditional distribution in the restricted Boltzmann machine and the weight factor distribution in the RG procedure, that a valid real-space RG transformation can be learned without prior knowledge of the physical system.This neural Monte Carlo RG algorithm allows for direct computation of the RG flow and critical exponents.Our results establish a solid connection between the RG transformation in physics and the deep architecture in machine learning, paving the way for further interdisciplinary research.
A general method for optimizing real-space renormalization-group transformations is presented. It is applicable to both spin systems and lattice gauge theories, with use of Monte Carlo computer simulations. It provides substantial improvement in the convergence of critical exponents for the d=3d=3d=3 Ising model.
We introduce a computationally stable inverse Monte Carlo renormalization group transformation method that provides a number of advantages for the calculation of critical properties. We are able to simulate the fixed point of a renormalization group for arbitrarily large lattices without critical slowing down. The log-log scaling plots obtained with this method show remarkable linearity, leading to accurate estimates for critical exponents. We illustrate this method with calculations in two- and three-dimensional Ising models for a variety of renormalization group transformations.
We present a physical interpretation of machine learning functions, opening up the possibility to control properties of statistical systems via the inclusion of these functions in Hamiltonians.In particular, we include the predictive function of a neural network, designed for phase classification, as a conjugate variable coupled to an external field within the Hamiltonian of a system.Results in the two-dimensional Ising model evidence that the field can induce an order-disorder phase transition by breaking or restoring the symmetry, in contrast with the field of the conventional order parameter which causes explicit symmetry breaking.The critical behavior is then studied by proposing a Hamiltonian-agnostic reweighting approach and forming a renormalization group mapping on quantities derived from the neural network.Accurate estimates of the critical point and of the critical exponents related to the operators that govern the divergence of the correlation length are provided.We conclude by discussing how the method provides an essential step toward bridging machine learning and physics.
We explore alternative experimental setups for the iterative sampling (flow) from Restricted Boltzmann Machines (RBM) mapped on the temperature space of square lattice Ising models by a neural network thermometer. This framework has been introduced to explore connections between RBM-based deep neural networks and the Renormalization Group (RG). It has been found that, under certain conditions, the flow of an RBM trained with Ising spin configurations approaches in the temperature space a value around the critical one: $ k_B T_c / J \approx 2.269$. In this paper we consider datasets with no information about model topology to argue that a neural network thermometer is not an accurate way to detect whether the RBM has learned scale invariance or not.
This dissertation involves the renormalization group theory and its application to two systems exhibiting renormalization symmetry. Both the real space and the field theoretic formulations of the renormalization group theory are discussed. A continuum of real space renormalization transformations is used to study the critical behavior of the two-dimensional Ising model. We find that there exists an optimal transformation that produces sharply more accurate critical properties that the others. We establish a set of conditions that characterize the optimal transformation. These conditions suggest criteria that could enable one to control a given real space renormalization approximation. Field theory renormalization is used to exploit the renormalization symmetry in the excluded volume problem. We develop a self-contained formalism that incorporates the concepts and methods of field theory renormalization directly into the language of the excluded volume problem. This formalism avoids the Lagrangian model isomorphism, thereby providing a simpler and more natural framework for underst and ing the excluded volume problem from first principles. This formalism is used to investigate the spatial correlations in a large self-repelling ring polymer. In particular, we find that the ratio of the radius of gyration of a ring polymer to that of a linear polymer having the same number of monomers is a universal quantity whose value we calculate to first order in (epsilon) (TBOND) 4 - (dimension of space). In addition, we study the mutual excluded volume characterizing a system of two chains with different lengths. The renormalization of the polymer perturbation theory through two-loop order enables us to calculate the universal value of the interpenetration function to second order in (epsilon). Our renormalization group results are in very good agreement with the results obtained from numerical and experimental studies of rings and chains in three dimensional space. We also discuss the connection between real space and field theory renormalization. We outline the basic conceptual ideas that underlie the general theory of renormalization and illustrate how each of these ideas is realized in the real space and the field theoretic formulations.