Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1809.09632 · Physical Review X

Optimal Renormalization Group Transformation from Information Theory

Patrick M. Lenggenhager, Doruk Efe Gökmen, Zohar Ringel, Sebastian D. Huber, Maciej Koch-Janusz

Published Feb 14, 2020• 45 citations
arXivHTMLPDF

Abstract

Recently, a novel real-space renormalization group (RG) algorithm was introduced.By maximizing an information-theoretic quantity, the real-space mutual information, the algorithm identifies the relevant lowenergy degrees of freedom.Motivated by this insight, we investigate the information-theoretic properties of coarse-graining procedures for both translationally invariant and disordered systems.We prove that a perfect real-space mutual information coarse graining does not increase the range of interactions in the renormalized Hamiltonian, and, for disordered systems, it suppresses the generation of correlations in the renormalized disorder distribution, being in this sense optimal.We empirically verify decay of those measures of complexity as a function of information retained by the RG, on the examples of arbitrary coarse grainings of the clean and random Ising chain.The results establish a direct and quantifiable connection between properties of RG viewed as a compression scheme and those of physical objects, i.e., Hamiltonians and disorder distributions.We also study the effect of constraints on the number and type of coarse-grained degrees of freedom on a generic RG procedure.

DOI
10.1103/physrevx.10.011037

Related papers

Informational and algebraic renormalization group

Takato Mori, Teruaki Nagasawa

Renormalization group (RG) is a core concept from statistical mechanics to quantum field theory, yet its schemes differ widely across literature. We formulate Wilsonian RG for generic, including finite-dimensional, quantum systems as a quantum channel combining coarse graining with isometric rescaling, whose Kraus representation yields pure conditional trajectories for pure inputs and recovers mixed-state flows upon averaging. We then develop an algebraic extension without assuming tensor-product factorization: the retained low-energy algebra is constructed from the one-particle spectrum, and coarse graining is a conditional expectation onto it. Identifying the channel's Cesàro mean with a resource-destroying map onto fixed states establishes a resource theory of RG and yields a relative-entropy monotone without variational optimization. For thermal states in the zero-temperature limit, the resulting Bogoliubov--Kubo--Mori metric per unit spacetime volume is proportional to the Zamolodchikov metric, directly relating the resource density to $c-c_{\rm IR}$ near a two-dimensional IR fixed point. We also introduce the relative entropy of coarse graining to measure discarded UV information, prove its monotonicity along successive coarse grainings, and evaluate it holographically in global $\mathrm{AdS}_3$.

hep-thCross-listedarXiv:2609.30362•Sep 28, 2026•1 citation

Symmetries and phase diagrams with real-space mutual information neural estimation

Doruk Efe Gökmen, Zohar Ringel, Sebastian D. Huber +1 more

Real-space mutual information (RSMI) was shown to be an important quantity, formally and from a numerical standpoint, in finding coarse-grained descriptions of physical systems. It very generally quantifies spatial correlations and can give rise to constructive algorithms extracting relevant degrees of freedom. Efficient and reliable estimation or maximization of RSMI is, however, numerically challenging. A recent breakthrough in theoretical machine learning has been the introduction of variational lower bounds for mutual information, parametrized by neural networks. Here we describe in detail how these results can be combined with differentiable coarse-graining operations to develop a single unsupervised neural-network-based algorithm, the RSMI-NE, efficiently extracting the relevant degrees of freedom in the form of the operators of effective field theories, directly from real-space configurations. We study the information contained in the statistical ensemble of constructed coarse-graining transformations and its recovery from partial input data using a secondary machine learning analysis applied to this ensemble. In particular, we show how symmetries, also emergent, can be identified. We demonstrate the extraction of the phase diagram and the order parameters for equilibrium systems and consider also an example of a nonequilibrium problem.

arXiv:2103.16887•Physical review. E•Dec 6, 2021•23 citations

Field Theory Renormalization of the Excluded Volume Problem and Optimal Real Space Renormalization of the Ising Model.

Jeffrey J. Prentis

This dissertation involves the renormalization group theory and its application to two systems exhibiting renormalization symmetry. Both the real space and the field theoretic formulations of the renormalization group theory are discussed. A continuum of real space renormalization transformations is used to study the critical behavior of the two-dimensional Ising model. We find that there exists an optimal transformation that produces sharply more accurate critical properties that the others. We establish a set of conditions that characterize the optimal transformation. These conditions suggest criteria that could enable one to control a given real space renormalization approximation. Field theory renormalization is used to exploit the renormalization symmetry in the excluded volume problem. We develop a self-contained formalism that incorporates the concepts and methods of field theory renormalization directly into the language of the excluded volume problem. This formalism avoids the Lagrangian model isomorphism, thereby providing a simpler and more natural framework for underst and ing the excluded volume problem from first principles. This formalism is used to investigate the spatial correlations in a large self-repelling ring polymer. In particular, we find that the ratio of the radius of gyration of a ring polymer to that of a linear polymer having the same number of monomers is a universal quantity whose value we calculate to first order in (epsilon) (TBOND) 4 - (dimension of space). In addition, we study the mutual excluded volume characterizing a system of two chains with different lengths. The renormalization of the polymer perturbation theory through two-loop order enables us to calculate the universal value of the interpenetration function to second order in (epsilon). Our renormalization group results are in very good agreement with the results obtained from numerical and experimental studies of rings and chains in three dimensional space. We also discuss the connection between real space and field theory renormalization. We outline the basic conceptual ideas that underlie the general theory of renormalization and illustrate how each of these ideas is realized in the real space and the field theoretic formulations.

•Mar 1, 1982•0 citations

Statistical Physics through the Lens of Real-Space Mutual Information

Doruk Efe Gökmen, Zohar Ringel, Sebastian D. Huber +1 more

Identifying the relevant degrees of freedom in a complex physical system is a key stage in developing effective theories in and out of equilibrium. The celebrated renormalization group provides a framework for this, but its practical execution in unfamiliar systems is fraught with ad hoc choices, whereas machine learning approaches, though promising, lack formal interpretability. Here we present an algorithm employing state-of-the-art results in machine-learning-based estimation of information-theoretic quantities, overcoming these challenges, and use this advance to develop a new paradigm in identifying the most relevant operators describing properties of the system. We demonstrate this on an interacting model, where the emergent degrees of freedom are qualitatively different from the microscopic constituents. Our results push the boundary of formally interpretable applications of machine learning, conceptually paving the way toward automated theory building.

arXiv:2101.11633•Physical Review Letters•Dec 6, 2021•28 citations

Real-space renormalization-group scheme for spin and gauge systems

Eduardo Fradkin, Stuart Raby

We present a real-space renormalization-group scheme for both spin and gauge systems within a Hamiltonian formalism. The approximation, in particular, preserves gauge invariance at every step of the calculation. We apply this scheme to the (1 + 1)-dimensional Ising model in a transverse field and to the (2 + 1)-dimensional Ising gauge theory. We find reasonable results for the critical coupling and for those critical exponents which are related to energy gaps. We also obtain the correct qualitative behavior for order and disorder parameters and correlation functions. In particular, the calculation yields exponential decay for correlation functions in the disordered phase. However, the critical indices we find for spacelike quantities are not good. This defect of the approximation is related to the asymmetric scaling of space and time under the renormalization group.

Physical review. D. Particles, fields, gravitation, and cosmology/Physical review. D. Particles and fields•Nov 15, 1979•33 citations

Relevance in the Renormalization Group and in Information Theory

Amit Gordon, Aditya Banerjee, Maciej Koch-Janusz +1 more

The analysis of complex physical systems hinges on the ability to extract the relevant degrees of freedom from among the many others. Though much hope is placed in machine learning, it also brings challenges, chief of which is interpretability. It is often unclear what relation, if any, the architecture- and training-dependent learned "relevant" features bear to standard objects of physical theory. Here we report on theoretical results which may help to systematically address this issue: we establish equivalence between the field-theoretic relevance of the renormalization group, and an information-theoretic notion of relevance we define using the information bottleneck (IB) formalism of compression theory. We show analytically that for statistical physical systems described by a field theory the relevant degrees of freedom found using IB compression indeed correspond to operators with the lowest scaling dimensions. We confirm our field theoretic predictions numerically. We study dependence of the IB solutions on the physical symmetries of the data. Our findings provide a dictionary connecting two distinct theoretical toolboxes, and an example of constructively incorporating physical interpretability in applications of deep learning in physics.

arXiv:2012.01447•Physical Review Letters•Jun 17, 2021•27 citations
Recently, a novel real-space renormalization group (RG) algorithm was introduced.By maximizing an information-theoretic quantity, the real-space mutual information, the algorithm identifies the relevant lowenergy degrees of freedom.Motivated by this insight, we investigate the information-theoretic properties of coarse-graining procedures for both translationally invariant and disordered systems.We prove that a perfect real-space mutual information coarse graining does not increase the range of interactions in the renormalized Hamiltonian, and, for disordered systems, it suppresses the generation of correlations in the renormalized disorder distribution, being in this sense optimal.We empirically verify decay of those measures of complexity as a function of information retained by the RG, on the examples of arbitrary coarse grainings of the clean and random Ising chain.The results establish a direct and quantifiable connection between properties of RG viewed as a compression scheme and those of physical objects, i.e., Hamiltonians and disorder distributions.We also study the effect of constraints on the number and type of coarse-grained degrees of freedom on a generic RG procedure.
Renormalization group (RG) is a core concept from statistical mechanics to quantum field theory, yet its schemes differ widely across literature. We formulate Wilsonian RG for generic, including finite-dimensional, quantum systems as a quantum channel combining coarse graining with isometric rescaling, whose Kraus representation yields pure conditional trajectories for pure inputs and recovers mixed-state flows upon averaging. We then develop an algebraic extension without assuming tensor-product factorization: the retained low-energy algebra is constructed from the one-particle spectrum, and coarse graining is a conditional expectation onto it. Identifying the channel's Cesàro mean with a resource-destroying map onto fixed states establishes a resource theory of RG and yields a relative-entropy monotone without variational optimization. For thermal states in the zero-temperature limit, the resulting Bogoliubov--Kubo--Mori metric per unit spacetime volume is proportional to the Zamolodchikov metric, directly relating the resource density to c−cIRc-c_{\rm IR}c−cIR​ near a two-dimensional IR fixed point. We also introduce the relative entropy of coarse graining to measure discarded UV information, prove its monotonicity along successive coarse grainings, and evaluate it holographically in global AdS3\mathrm{AdS}_3AdS3​.
Real-space mutual information (RSMI) was shown to be an important quantity, formally and from a numerical standpoint, in finding coarse-grained descriptions of physical systems. It very generally quantifies spatial correlations and can give rise to constructive algorithms extracting relevant degrees of freedom. Efficient and reliable estimation or maximization of RSMI is, however, numerically challenging. A recent breakthrough in theoretical machine learning has been the introduction of variational lower bounds for mutual information, parametrized by neural networks. Here we describe in detail how these results can be combined with differentiable coarse-graining operations to develop a single unsupervised neural-network-based algorithm, the RSMI-NE, efficiently extracting the relevant degrees of freedom in the form of the operators of effective field theories, directly from real-space configurations. We study the information contained in the statistical ensemble of constructed coarse-graining transformations and its recovery from partial input data using a secondary machine learning analysis applied to this ensemble. In particular, we show how symmetries, also emergent, can be identified. We demonstrate the extraction of the phase diagram and the order parameters for equilibrium systems and consider also an example of a nonequilibrium problem.
This dissertation involves the renormalization group theory and its application to two systems exhibiting renormalization symmetry. Both the real space and the field theoretic formulations of the renormalization group theory are discussed. A continuum of real space renormalization transformations is used to study the critical behavior of the two-dimensional Ising model. We find that there exists an optimal transformation that produces sharply more accurate critical properties that the others. We establish a set of conditions that characterize the optimal transformation. These conditions suggest criteria that could enable one to control a given real space renormalization approximation. Field theory renormalization is used to exploit the renormalization symmetry in the excluded volume problem. We develop a self-contained formalism that incorporates the concepts and methods of field theory renormalization directly into the language of the excluded volume problem. This formalism avoids the Lagrangian model isomorphism, thereby providing a simpler and more natural framework for underst and ing the excluded volume problem from first principles. This formalism is used to investigate the spatial correlations in a large self-repelling ring polymer. In particular, we find that the ratio of the radius of gyration of a ring polymer to that of a linear polymer having the same number of monomers is a universal quantity whose value we calculate to first order in (epsilon) (TBOND) 4 - (dimension of space). In addition, we study the mutual excluded volume characterizing a system of two chains with different lengths. The renormalization of the polymer perturbation theory through two-loop order enables us to calculate the universal value of the interpenetration function to second order in (epsilon). Our renormalization group results are in very good agreement with the results obtained from numerical and experimental studies of rings and chains in three dimensional space. We also discuss the connection between real space and field theory renormalization. We outline the basic conceptual ideas that underlie the general theory of renormalization and illustrate how each of these ideas is realized in the real space and the field theoretic formulations.
Identifying the relevant degrees of freedom in a complex physical system is a key stage in developing effective theories in and out of equilibrium. The celebrated renormalization group provides a framework for this, but its practical execution in unfamiliar systems is fraught with ad hoc choices, whereas machine learning approaches, though promising, lack formal interpretability. Here we present an algorithm employing state-of-the-art results in machine-learning-based estimation of information-theoretic quantities, overcoming these challenges, and use this advance to develop a new paradigm in identifying the most relevant operators describing properties of the system. We demonstrate this on an interacting model, where the emergent degrees of freedom are qualitatively different from the microscopic constituents. Our results push the boundary of formally interpretable applications of machine learning, conceptually paving the way toward automated theory building.
We present a real-space renormalization-group scheme for both spin and gauge systems within a Hamiltonian formalism. The approximation, in particular, preserves gauge invariance at every step of the calculation. We apply this scheme to the (1 + 1)-dimensional Ising model in a transverse field and to the (2 + 1)-dimensional Ising gauge theory. We find reasonable results for the critical coupling and for those critical exponents which are related to energy gaps. We also obtain the correct qualitative behavior for order and disorder parameters and correlation functions. In particular, the calculation yields exponential decay for correlation functions in the disordered phase. However, the critical indices we find for spacelike quantities are not good. This defect of the approximation is related to the asymmetric scaling of space and time under the renormalization group.
The analysis of complex physical systems hinges on the ability to extract the relevant degrees of freedom from among the many others. Though much hope is placed in machine learning, it also brings challenges, chief of which is interpretability. It is often unclear what relation, if any, the architecture- and training-dependent learned "relevant" features bear to standard objects of physical theory. Here we report on theoretical results which may help to systematically address this issue: we establish equivalence between the field-theoretic relevance of the renormalization group, and an information-theoretic notion of relevance we define using the information bottleneck (IB) formalism of compression theory. We show analytically that for statistical physical systems described by a field theory the relevant degrees of freedom found using IB compression indeed correspond to operators with the lowest scaling dimensions. We confirm our field theoretic predictions numerically. We study dependence of the IB solutions on the physical symmetries of the data. Our findings provide a dictionary connecting two distinct theoretical toolboxes, and an example of constructively incorporating physical interpretability in applications of deep learning in physics.