Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2101.11633 · Physical Review Letters

Statistical Physics through the Lens of Real-Space Mutual Information

Doruk Efe Gökmen, Zohar Ringel, Sebastian D. Huber, Maciej Koch-Janusz

Published Dec 6, 2021• 28 citations
arXivHTMLPDF

Abstract

Identifying the relevant degrees of freedom in a complex physical system is a key stage in developing effective theories in and out of equilibrium. The celebrated renormalization group provides a framework for this, but its practical execution in unfamiliar systems is fraught with ad hoc choices, whereas machine learning approaches, though promising, lack formal interpretability. Here we present an algorithm employing state-of-the-art results in machine-learning-based estimation of information-theoretic quantities, overcoming these challenges, and use this advance to develop a new paradigm in identifying the most relevant operators describing properties of the system. We demonstrate this on an interacting model, where the emergent degrees of freedom are qualitatively different from the microscopic constituents. Our results push the boundary of formally interpretable applications of machine learning, conceptually paving the way toward automated theory building.

DOI
10.1103/physrevlett.127.240603

Related papers

Symmetries and phase diagrams with real-space mutual information neural estimation

Doruk Efe Gökmen, Zohar Ringel, Sebastian D. Huber +1 more

Real-space mutual information (RSMI) was shown to be an important quantity, formally and from a numerical standpoint, in finding coarse-grained descriptions of physical systems. It very generally quantifies spatial correlations and can give rise to constructive algorithms extracting relevant degrees of freedom. Efficient and reliable estimation or maximization of RSMI is, however, numerically challenging. A recent breakthrough in theoretical machine learning has been the introduction of variational lower bounds for mutual information, parametrized by neural networks. Here we describe in detail how these results can be combined with differentiable coarse-graining operations to develop a single unsupervised neural-network-based algorithm, the RSMI-NE, efficiently extracting the relevant degrees of freedom in the form of the operators of effective field theories, directly from real-space configurations. We study the information contained in the statistical ensemble of constructed coarse-graining transformations and its recovery from partial input data using a secondary machine learning analysis applied to this ensemble. In particular, we show how symmetries, also emergent, can be identified. We demonstrate the extraction of the phase diagram and the order parameters for equilibrium systems and consider also an example of a nonequilibrium problem.

arXiv:2103.16887•Physical review. E•Dec 6, 2021•23 citations

Relevance in the Renormalization Group and in Information Theory

Amit Gordon, Aditya Banerjee, Maciej Koch-Janusz +1 more

The analysis of complex physical systems hinges on the ability to extract the relevant degrees of freedom from among the many others. Though much hope is placed in machine learning, it also brings challenges, chief of which is interpretability. It is often unclear what relation, if any, the architecture- and training-dependent learned "relevant" features bear to standard objects of physical theory. Here we report on theoretical results which may help to systematically address this issue: we establish equivalence between the field-theoretic relevance of the renormalization group, and an information-theoretic notion of relevance we define using the information bottleneck (IB) formalism of compression theory. We show analytically that for statistical physical systems described by a field theory the relevant degrees of freedom found using IB compression indeed correspond to operators with the lowest scaling dimensions. We confirm our field theoretic predictions numerically. We study dependence of the IB solutions on the physical symmetries of the data. Our findings provide a dictionary connecting two distinct theoretical toolboxes, and an example of constructively incorporating physical interpretability in applications of deep learning in physics.

arXiv:2012.01447•Physical Review Letters•Jun 17, 2021•27 citations

Holographic Renormalization with Machine learning

Eric M. Howard

At low energies, the microscopic characteristics and changes of physical systems as viewed at different distance scales are described by universal scale invariant properties investigated by the Renormalization Group (RG) apparatus, an efficient tool used to deal with scaling problems in effective field theories. We employ an information-theoretic approach in a deep learning setup by introducing an artificial neural network algorithm to map and identify new physical degrees of freedom. Using deep learning methods mapped to a genuine field theory, we develop a mechanism capable to identify relevant degrees of freedom and induce scale invariance without prior knowledge about a system. We show that deep learning algorithms that use an RG-like scheme to learn relevant features from data could help to understand the nature of the holographic entanglement entropy and the holographic principle in context of the AdS/CFT correspondence.

arXiv:1803.11056•Mar 23, 2018•4 citations

Inferring interpretable dynamical generators of local quantum observables from projective measurements through machine learning

Giovanni Cemin, Francesco Carnazza, Sabine Andergassen +3 more

Reconstructing the effective equation of motion for the time evolution of a subset of degrees of freedom of a larger system remains a problem of interest in quantum physics. Many methods have been developed, but they either rely on an ad hoc ansatz, demand data that is not experimentally accessible, or lack physical interpretability. The authors employ machine-learning methods to infer the effective dynamical generator from a noisy, finite set of local measurements. Their method yields interpretable results that may be used to infer noise models on quantum simulators, or to study thermalization dynamics in quantum many-body systems.

arXiv:2306.03935•Physical Review Applied•Apr 3, 2024•12 citations

Data-driven discovery of statistically relevant information in quantum simulators

Roberto Verdel, Vittorio Vitale, Rajat Kumar Panda +7 more

Quantum simulators offer powerful means to investigate strongly correlated quantum matter. However, interpreting measurement outcomes in such systems poses significant challenges. Here, we present a theoretical framework for information extraction in synthetic quantum matter, illustrated for the case of a quantum quench in a spinor Bose-Einstein condensate experiment. Employing nonparametric unsupervised learning tools that provide different measures of information content, we demonstrate a theory-agnostic approach to identify dominant degrees of freedom. This enables us to rank operators according to their relevance, akin to effective field theory. To characterize the corresponding effective description, we then explore the intrinsic dimension of data sets as a measure of the complexity of the dynamics. This reveals a simplification of the data structure, which correlates with the emergence of time-dependent universal behavior in the studied system. Our assumption-free approach can be immediately applied in a variety of experimental platforms.

arXiv:2307.10040•Physical review. B./Physical review. B•Feb 23, 2024•17 citations

Characterization and Control of Quantum Systems using Machine Learning and Information Theory

Akram Youssry

The tasks of characterization and control of quantum systems are becoming more challenging with the advancement of quantum technology. Standard methods that were successful for simple quantum systems are becoming inadequate for more complex engineered systems. Modelling assumptions and approximations (such as Markovianity) are not justifiable anymore. As a result, the usual models fail to fit experimental measurements. In this thesis, we use state-of-the-art machine learning methods, assisted by tools from information theory as needed, to develop new frameworks that try to address these challenges. We focus on three directions. The first is developing an efficient online quantum state estimation algorithm with provable convergence properties. The second is developing a deep learning framework for characterizing and controlling closed quantum systems. The final direction is upgrading that framework to be suitable for characterization and control of open quantum systems. This thesis opens the door for a novel way of utilizing machine learning techniques for applications in quantum information specially and physics in general.

•Jan 1, 2020•1 citation
Identifying the relevant degrees of freedom in a complex physical system is a key stage in developing effective theories in and out of equilibrium. The celebrated renormalization group provides a framework for this, but its practical execution in unfamiliar systems is fraught with ad hoc choices, whereas machine learning approaches, though promising, lack formal interpretability. Here we present an algorithm employing state-of-the-art results in machine-learning-based estimation of information-theoretic quantities, overcoming these challenges, and use this advance to develop a new paradigm in identifying the most relevant operators describing properties of the system. We demonstrate this on an interacting model, where the emergent degrees of freedom are qualitatively different from the microscopic constituents. Our results push the boundary of formally interpretable applications of machine learning, conceptually paving the way toward automated theory building.
Real-space mutual information (RSMI) was shown to be an important quantity, formally and from a numerical standpoint, in finding coarse-grained descriptions of physical systems. It very generally quantifies spatial correlations and can give rise to constructive algorithms extracting relevant degrees of freedom. Efficient and reliable estimation or maximization of RSMI is, however, numerically challenging. A recent breakthrough in theoretical machine learning has been the introduction of variational lower bounds for mutual information, parametrized by neural networks. Here we describe in detail how these results can be combined with differentiable coarse-graining operations to develop a single unsupervised neural-network-based algorithm, the RSMI-NE, efficiently extracting the relevant degrees of freedom in the form of the operators of effective field theories, directly from real-space configurations. We study the information contained in the statistical ensemble of constructed coarse-graining transformations and its recovery from partial input data using a secondary machine learning analysis applied to this ensemble. In particular, we show how symmetries, also emergent, can be identified. We demonstrate the extraction of the phase diagram and the order parameters for equilibrium systems and consider also an example of a nonequilibrium problem.
The analysis of complex physical systems hinges on the ability to extract the relevant degrees of freedom from among the many others. Though much hope is placed in machine learning, it also brings challenges, chief of which is interpretability. It is often unclear what relation, if any, the architecture- and training-dependent learned "relevant" features bear to standard objects of physical theory. Here we report on theoretical results which may help to systematically address this issue: we establish equivalence between the field-theoretic relevance of the renormalization group, and an information-theoretic notion of relevance we define using the information bottleneck (IB) formalism of compression theory. We show analytically that for statistical physical systems described by a field theory the relevant degrees of freedom found using IB compression indeed correspond to operators with the lowest scaling dimensions. We confirm our field theoretic predictions numerically. We study dependence of the IB solutions on the physical symmetries of the data. Our findings provide a dictionary connecting two distinct theoretical toolboxes, and an example of constructively incorporating physical interpretability in applications of deep learning in physics.
At low energies, the microscopic characteristics and changes of physical systems as viewed at different distance scales are described by universal scale invariant properties investigated by the Renormalization Group (RG) apparatus, an efficient tool used to deal with scaling problems in effective field theories. We employ an information-theoretic approach in a deep learning setup by introducing an artificial neural network algorithm to map and identify new physical degrees of freedom. Using deep learning methods mapped to a genuine field theory, we develop a mechanism capable to identify relevant degrees of freedom and induce scale invariance without prior knowledge about a system. We show that deep learning algorithms that use an RG-like scheme to learn relevant features from data could help to understand the nature of the holographic entanglement entropy and the holographic principle in context of the AdS/CFT correspondence.
Reconstructing the effective equation of motion for the time evolution of a subset of degrees of freedom of a larger system remains a problem of interest in quantum physics. Many methods have been developed, but they either rely on an ad hoc ansatz, demand data that is not experimentally accessible, or lack physical interpretability. The authors employ machine-learning methods to infer the effective dynamical generator from a noisy, finite set of local measurements. Their method yields interpretable results that may be used to infer noise models on quantum simulators, or to study thermalization dynamics in quantum many-body systems.
Quantum simulators offer powerful means to investigate strongly correlated quantum matter. However, interpreting measurement outcomes in such systems poses significant challenges. Here, we present a theoretical framework for information extraction in synthetic quantum matter, illustrated for the case of a quantum quench in a spinor Bose-Einstein condensate experiment. Employing nonparametric unsupervised learning tools that provide different measures of information content, we demonstrate a theory-agnostic approach to identify dominant degrees of freedom. This enables us to rank operators according to their relevance, akin to effective field theory. To characterize the corresponding effective description, we then explore the intrinsic dimension of data sets as a measure of the complexity of the dynamics. This reveals a simplification of the data structure, which correlates with the emergence of time-dependent universal behavior in the studied system. Our assumption-free approach can be immediately applied in a variety of experimental platforms.
The tasks of characterization and control of quantum systems are becoming more challenging with the advancement of quantum technology. Standard methods that were successful for simple quantum systems are becoming inadequate for more complex engineered systems. Modelling assumptions and approximations (such as Markovianity) are not justifiable anymore. As a result, the usual models fail to fit experimental measurements. In this thesis, we use state-of-the-art machine learning methods, assisted by tools from information theory as needed, to develop new frameworks that try to address these challenges. We focus on three directions. The first is developing an efficient online quantum state estimation algorithm with provable convergence properties. The second is developing a deep learning framework for characterizing and controlling closed quantum systems. The final direction is upgrading that framework to be suitable for characterization and control of open quantum systems. This thesis opens the door for a novel way of utilizing machine learning techniques for applications in quantum information specially and physics in general.