Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2311.09128

Fast Detection of Phase Transitions with Multi-Task Learning-by-Confusion

Julian Arnold, Frank Schäfer, Niels Lörch

Published Nov 15, 2023• 6 citations
arXivHTMLPDF

Abstract

Machine learning has been successfully used to study phase transitions. One of the most popular approaches to identifying critical points from data without prior knowledge of the underlying phases is the learning-by-confusion scheme. As input, it requires system samples drawn from a grid of the parameter whose change is associated with potential phase transitions. Up to now, the scheme required training a distinct binary classifier for each possible splitting of the grid into two sides, resulting in a computational cost that scales linearly with the number of grid points. In this work, we propose and showcase an alternative implementation that only requires the training of a single multi-class classifier. Ideally, such multi-task learning eliminates the scaling with respect to the number of grid points. In applications to the Ising model and an image dataset generated with Stable Diffusion, we find significant speedups that closely correspond to the ideal case, with only minor deviations.

DOI
10.48550/arxiv.2311.09128

Related papers

Detecting Phase Transitions from Data Using Generative Learning

X. K. Zhou, Yan Mi, Pan Zhang

Identifying phase transitions in complex many-body systems traditionally necessitates the definition of specific order parameters, a task often requiring prior knowledge of the statistical model and the symmetry-breaking mechanism. In this work, we propose a framework for detecting phase transitions directly from raw (experimental) data without requiring knowledge of the underlying model Hamiltonian, parameters, or pre-defined labels. Inspired by generative modeling in machine learning, our method utilizes autoregressive networks to estimate the normalized probability distribution of the system from raw configuration data. We then quantify the intrinsic sensitivity of this learned distribution to control parameters (such as temperature) to construct a robust indicator of phase transitions. This indicator is based on the expectation of the change in absolute logarithmic probability, derived entirely from the raw data. Our approach is purely data-driven: it takes raw data across varying control parameters as input and outputs the most likely estimate of the phase transition point. To validate our approach, we conduct extensive numerical experiments on the 2D Ising model on both triangular and square lattices, and on the Sherrington-Kirkpatrick (SK) model utilizing raw data generated via Markov Chain Monte Carlo and Tensor Network methods. The results demonstrate that our generative approach accurately identifies phase transitions using only raw data. Our framework provides a general tool for exploring critical phenomena in model systems, with the potential to be extended to realistic experimental data where theoretical descriptions remain incomplete.

Entropy•Apr 3, 2026•0 citations

Learning by confusion: The phase diagram of the Holstein model

George Issa, Owen Bradley, Ehsan Khatami +1 more

We employ the ``learning by confusion'' technique, an unsupervised machine learning approach for detecting phase transitions, to analyze quantum Monte Carlo simulations of the two-dimensional Holstein model---a fundamental model for electron-phonon interactions on a lattice. Utilizing a convolutional neural network, we conduct a series of binary classification tasks to identify Holstein critical points based on the neural network's learning accuracy. We further evaluate the effectiveness of various training datasets, including snapshots of phonon fields and other measurements resolved in imaginary time, for predicting distinct phase transitions and crossovers. Our results culminate in the construction of the finite-temperature phase diagram of the Holstein model.

arXiv:2501.04681•Physical review. B./Physical review. B•Apr 23, 2025•7 citations

Unveiling phase transitions with machine learning

Askery Canabarro, F. F. Fanchini, André Luiz Malvezzi +2 more

The classification of phase transitions is a central and challenging task in condensed matter physics. Typically, it relies on the identification of order parameters and the analysis of singularities in the free energy and its derivatives. Here, we propose an alternative framework to identify quantum phase transitions, employing both unsupervised and supervised machine learning techniques. Using the axial next-nearest-neighbor Ising (ANNNI) model as a benchmark, we show how unsupervised learning can detect three phases (ferromagnetic, paramagnetic, and a cluster of the antiphase with the floating phase) as well as two distinct regions within the paramagnetic phase. Employing supervised learning we show that transfer learning becomes possible: a machine trained only with nearest-neighbor interactions can learn to identify a new type of phase occurring when next-nearest-neighbor interactions are introduced. All our results rely on few- and low-dimensional input data (up to twelve lattice sites), thus providing a computational friendly and general framework for the study of phase transitions in many-body systems.

arXiv:1904.01486•Physical review. B./Physical review. B•Jul 22, 2019•98 citations

Parameter diagnostics of phases and phase transition learning by neural networks

Philippe Suchsland, Stefan Weßel

We present an analysis of neural network-based machine learning schemes for phases and phase transitions in theoretical condensed matter research, focusing on neural networks with a single hidden layer. Such shallow neural networks were previously found to be efficient in classifying phases and locating phase transitions of various basic model systems. In order to rationalize the emergence of the classification process and for identifying any underlying physical quantities, it is feasible to examine the weight matrices and the convolutional filter kernels that result from the learning process of such shallow networks. Furthermore, we demonstrate how the learning-by-confusing scheme can be used, in combination with a simple threshold-value classification method, to diagnose the learning parameters of neural networks. In particular, we study the classification process of both fully-connected and convolutional neural networks for the two-dimensional Ising model with extended domain wall configurations included in the low-temperature regime. Moreover, we consider the two-dimensional XY model and contrast the performance of the learning-by-confusing scheme and convolutional neural networks trained on bare spin configurations to the case of preprocessed samples with respect to vortex configurations. We discuss these findings in relation to similar recent investigations and possible further applications.

arXiv:1802.09876•Physical review. B./Physical review. B•May 31, 2018•82 citations

Learning by Confusion Locates a Parametrization-Dependent Fisher Information Maximum

George Issa, Richard T. Scalettar

Learning by confusion (LBC) is a machine-learning method for locating phase transitions without assuming a known order parameter. Its characteristic accuracy curve contains a central maximum that is interpreted as the transition point, but what determines the location and finite-size scaling of this maximum has remained unclear. We derive an exact balance condition for the Bayes-optimal confusion peak and show that, for equilibrium systems with a single swept parameter, the peak closely follows the maximum of the corresponding Fisher information. This immediately gives its finite-size scaling and reveals an unexpected dependence on how the data are sampled: the same configurations arranged on grids uniform in $T$, $\ln T$, or $β=1/T$ can yield different finite-size pseudocritical trajectories. Tests on the Ising, Blume-Capel, Potts, and Baxter-Wu models confirm the prediction across continuous, tricritical, and first-order transitions. Our results identify the statistical quantity measured by LBC and show that finite-size machine-learning estimates can depend on the parametrization of the training data as well as on the underlying physics.

arXiv:2610.34769•Oct 26, 2026•0 citations

Learning by confusion approach to identification of discontinuous phase transitions

Monika Richter-Laskowska, Marcin Kurpas, Maciej M. Maśka

Recently, the learning by confusion (LbC) approach has been proposed as a machine learning tool to determine the critical temperature T_{c} of phase transitions without any prior knowledge of its even approximate value. The method has been proven effective, but it has been used only for continuous phase transitions, where the confusion results only from deliberate incorrect labeling of the data. However, in the case of a discontinuous phase transition, additional confusion can result from the coexistence of different phases. To verify whether the confusion scheme can also be used for discontinuous phase transitions, we apply the LbC method to three microscopic models, the Blume-Capel, the q-state Potts, and the Falicov-Kimball models, which undergo continuous or discontinuous phase transitions depending on model parameters. With the help of a simple model, we predict that the phase coexistence present in discontinuous phase transitions can indeed make the neural network more confused and thus decrease its performance. However, numerical calculations performed for the models mentioned above indicate that other aspects of this kind of phase transition are more important and can render the LbC method even less effective. Nevertheless, we demonstrate that in some cases the same aspects allow us to use the LbC method to identify the order of a phase transition.

arXiv:2206.15114•Physical review. E•Aug 7, 2023•17 citations
Machine learning has been successfully used to study phase transitions. One of the most popular approaches to identifying critical points from data without prior knowledge of the underlying phases is the learning-by-confusion scheme. As input, it requires system samples drawn from a grid of the parameter whose change is associated with potential phase transitions. Up to now, the scheme required training a distinct binary classifier for each possible splitting of the grid into two sides, resulting in a computational cost that scales linearly with the number of grid points. In this work, we propose and showcase an alternative implementation that only requires the training of a single multi-class classifier. Ideally, such multi-task learning eliminates the scaling with respect to the number of grid points. In applications to the Ising model and an image dataset generated with Stable Diffusion, we find significant speedups that closely correspond to the ideal case, with only minor deviations.
Identifying phase transitions in complex many-body systems traditionally necessitates the definition of specific order parameters, a task often requiring prior knowledge of the statistical model and the symmetry-breaking mechanism. In this work, we propose a framework for detecting phase transitions directly from raw (experimental) data without requiring knowledge of the underlying model Hamiltonian, parameters, or pre-defined labels. Inspired by generative modeling in machine learning, our method utilizes autoregressive networks to estimate the normalized probability distribution of the system from raw configuration data. We then quantify the intrinsic sensitivity of this learned distribution to control parameters (such as temperature) to construct a robust indicator of phase transitions. This indicator is based on the expectation of the change in absolute logarithmic probability, derived entirely from the raw data. Our approach is purely data-driven: it takes raw data across varying control parameters as input and outputs the most likely estimate of the phase transition point. To validate our approach, we conduct extensive numerical experiments on the 2D Ising model on both triangular and square lattices, and on the Sherrington-Kirkpatrick (SK) model utilizing raw data generated via Markov Chain Monte Carlo and Tensor Network methods. The results demonstrate that our generative approach accurately identifies phase transitions using only raw data. Our framework provides a general tool for exploring critical phenomena in model systems, with the potential to be extended to realistic experimental data where theoretical descriptions remain incomplete.
We employ the ``learning by confusion'' technique, an unsupervised machine learning approach for detecting phase transitions, to analyze quantum Monte Carlo simulations of the two-dimensional Holstein model---a fundamental model for electron-phonon interactions on a lattice. Utilizing a convolutional neural network, we conduct a series of binary classification tasks to identify Holstein critical points based on the neural network's learning accuracy. We further evaluate the effectiveness of various training datasets, including snapshots of phonon fields and other measurements resolved in imaginary time, for predicting distinct phase transitions and crossovers. Our results culminate in the construction of the finite-temperature phase diagram of the Holstein model.
The classification of phase transitions is a central and challenging task in condensed matter physics. Typically, it relies on the identification of order parameters and the analysis of singularities in the free energy and its derivatives. Here, we propose an alternative framework to identify quantum phase transitions, employing both unsupervised and supervised machine learning techniques. Using the axial next-nearest-neighbor Ising (ANNNI) model as a benchmark, we show how unsupervised learning can detect three phases (ferromagnetic, paramagnetic, and a cluster of the antiphase with the floating phase) as well as two distinct regions within the paramagnetic phase. Employing supervised learning we show that transfer learning becomes possible: a machine trained only with nearest-neighbor interactions can learn to identify a new type of phase occurring when next-nearest-neighbor interactions are introduced. All our results rely on few- and low-dimensional input data (up to twelve lattice sites), thus providing a computational friendly and general framework for the study of phase transitions in many-body systems.
We present an analysis of neural network-based machine learning schemes for phases and phase transitions in theoretical condensed matter research, focusing on neural networks with a single hidden layer. Such shallow neural networks were previously found to be efficient in classifying phases and locating phase transitions of various basic model systems. In order to rationalize the emergence of the classification process and for identifying any underlying physical quantities, it is feasible to examine the weight matrices and the convolutional filter kernels that result from the learning process of such shallow networks. Furthermore, we demonstrate how the learning-by-confusing scheme can be used, in combination with a simple threshold-value classification method, to diagnose the learning parameters of neural networks. In particular, we study the classification process of both fully-connected and convolutional neural networks for the two-dimensional Ising model with extended domain wall configurations included in the low-temperature regime. Moreover, we consider the two-dimensional XY model and contrast the performance of the learning-by-confusing scheme and convolutional neural networks trained on bare spin configurations to the case of preprocessed samples with respect to vortex configurations. We discuss these findings in relation to similar recent investigations and possible further applications.
Learning by confusion (LBC) is a machine-learning method for locating phase transitions without assuming a known order parameter. Its characteristic accuracy curve contains a central maximum that is interpreted as the transition point, but what determines the location and finite-size scaling of this maximum has remained unclear. We derive an exact balance condition for the Bayes-optimal confusion peak and show that, for equilibrium systems with a single swept parameter, the peak closely follows the maximum of the corresponding Fisher information. This immediately gives its finite-size scaling and reveals an unexpected dependence on how the data are sampled: the same configurations arranged on grids uniform in TTT, ln⁡T\ln TlnT, or β=1/Tβ=1/Tβ=1/T can yield different finite-size pseudocritical trajectories. Tests on the Ising, Blume-Capel, Potts, and Baxter-Wu models confirm the prediction across continuous, tricritical, and first-order transitions. Our results identify the statistical quantity measured by LBC and show that finite-size machine-learning estimates can depend on the parametrization of the training data as well as on the underlying physics.
Recently, the learning by confusion (LbC) approach has been proposed as a machine learning tool to determine the critical temperature T_{c} of phase transitions without any prior knowledge of its even approximate value. The method has been proven effective, but it has been used only for continuous phase transitions, where the confusion results only from deliberate incorrect labeling of the data. However, in the case of a discontinuous phase transition, additional confusion can result from the coexistence of different phases. To verify whether the confusion scheme can also be used for discontinuous phase transitions, we apply the LbC method to three microscopic models, the Blume-Capel, the q-state Potts, and the Falicov-Kimball models, which undergo continuous or discontinuous phase transitions depending on model parameters. With the help of a simple model, we predict that the phase coexistence present in discontinuous phase transitions can indeed make the neural network more confused and thus decrease its performance. However, numerical calculations performed for the models mentioned above indicate that other aspects of this kind of phase transition are more important and can render the LbC method even less effective. Nevertheless, we demonstrate that in some cases the same aspects allow us to use the LbC method to identify the order of a phase transition.