Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2609.16506

Unsupervised Machine Learning of the Contact Process

L. T. Brito, Gladstone Alencar Alves, F. W. S. Lima, A. Macedo-Filho, Ronan Silva Ferreira, T. F. A. Alves

Published Sep 15, 2026• 0 citations
arXivHTMLPDF

Abstract

We investigate how unsupervised machine-learning methods can characterize the active-absorbing phase transition in the contact process in one and two spatial dimensions. Our analysis focuses on principal component analysis (PCA) and variational autoencoders (VAEs), and we show that direct applications of these methods encounter a central difficulty: contact process configurations are intrinsically positive-definite. In the PCA case, standard centering procedures fail to isolate the order parameter in the leading component. To address this, we augment the data with sign-reversed configurations, creating a balanced dataset with zero mean while preserving the density information required to describe the transition. This preprocessing allows the dominant principal component to recover the order parameter and reproduce the expected finite-size scaling near criticality. For VAEs, we find a related limitation: a fixed Gaussian prior does not provide sufficient latent regularization across the full range of control parameters and system sizes for positive-definite data. We overcome this by adopting a heteroscedastic Gaussian prior that adapts to the control parameter, leading to a substantial improvement in the finite-size scaling of reconstruction-based observables near the critical threshold. Taken together, these results highlight a key lesson: the success of machine learning in phase-transition problems does not rely on algorithmic complexity alone, but on tailoring the representation to respect the physical structure of the system, including its intrinsic constraints and symmetries.

DOI
10.48550/arxiv.2609.16506

Related papers

Prometheus: Unsupervised Discovery of Phase Transitions and Order Parameters in the Two-Dimensional Ising Model Using Variational Autoencoders

Brandon Yee, Wilson Collins, Caden Wang +1 more

Abstract We present an unsupervised machine learning framework for discovering phase transitions and order parameters in the two-dimensional Ising model without prior knowledge of the underlying physics. Using convolutional beta-variational autoencoders (β-VAE), we learn compressed representations that naturally separate ordered and disordered phases. Our physics-informed training procedures incorporate data augmentation respecting Ising symmetries, cosine annealing optimization, and progressive temperature curriculum learning. Experimental validation on Monte Carlo simulated configurations demonstrates automatic order parameter discovery with correlation ρ = 0.85 ± 0.04 to theoretical magnetization (95% CI [0.82, 0.88]) and critical temperature detection within 0.27% of the Onsager solution (p < 0.001). The method achieves 89% improvement over principal component analysis and 124% improvement over t-distributed stochastic neighbor embedding. Latent representations exhibit clear phase separation with physics consistency score S = 0.88 ± 0.03. Ablation studies reveal optimal performance at β = 1.0, balancing reconstruction fidelity with disentanglement. This framework enables automated identification of emergent phenomena in complex many-body systems, advancing machine learning applications in condensed matter physics.

•Oct 31, 2025•0 citations

Can machine learning truly decode phase transitions? A deep dive into the Ising model with competing interactions

Maninder Kaur, Ying Wai Li, Dilina Perera +1 more

We investigate phase transitions in the two-dimensional Ising model with competing nearest-neighbor (NN) and next-nearest-neighbor (NNN) interactions, where the NNN coupling generates a degenerate superantiferromagnetic (SAF) ground state, by combining machine-learning methods with Monte Carlo simulations and finite-size scaling (FSS). Going beyond earlier studies, we show that unsupervised learning can recover order-parameter and Binder cumulant analogs that obey FSS. Principal component analysis (PCA) reveals the two-component structure of the SAF order parameter, and k-means clustering is used to visualize qualitative differences between ordered and disordered configurations in the principal-component space. A fully connected neural network (FCNN), trained without prior knowledge of the order parameter or the critical temperature, learns the strength of SAF stripe ordering and uses it as the internal feature for phase classification. FSS of thermodynamic observables, the PCA-derived quantity, and the FCNN output yields consistent estimates of the critical temperature and correlation-length exponent. These results demonstrate that machine learning can decode ordering patterns, extract meaningful order-parameter analogs, and reproduce critical behavior in frustrated Ising systems.

Physical review. E•May 19, 2026•1 citation

Discovering phases, phase transitions, and crossovers through unsupervised machine learning: A critical examination

Wenjian Hu, Rajiv R. P. Singh, Richard T. Scalettar

We apply unsupervised machine learning techniques, mainly principal component analysis (PCA), to compare and contrast the phase behavior and phase transitions in several classical spin models-the square- and triangular-lattice Ising models, the Blume-Capel model, a highly degenerate biquadratic-exchange spin-1 Ising (BSI) model, and the two-dimensional XY model-and we examine critically what machine learning is teaching us. We find that quantified principal components from PCA not only allow the exploration of different phases and symmetry-breaking, but they can distinguish phase-transition types and locate critical points. We show that the corresponding weight vectors have a clear physical interpretation, which is particularly interesting in the frustrated models such as the triangular antiferromagnet, where they can point to incipient orders. Unlike the other well-studied models, the properties of the BSI model are less well known. Using both PCA and conventional Monte Carlo analysis, we demonstrate that the BSI model shows an absence of phase transition and macroscopic ground-state degeneracy. The failure to capture the "charge" correlations (vorticity) in the BSI model (XY model) from raw spin configurations points to some of the limitations of PCA. Finally, we employ a nonlinear unsupervised machine learning procedure, the "autoencoder method," and we demonstrate that it too can be trained to capture phase transitions and critical points.

arXiv:1704.00080•Physical review. E•Jun 19, 2017•356 citations

Unsupervised Learning Universal Critical Behavior via the Intrinsic Dimension

T. Mendes-Santos, Xhek Turkeshi, M. Dalmonte +1 more

The identification of universal properties from minimally processed data sets is one goal of machine learning techniques applied to statistical physics.Here, we study how the minimum number of variables needed to accurately describe the important features of a data set-the intrinsic dimension (I d )-behaves in the vicinity of phase transitions.We employ state-of-the-art nearest-neighbors-based I d estimators to compute the I d of raw Monte Carlo thermal configurations across different phase transitions: first-order, second-order, and Berezinskii-Kosterlitz-Thouless.For all the considered cases, we find that the I d uniquely characterizes the transition regime.The finite-size analysis of the I d allows us to not only identify critical points with an accuracy comparable to methods that rely on a priori identification of order parameters but also to determine the corresponding (critical) exponent ν in the case of continuous transitions.For the case of topological transitions, this analysis overcomes the reported limitations affecting other unsupervised learning methods.Our work reveals how raw data sets display unique signatures of universal behavior in the absence of any dimensional reduction scheme and suggest direct parallelism between conventional order parameters in real space and the intrinsic dimension in the data space.

arXiv:2006.12953•Physical Review X•Feb 26, 2021•64 citations

Machine Learning techniques applied to the statistical properties of spin systems

Matteo Ferraretto

In recent years Machine Learning has proved to be successful in many technological applications and scientific tasks, such as image and speech recognition, natural language understanding and more. In this work we apply both supervised and unsupervised Machine Learning to three key problems in statistical physics: design of Hamiltonian from data, phase recognition and study of critical properties of a system undergoing phase transition. As an example of model design, we use a dataset with spin configurations and corresponding energies randomly sampled from a one dimensional Ising model. We then make two guesses for the correct Hamiltonian: the former involving interactions of spins with an external local field, the latter involving two body interactions among spins. The coupling constants are determined with a linear penalized regression, comparing the effects of L1 and L2 penalization terms of the cost function. We pay specific attention to the problem of overfitting and to the validation process, which is critical for accepting or rejecting the proposed model. The phase recognition problem is faced with the two dimensional Ising and XY models as examples. After showing the limits of a simple softmax regression for this task, we build suitable neural networks to overcome these limits. In particular, a feed forward network is built and the learning process is investigated for the Ising model; while a more sophisticated convolutional network is proposed for the XY model in order to detect local topological structures. The last part of the work is dedicated to the unsupervised study of phase transitions, and the determination of critical properties (order parameter, critical temperature, critical exponents). The discussed techniques are Principal Component Analysis (PCA) for dimensional reduction and K-means clustering for organizing data into subsets with specific properties. PCA is applied to the two dimensional Ising, Potts and XY models, and it is used to find suitable order parameters. The study of the proposed order parameter as a function of temperature provides evidence of phase transition, and a finite size scaling allows to extrapolate both the critical temperature in the thermodynamic limit, and the $\nu$ critical exponent for the correlation length. K-means clustering is applied to equilibrium configurations of the two dimensional Ising model, before and after the dimensional reduction, and the critical temperature is estimated. Moreover, a clustering of relaxation curves of magnetization in a Monte Carlo dynamics is used to build a phase diagram on the parameter space of temperature and magnetic field. A synergy of C++, Python and Wolfram Mathematica 12.0 is used throughout this work in order to sample input datasets and to build and control customized neural networks and learning tools. The most relevant codes are provided in the appendix.

•Oct 14, 2019•0 citations

Unsupervised machine learning phase classification for the Falicov-Kimball model

Lukáš Frk, Pavel Baláž, Elguja Archemashvili +1 more

We apply various unsupervised machine learning methods for phase classification to investigate the finite-temperature phase diagram of the spinless Falicov-Kimball model in two dimensions. Using only particle occupation snapshots from Monte Carlo simulations as input, each technique, including a straightforward classification based on principal component analysis (PCA), successfully identifies the phase boundary between ordered and disordered phases, independent of the type of phase transition. Remarkably, these techniques also distinguish between the weakly localized and Anderson-localized regimes within the disordered phase, accurately identifying their crossover, which is a challenging task for standard methods. Among the machine learning approaches used, PCA based analysis outperforms more complex methods, such as neural network predictors and autoencoders. These results underscore the effectiveness of simple unsupervised techniques in examining phase transitions and electron localization in complex correlated systems.

arXiv:2411.07319•Physical review. B./Physical review. B•May 13, 2025•3 citations
We investigate how unsupervised machine-learning methods can characterize the active-absorbing phase transition in the contact process in one and two spatial dimensions. Our analysis focuses on principal component analysis (PCA) and variational autoencoders (VAEs), and we show that direct applications of these methods encounter a central difficulty: contact process configurations are intrinsically positive-definite. In the PCA case, standard centering procedures fail to isolate the order parameter in the leading component. To address this, we augment the data with sign-reversed configurations, creating a balanced dataset with zero mean while preserving the density information required to describe the transition. This preprocessing allows the dominant principal component to recover the order parameter and reproduce the expected finite-size scaling near criticality. For VAEs, we find a related limitation: a fixed Gaussian prior does not provide sufficient latent regularization across the full range of control parameters and system sizes for positive-definite data. We overcome this by adopting a heteroscedastic Gaussian prior that adapts to the control parameter, leading to a substantial improvement in the finite-size scaling of reconstruction-based observables near the critical threshold. Taken together, these results highlight a key lesson: the success of machine learning in phase-transition problems does not rely on algorithmic complexity alone, but on tailoring the representation to respect the physical structure of the system, including its intrinsic constraints and symmetries.
Abstract We present an unsupervised machine learning framework for discovering phase transitions and order parameters in the two-dimensional Ising model without prior knowledge of the underlying physics. Using convolutional beta-variational autoencoders (β-VAE), we learn compressed representations that naturally separate ordered and disordered phases. Our physics-informed training procedures incorporate data augmentation respecting Ising symmetries, cosine annealing optimization, and progressive temperature curriculum learning. Experimental validation on Monte Carlo simulated configurations demonstrates automatic order parameter discovery with correlation ρ = 0.85 ± 0.04 to theoretical magnetization (95% CI [0.82, 0.88]) and critical temperature detection within 0.27% of the Onsager solution (p < 0.001). The method achieves 89% improvement over principal component analysis and 124% improvement over t-distributed stochastic neighbor embedding. Latent representations exhibit clear phase separation with physics consistency score S = 0.88 ± 0.03. Ablation studies reveal optimal performance at β = 1.0, balancing reconstruction fidelity with disentanglement. This framework enables automated identification of emergent phenomena in complex many-body systems, advancing machine learning applications in condensed matter physics.
We investigate phase transitions in the two-dimensional Ising model with competing nearest-neighbor (NN) and next-nearest-neighbor (NNN) interactions, where the NNN coupling generates a degenerate superantiferromagnetic (SAF) ground state, by combining machine-learning methods with Monte Carlo simulations and finite-size scaling (FSS). Going beyond earlier studies, we show that unsupervised learning can recover order-parameter and Binder cumulant analogs that obey FSS. Principal component analysis (PCA) reveals the two-component structure of the SAF order parameter, and k-means clustering is used to visualize qualitative differences between ordered and disordered configurations in the principal-component space. A fully connected neural network (FCNN), trained without prior knowledge of the order parameter or the critical temperature, learns the strength of SAF stripe ordering and uses it as the internal feature for phase classification. FSS of thermodynamic observables, the PCA-derived quantity, and the FCNN output yields consistent estimates of the critical temperature and correlation-length exponent. These results demonstrate that machine learning can decode ordering patterns, extract meaningful order-parameter analogs, and reproduce critical behavior in frustrated Ising systems.
We apply unsupervised machine learning techniques, mainly principal component analysis (PCA), to compare and contrast the phase behavior and phase transitions in several classical spin models-the square- and triangular-lattice Ising models, the Blume-Capel model, a highly degenerate biquadratic-exchange spin-1 Ising (BSI) model, and the two-dimensional XY model-and we examine critically what machine learning is teaching us. We find that quantified principal components from PCA not only allow the exploration of different phases and symmetry-breaking, but they can distinguish phase-transition types and locate critical points. We show that the corresponding weight vectors have a clear physical interpretation, which is particularly interesting in the frustrated models such as the triangular antiferromagnet, where they can point to incipient orders. Unlike the other well-studied models, the properties of the BSI model are less well known. Using both PCA and conventional Monte Carlo analysis, we demonstrate that the BSI model shows an absence of phase transition and macroscopic ground-state degeneracy. The failure to capture the "charge" correlations (vorticity) in the BSI model (XY model) from raw spin configurations points to some of the limitations of PCA. Finally, we employ a nonlinear unsupervised machine learning procedure, the "autoencoder method," and we demonstrate that it too can be trained to capture phase transitions and critical points.
The identification of universal properties from minimally processed data sets is one goal of machine learning techniques applied to statistical physics.Here, we study how the minimum number of variables needed to accurately describe the important features of a data set-the intrinsic dimension (I d )-behaves in the vicinity of phase transitions.We employ state-of-the-art nearest-neighbors-based I d estimators to compute the I d of raw Monte Carlo thermal configurations across different phase transitions: first-order, second-order, and Berezinskii-Kosterlitz-Thouless.For all the considered cases, we find that the I d uniquely characterizes the transition regime.The finite-size analysis of the I d allows us to not only identify critical points with an accuracy comparable to methods that rely on a priori identification of order parameters but also to determine the corresponding (critical) exponent ν in the case of continuous transitions.For the case of topological transitions, this analysis overcomes the reported limitations affecting other unsupervised learning methods.Our work reveals how raw data sets display unique signatures of universal behavior in the absence of any dimensional reduction scheme and suggest direct parallelism between conventional order parameters in real space and the intrinsic dimension in the data space.
In recent years Machine Learning has proved to be successful in many technological applications and scientific tasks, such as image and speech recognition, natural language understanding and more. In this work we apply both supervised and unsupervised Machine Learning to three key problems in statistical physics: design of Hamiltonian from data, phase recognition and study of critical properties of a system undergoing phase transition. As an example of model design, we use a dataset with spin configurations and corresponding energies randomly sampled from a one dimensional Ising model. We then make two guesses for the correct Hamiltonian: the former involving interactions of spins with an external local field, the latter involving two body interactions among spins. The coupling constants are determined with a linear penalized regression, comparing the effects of L1 and L2 penalization terms of the cost function. We pay specific attention to the problem of overfitting and to the validation process, which is critical for accepting or rejecting the proposed model. The phase recognition problem is faced with the two dimensional Ising and XY models as examples. After showing the limits of a simple softmax regression for this task, we build suitable neural networks to overcome these limits. In particular, a feed forward network is built and the learning process is investigated for the Ising model; while a more sophisticated convolutional network is proposed for the XY model in order to detect local topological structures. The last part of the work is dedicated to the unsupervised study of phase transitions, and the determination of critical properties (order parameter, critical temperature, critical exponents). The discussed techniques are Principal Component Analysis (PCA) for dimensional reduction and K-means clustering for organizing data into subsets with specific properties. PCA is applied to the two dimensional Ising, Potts and XY models, and it is used to find suitable order parameters. The study of the proposed order parameter as a function of temperature provides evidence of phase transition, and a finite size scaling allows to extrapolate both the critical temperature in the thermodynamic limit, and the ν\nuν critical exponent for the correlation length. K-means clustering is applied to equilibrium configurations of the two dimensional Ising model, before and after the dimensional reduction, and the critical temperature is estimated. Moreover, a clustering of relaxation curves of magnetization in a Monte Carlo dynamics is used to build a phase diagram on the parameter space of temperature and magnetic field. A synergy of C++, Python and Wolfram Mathematica 12.0 is used throughout this work in order to sample input datasets and to build and control customized neural networks and learning tools. The most relevant codes are provided in the appendix.
We apply various unsupervised machine learning methods for phase classification to investigate the finite-temperature phase diagram of the spinless Falicov-Kimball model in two dimensions. Using only particle occupation snapshots from Monte Carlo simulations as input, each technique, including a straightforward classification based on principal component analysis (PCA), successfully identifies the phase boundary between ordered and disordered phases, independent of the type of phase transition. Remarkably, these techniques also distinguish between the weakly localized and Anderson-localized regimes within the disordered phase, accurately identifying their crossover, which is a challenging task for standard methods. Among the machine learning approaches used, PCA based analysis outperforms more complex methods, such as neural network predictors and autoencoders. These results underscore the effectiveness of simple unsupervised techniques in examining phase transitions and electron localization in complex correlated systems.