The applicability of artificial neural networks (ANNs) is typically limited to the models they are trained with and little is known about their generalizability, which is a pressing issue in the practical application of trained ANNs to unseen problems. Here, by using the task of identifying phase transitions in spin models, we establish a systematic generalizability such that simple ANNs trained with the two-dimensional ferromagnetic Ising model can be applied to the ferromagnetic q q -state Potts model in different dimensions for q \geq 2 q ≥ 2 . The same scheme can be applied to the highly nontrivial antiferromagnetic q q -state Potts model. We demonstrate that similar results can be obtained by reducing the exponentially large state space spanned by the training data to one that comprises only three representative configurations artificially constructed through symmetry considerations. We expect our findings to simplify and accelerate the development of machine learning-assisted tasks in spin-model related disciplines in physics and materials science.
The applicability of artificial neural networks (ANNs) is typically limited to the models they are trained with and little is known about their generalizability, which is a pressing issue in the practical application of trained ANNs to unseen problems. Here, by using the task of identifying phase transitions in spin models, we establish a systematic generalizability such that simple ANNs trained with the two-dimensional ferromagnetic Ising model can be applied to the ferromagnetic q q -state Potts model in different dimensions for q \geq 2 q ≥ 2 . The same scheme can be applied to the highly nontrivial antiferromagnetic q q -state Potts model. We demonstrate that similar results can be obtained by reducing the exponentially large state space spanned by the training data to one that comprises only three representative configurations artificially constructed through symmetry considerations. We expect our findings to simplify and accelerate the development of machine learning-assisted tasks in spin-model related disciplines in physics and materials science.
Abstract Using the techniques of neural networks (NN), we study the three-dimensional (3D) five-state ferromagnetic Potts model on the cubic lattice as well as the two-dimensional (2D) three-state antiferromagnetic Potts model on the square lattice. Unlike the conventional approach, here we follow the idea employed by Li et al (2018 Ann. Phys., NY 391 312–331). Specifically, instead of numerically generating numerous objects for the training, the whole or part of the theoretical ground state configurations of the studied models are considered as the training sets. Remarkably, our investigation of these two models provides convincing evidence for the effectiveness of the method of preparing training sets used in this study. In particular, the results of the 3D model obtained here imply that the NN approach is as efficient as the traditional method since the signal of a first order phase transition, namely tunneling between two channels, determined by the NN method is as strong as that calculated with the Monte Carlo technique. Furthermore, the outcomes associated with the considered 2D system indicate even little partial information of the ground states can lead to conclusive results regarding the studied phase transition. The achievements reached in our investigation demonstrate that the performance of NN, using certain amount of the theoretical ground state configurations as the training sets, is impressive.
A universal (supervised) neural network (NN), which is only trained once on a one-dimensional lattice of 200 sites, is employed to study the phase transition of the two-dimensional (2D) 5-state ferromagnetic Potts model on the square lattice. In particular, the NN is obtained by using merely two artificially made configurations as the training set. Due to the elegant features of the considered NN, results associated with systems consisting of over 4000000 spins can be obtained with ease, and convincing evidence showing the investigated phase transition is weakly first order is reached. The outcomes demonstrated here can hardly be achieved with the standard NNs that are commonly used in the literature.
Conventionally, the training of a neural network for learning phases of matter uses real physical quantities as the training set. However, it has been demonstrated in several studies that this may not be required. Here we investigate the phase transitions of the two-dimensional (2D) q-state Potts models on the square lattice using a pre-trained neural network (NN). The employed NN was trained previously using two artifically made configurations as the training set. Hence no training is conducted for the present study. Remarkably, the used NN not only calculates the critical points of the considered phase transitions precisely, but also determines the nature of these phase transition definitely without ambiguity. Our results as well as the outcomes found previously suggest that training a NN using real physical quantities as the training set is not required to obtain a working NN. These unconventional studies also imply that if the configuration space of a system can be classified into two categories, then the NN considered here is likely applicable to study the phase transition of that system. Comparison between our approach and other known NN methods for studying the 2D q-state Potts models is briefly discussed as well.
The main question raised in the article is whether a neural network trained on a spin lattice model in one universality class can be used to test a model in another universality class. The quantities of interest are the critical phase transition temperature and the correlation length exponent. In other words, the question of transfer learning is how "universal" the trained network is and under what conditions. For this purpose, we applied a supervised learning procedure to three two-dimensional models for which critical properties are precisely known: The Ising model, the four-state Potts model, and the Baxter-Wu model. We consider two datasets: One with spin configurations and one with binding energy configurations. We find that estimates of the critical temperature agree well with the known results for both datasets, but not with the results of cross-testing using the energy datasets of the two models: The four-state Potts model and the Ising model. Estimates of the critical length exponent are less regular, and appear to be more accurate for energy datasets. A good example is the cross-testing using the energy dataset between the Ising model and the Baxter-Wu model in both training and testing directions.
Abstract The critical phenomena of the 2D antiferromagnetic q-state Potts model on the square lattice with q=2,3,4 are investigated using the techniques of neural networks (NNs). In particular, an unconventional supervised NN which is trained using no information about the physics of the considered systems is employed. In addition, conventional unsupervised autoencoders (AECs) are used in our study as well. Remarkably, whereas the conventional AECs either fail or only work partially to uncover the critical phenomena of the systems associated with q=3 and q=4 investigated here, our unconventional supervised NN correctly identifies the critical behaviors of all three considered antiferromagnetic q-state Potts models. The results obtained in this study suggest convincingly that the applicability of our unconventional supervised NN is broader than one anticipates. In particular, when a new system is studied with our NN, it is likely that it is not necessary to conduct any training, and one only needs to examine whether an appropriate reduced representation of the original raw configurations exists, so that the same already trained NN can be employed to explore the related phase transition efficiently.
Identifying phase transitions and classifying phases of matter is central to understanding the properties and behavior of a broad range of material systems. In recent years, machine-learning (ML) techniques have been successfully applied to perform such tasks in a data-driven manner. However, the success of this approach notwithstanding, we still lack a clear understanding of ML methods for detecting phase transitions, particularly of those that utilize neural networks (NNs). In this work, we derive analytical expressions for the optimal output of three widely used NN-based methods for detecting phase transitions. These optimal predictions correspond to the results obtained in the limit of high model capacity. Therefore, in practice they can, for example, be recovered using sufficiently large, well-trained NNs. The inner workings of the considered methods are revealed through the explicit dependence of the optimal output on the input data. By evaluating the analytical expressions, we can identify phase transitions directly from experimentally accessible data without training NNs, which makes this procedure favorable in terms of computation time. Our theoretical results are supported by extensive numerical simulations covering, e.g., topological, quantum, and many-body localization phase transitions. We expect similar analyses to provide a deeper understanding of other classification tasks in condensed matter physics.