Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Applications of Spin Glasses across Disciplines: From Complex Systems to Quantum Computing and Algorithm Development

Zheng Zhu

Published Aug 5, 2015• 0 citations
OpenAlex

Abstract

The main subjects of this dissertation are spin glass applications in other disciplines and spin glass algorithms. Spin glasses are magnetic systems with disorder and frustration, and the essential physics of spin glasses lies not in the details of their microscopic interactions but rather in the competition between quenched ferromagnetic and antiferromagnetic interactions. Concepts that arose in the study of spin glasses have led to applications in areas as diverse as computer science, biology, and finance, as well as a variety of others.\n\nIn the first part of this dissertation I study the equilibrium and non-equilibrium properties of Boolean decision problems with competing interactions on scale-free networks in an external bias (a magnetic field). First, I perform finite-temperature Monte Carlo simulations in a field to test the robustness of the spin-glass phase and I show that the system has a spin-glass phase in a field, i.e., it exhibits a de Almeida–Thouless line. Then I study avalanche distributions when the system is driven by a field at zero temperature to test whether the system displays self-organized criticality. The numerical results suggest that avalanches (damage) can spread across the entire system with nonzero probability when the decay exponent of the interaction degree is less than or equal to 2, i.e., that Boolean decision problems on scale-free networks with competing interactions can be fragile when the system is not in thermal equilibrium.\n\nIn the second part of this dissertation I discuss the best-case performance of quantum annealers on native spin-glass benchmarks, i.e., how chaos can affect success probabilities. We perform classical parallel-tempering Monte Carlo simulations of the archetypal benchmark problem, an Ising spin glass, on the native chip topology. Using realistic uncorrelated noise models for the D-Wave Two quantum annealer, I study the best-case resilience, or the probability that the ground-state configuration is not affected by random fields and random-bond fluctuations found on the chip. We compute the upper-bound success probabilities for different instance classes based on these simple error models, and I present strategies for developing robust and hard benchmark instances.\n\nIn the third part of this dissertation I present a cluster algorithm for Ising spin glasses that works in any space dimension and speeds up thermalization by several orders of magnitude at temperatures where thermalization is typically difficult. Our isoenergetic cluster moves are based on the Houdayer cluster algorithm for two-dimensional spin glasses and lead to a speedup over conventional state-of-the-art methods that increases with the system size. We illustrate the benefits (improved thermalization and achievement of more equiprobable sampling of ground states) of the isoenergetic cluster moves in two and three space dimensions, as well as in the nonplanar Chimera topology found in the D-Wave quantum annealing machine.\n\nFinally, I study the thermodynamic properties of the two-dimensional Edwards-Anderson Ising spin-glass model on a square lattice using the tensor renormalization group method based on a higher-order singular-value decomposition. Our estimates of the partition function without a high precision data type lead to negative values at very low temperatures, thus illustrating that the method can not be applied to frustrated magnetic systems.

Related papers

A Study of Spin Glasses and Their Applications

Chao Fang

Spin glasses are disordered magnetic systems that have frustration. The most interesting feature of the physical properties of spin glasses is the complex structure of phase space that is caused by the competition between the quenched ferromagnetic and antiferromagnetic interactions of spin pairs. The popularity of spin glasses is two-fold. First of all, the extremely complicated energy landscapes built from the frustration among spin interactions gives spin glasses new properties that have never been seen in other ordered systems. One of these properties is a new transition between the paramagnetic phase and a disordered phase, the spin-glass phase. This new phenomenon triggers scientists' enthusiasm for deeply understanding the physical foundations and mathematical description for disordered systems such as spin glasses. Secondly, because analytical methods can no longer offer enough support for studying disordered systems, scientists use numerical tools like Markov-chain Monte Carlo to simulate the thermodynamics of the systems of interest as well as statistical methods to process big data generated from the simulations. Therefore, the research on such complex systems introduces a new paradigm to statistical physics and also opens a window into an overlapping area between computational physics and information science, which makes an interdisciplinary study necessary and helpful. \n\n\n\n I devote my research to this new interdisciplinary area by seeking new connections in both models and algorithms. This dissertation consists of two themes. The first theme is about the research of spin glasses, including a study on the universality of a diluted spin-glass model and the development of algorithms by introducing new tools from artificial intelligence and extending the current algorithms for more general use. I demonstrate that to detect the phase transition in a spin-glass model we can train convolutional neural networks with a different spin-glass model. Then, use the convolutional neural networks to precisely predict the phase transition of the model. I also show that by training the convolutional neural networks with poisoned data, the results can be very unpredictable. Next, I introduce research in modifying the isoenergetic cluster moves for highly connected topologies in spin glasses. The numerical results show that isoenergetic cluster moves can only be effective for graphs with low connectivities due to the relatively small percolation thresholds in topologies with high connectivities and the trade-off between the cluster size and acceptance rate forced by the detailed balance condition. To conclude the first theme, I study the universality of the two dimensional Ising model with bond dilution. This project is inspired by a debate in the grey area that is not covered by Harris criterion: the universality of a two-dimensional Ising model with disorder can not be theoretically explained. The simulation results for the two-dimensional Ising model with bond dilution show that the critical exponent of the correction to the correlation length does not change with disorder, which supports the strong universality scenario. The second theme of this dissertation is the study of the Boolean satisfiability problem through the use of Ising spin form. The Boolean satisfiability problem is the problem of determining if there exists an assignment of Boolean variables that satisfies a given Boolean formula. Considering that there are rarely global algorithms for the Boolean satisfiability problem and that the NP-complete Ising spin glass is written in Boolean variables as well, I use Monte Carlo simulations to find the optimal solutions for the Boolean satisfiability problem by implementing the Metropolis algorithm combined with the Parallel tempering algorithm. The advantage of this method is that the ergodicity of the thermodynamic procedure makes this algorithm global, which can help search for optimal solutions through the entire configuration space. The numerical results show that this physical algorithm has an obvious advantage over the current state-of-art algorithms on a derivative problem, the Boolean maximum satisfiability problem. Finally, I introduce my research on the Boolean satisfiability problem-based membership filter. Since the physical approach has the ability of globally seeking solutions it can help find uncorrelated solutions for the Boolean satisfiability problem-based membership filter, which is the key to improving efficiency for this new filter. Furthermore, I improve the efficiency of the filter by turning the Boolean satisfiability instance into a not-all-equal form to guarantee that the solutions found by our algorithm, Borealis, are uncorrelated. The numerical results show that the efficiency of Boolean satisfiability-based filter can be significantly improved while keeping the false positive rate low.

•May 26, 2020•0 citations

A STUDY OF QUANTUM ANNEALING DEVICES FROM A CLASSICAL PERSPECTIVE

Andrew J. Ochoa

Spin glasses are experiencing a revival due to applications in quantum information\ntheory. In particular, they are the archetypal native benchmark problem for quantum annealing\nmachines. Furthermore, they find applications in fields as diverse as satisfiability,\nneural networks, and general combinatorial optimization problems. As such, developing\nand improving algorithms and methods to study these computationally complex systems\nis of paramount importance to many disciplines. This body of work attempts to attack\nthe problem of solving combinatorial optimization problems by simulating spin glasses\nfrom three sides: classical algorithm development, suggestions for quantum annealing\ndevice design, and improving measurements in realistic physical systems with inherent\nnoise. I begin with the introduction of a cluster algorithm based on Houdayer’s cluster algorithm\nfor two-dimensional Ising spin-glasses that is applicable to any space dimension\nand speeds up thermalization by several orders of magnitude at low temperatures where\nprevious algorithms have difficulty. I show improvement for the D-Wave chimera topology\nand the three-dimensional cubic lattice that increases with the size of the problem.\nOne consequence of adding cluster moves is that for problems with degenerate solutions,\nground-state sampling is improved. I demonstrate an ergodic algorithm to sample ground\nstates through the use of simple Monte Carlo with parallel tempering and cluster moves.\nIn addition, I present a non-ergodic algorithm to generate new solutions from a bank of\nknown solutions. I compare these results against results from quantum annealing utilizing\nthe D-Wave Inc. quantum annealing device. Finally, I present an algorithm for improving\nthe recovery of ground-state solutions from problems with noise by using thermal fluctuations\nto infer the correct solution at the Nishimori temperature. While this method has been\ndemonstrated analytically and numerically for trivial ferromagnetic and Gaussian distributions, a useful metric for more complex Gaussian distributions with added Gaussian noise\nis unavailable. We show improved recovery of numerical solutions on the chimera graph\nwith a ferromagnetic distribution and added Gaussian noise. Next, I direct my focus to the\ndesign of future generations of quantum annealers. The first design is the two-dimensional\nsquare-lattice bimodal spin glass with next-nearest ferrromagnetic interactions proposed\nby Lemke and Campbell claimed to exhibit a finite-temperature spin-glass state for a particular\nrelative strength of the next-nearest to nearest neighbor interactions. Our results\nfrom finite-temperature simulations show the system is in a paramagnetic state in the thermodynamic\nlimit, thus not useful for quantum annealing device designs that would benefit\nfrom a spin-glass phase transition. The second design is the diluted next-nearest neighbor\nIsing spin-glass with Gaussian interactions in an attempt to improve the estimation\nof critical parameter with smaller system sizes by implementing averaging of observables\nover different graph dilutions. To date, this model has shown no improvement. Finally,\nI make suggestions for the choice of distributions of interactions that are robust to noise\nand present a method for using previously unaccessible continuous distributions. I begin\nwith showing the best-case performance of quantum annealing devices. I show results for\nthe resilience, the probability that the ground-state solution has changed due to inherent\nanalog noise in the device, and present strategies for developing robust instance classes.\nThe analog noise is also detrimental to interactions chosen from continuous distributions.\nUsing Gaussian quadratures, I present a method for discretizing continuous distributions\nto reduce noise effects. Simulations on the D-Wave show that the average residual of\nthe ground-state energy with the true ground-state energy is calculated and shown to be\nsmaller in the case of the discrete distribution.

•Dec 7, 2017•1 citation

Classical and Quantum Computation in Ground States and Beyond

Elizabeth Crosson

In this dissertation we study classical and quantum spin systems with applications to the theory of computation. In particular, we examine computational aspects of these systems beyond their ground states by considering the effects of non-zero temperatures and excited energy states. In the first part we show that universal classical computations can be encoded into equilibrium thermal states of classical spin systems, at sufficiently low temperatures which are independent of the system size. In the second part we explore different strategies for optimization with the quantum adiabatic algorithm, and we show that it is possible to increase the success probability for hard random instances by following the counterintuitive strategy of evolving along the Hamiltonian path more rapidly. In the third part we examine the performance of simulated quantum annealing in finding the minimum of an energy function which contains a high energy barrier, and we provide evidence that simulated quantum annealing inherits some of the advantages of quantum annealing which allow it to pass through the high barrier and minimize the energy function efficiently. In the last part we show that the path-integral quantum Monte Carlo method leads to a provably efficient algorithm for approximating the partition function of any 1D generalized transverse Ising spin chain (with position-dependent local fields and frustrated interactions), at temperatures which are independent of the system size.

•Sep 29, 2015•1 citation

Large Scale Excitations in Disordered Systems

Marta Sales i Pardo

Disorder is present in many systems in nature and in many different versions. For instance, the dislocations of a crystal lattice, or the randomness of the interaction between magnetic moments. One of the most studied examples is that of spin glasses because they are simple to model but keep most of the very complex features that many disordered systems have. The frustration of the ground state configuration is responsible for the existence of a gap less spectrum of excitations and a rugged and complex free-energy landscape which bring about a very slow relaxation towards the equilibrium state. The main concern of the thesis has been to study what the properties of the typical excitation, i.e. those excitations that are large and contribute dominantly to the physics in the frozen phase. The existence of these large excitations brings about large fluctuations of the order parameter, and we have shown in these theses that this feature can be exploited to study the transition of any spin glass model. Moreover, we have shown that the information about these excitations can be extracted from the statistics of the lowest lying excitations. This is because due to the random nature of spin glasses, the physics obtained from averaging over the whole spectrum of excitations of an infinite sample is equivalent to averaging over many finite systems where only the ground state and the first excitation are considered. The novelty of this approach is that we do not need to make any assumption on what are typical excitations like because we can compute them exactly using numerical methods. Finally, we have investigated the dynamics and more specifically the link between the problem of chaos and the rejuvenation phenomena observed experimentally. Rejuvenation means that when lowering the temperature the aging process restarts again from scratch. This is potentially linked with the chaos assumption which states that equilibrium configurations at two different properties are not correlated. Chaos is a large scale phenomenon possible if entropy fluctuations are large. However, in this thesis we have shown that the response to temperature changes can be large in the absence of chaos close to a localization transition where the Boltzmann weight condenses in a few states. This has been observed in simulation of the Sinai model in which this localization is realized dynamically. In this model, since at low temperatures the system gets trapped in the very deep states, the dynamics is only local, so that only small excitations contribute to the rejuvenation signal that we have been able to observe. Thus, in agreement with the hierarchical picture, rejuvenation is possible even in the absence of chaos and reflects the start of the aging process of small length scales.

•Nov 22, 2002•0 citations

Understanding Nonequilibrium Behaviors of Spin Glasses Through Heuristics

Jie Yang

Spin glass behavior was first seen in metallic alloys with magnetic impurities dispersed randomly in the main non-magnetic component. Due to the simultaneous presence of quenched disorder and competing ferromagnetic and antiferromagnetic interactions, the nonequilibrium behaviors of spin glasses are intricate and difficult to understand. Experimental research on spin glass materials indicate extremely slow dynamics, suggesting that the direct numerical simulation using local spin flips will take impractical time scales to replicate the nonequilibrium behaviors. This thesis introduces efficient algorithms and heuristics for the numerical simulation of simple models for spin glasses and discusses significant simulation results. The results provide insights into understanding the nonequilibrium behaviors, especially aging and memory, through studying microscopic constituent configurations. The methodology and conclusion presented in this thesis can be potentially extended to address general questions about disordered materials at nonequilibrium. Chapter 1 provides a thorough overview of spin glasses. A detailed introduction on complex nonequilibrium behaviors, including slow dynamics and memory effects, seen in typical experiments of spin glass materials, is presented. A general discussion about the characterization and categorization of memory effects found in many out-of-equilibrium systems is highlighted. Two prevalent theoretical models on spin glasses, the droplet and replica symmetry breaking theory, are described. Lastly, algorithm development and simulation techniques used to study spin glasses are covered. In Chapter 2, a patchwork heuristic is applied to accelerate the relaxation of spin glass models in dimensions $d=1$ and $d=2$ with the goal of investigating the dynamics of loss and recovery of spin configurations. A well-designed simulation protocol, consists of a aging and recovery stage, is used to mimic the temperature cycling experiment, where the temperature variations are replaced by the variations of the spin coupling realization. Eventual recovery of memory upon coarsening is seen in two-dimensional Ising spin glasses and one-dimensional clock models, while one-dimensional Ising spin systems do not exhibit configuration memory. A central result is that the coarsening recovery length scale $s_{\mathrm c}$ grows faster than the aging length scale $\ell$ as a power law relation $s_{\mathrm c}\sim\ell^{2.58}$. In Chapter 3, the microscopic dependence of spin glass equilibration on sample history, i.e., the initial configuration and the specific noise history of stochastic dynamics, is examined. The patchwork dynamics is used to simulate the glassy dynamics over a wide range of length scales. The dependence of the nearest-neighbor spin correlations at long time on initial spin configurations and on noise histories are compared. Most of the local spin correlations are independent of the details of evolution, due to the formation of rigid domains. The correlations on a fractal set of domain walls are found to have distinct dependence on the noise history and the initial state. The initial ``nature'' of the state is retained in the domain walls under coarsening more than the ``nurture'' of the noise, while the location of the domain walls at each scale is determined by the frozen disorder (``environment''). We also provide evidence that coarsening with local dynamics at finite temperature gives persistence of overlaps roughly consistent with coarsening at zero temperature, at least over short distances, supporting the use of zero-temperature heuristics to address finite-temperature dynamics and memory.

•Jan 1, 2018•0 citations

Replica Exchange Monte Carlo Simulations of the Ising Spin Glass: Static and Dynamic Properties

Burcu Yücesoy

Spin glasses have been the subject of intense study and considerable controversy for decades, and the low-temperature phase of short-range spin glasses is still poorly understood. Our main goal is to improve our understanding in this area and find an answer to the following question: Are there only a single pair or a countable infinity of pure states in the low temperature phase of the EA spin glass? To that aim we first start by introducing spin glasses and provide a brief history of their research, then proceed to describe our method of simulation, the parallel tempering Monte Carlo algorithm. Next, we present the results of a large-scale numerical study of the equilibrium three-dimensional Edwards-Anderson Ising spin glass with Gaussian disorder. In order to understand how the parallel tempering algorithm works, we measure various static, as well as dynamical quantities, such as the autocorrelation times and round-trip times for the parallel tempering Monte Carlo method. We examine the correlation between static and dynamic observables for _ 5000 disorder realizations and up to 1000 spins down to temperatures at 20% of the critical temperature, and our results show that autocorrelation times are directly correlated with the roughness of the free-energy landscape. In the following chapters, the three- and four-dimensional Edwards-Anderson and mean-field Sherrington-Kirkpatrick Ising spin glasses are studied again via large-scale Monte Carlo simulations at low temperatures, deep within the spinglass phase. Performing a careful statistical analysis of several thousand independent disorder realizations and using an observable that detects peaks in the overlap distribution, we show that the Sherrington-Kirkpatrick and Edwards-Anderson models have a distinctly different low-temperature behavior. We arrive to the following conclusion: The structure of the spin-glass overlap distribution for the Edwards-Anderson model suggests that its low-temperature phase has only a single pair of pure states. Finally we present results for several new observables, along with a few preliminary studies and suggestions for future research.

•Jan 1, 2013•0 citations
The main subjects of this dissertation are spin glass applications in other disciplines and spin glass algorithms. Spin glasses are magnetic systems with disorder and frustration, and the essential physics of spin glasses lies not in the details of their microscopic interactions but rather in the competition between quenched ferromagnetic and antiferromagnetic interactions. Concepts that arose in the study of spin glasses have led to applications in areas as diverse as computer science, biology, and finance, as well as a variety of others.\n\nIn the first part of this dissertation I study the equilibrium and non-equilibrium properties of Boolean decision problems with competing interactions on scale-free networks in an external bias (a magnetic field). First, I perform finite-temperature Monte Carlo simulations in a field to test the robustness of the spin-glass phase and I show that the system has a spin-glass phase in a field, i.e., it exhibits a de Almeida–Thouless line. Then I study avalanche distributions when the system is driven by a field at zero temperature to test whether the system displays self-organized criticality. The numerical results suggest that avalanches (damage) can spread across the entire system with nonzero probability when the decay exponent of the interaction degree is less than or equal to 2, i.e., that Boolean decision problems on scale-free networks with competing interactions can be fragile when the system is not in thermal equilibrium.\n\nIn the second part of this dissertation I discuss the best-case performance of quantum annealers on native spin-glass benchmarks, i.e., how chaos can affect success probabilities. We perform classical parallel-tempering Monte Carlo simulations of the archetypal benchmark problem, an Ising spin glass, on the native chip topology. Using realistic uncorrelated noise models for the D-Wave Two quantum annealer, I study the best-case resilience, or the probability that the ground-state configuration is not affected by random fields and random-bond fluctuations found on the chip. We compute the upper-bound success probabilities for different instance classes based on these simple error models, and I present strategies for developing robust and hard benchmark instances.\n\nIn the third part of this dissertation I present a cluster algorithm for Ising spin glasses that works in any space dimension and speeds up thermalization by several orders of magnitude at temperatures where thermalization is typically difficult. Our isoenergetic cluster moves are based on the Houdayer cluster algorithm for two-dimensional spin glasses and lead to a speedup over conventional state-of-the-art methods that increases with the system size. We illustrate the benefits (improved thermalization and achievement of more equiprobable sampling of ground states) of the isoenergetic cluster moves in two and three space dimensions, as well as in the nonplanar Chimera topology found in the D-Wave quantum annealing machine.\n\nFinally, I study the thermodynamic properties of the two-dimensional Edwards-Anderson Ising spin-glass model on a square lattice using the tensor renormalization group method based on a higher-order singular-value decomposition. Our estimates of the partition function without a high precision data type lead to negative values at very low temperatures, thus illustrating that the method can not be applied to frustrated magnetic systems.
Spin glasses are disordered magnetic systems that have frustration. The most interesting feature of the physical properties of spin glasses is the complex structure of phase space that is caused by the competition between the quenched ferromagnetic and antiferromagnetic interactions of spin pairs. The popularity of spin glasses is two-fold. First of all, the extremely complicated energy landscapes built from the frustration among spin interactions gives spin glasses new properties that have never been seen in other ordered systems. One of these properties is a new transition between the paramagnetic phase and a disordered phase, the spin-glass phase. This new phenomenon triggers scientists' enthusiasm for deeply understanding the physical foundations and mathematical description for disordered systems such as spin glasses. Secondly, because analytical methods can no longer offer enough support for studying disordered systems, scientists use numerical tools like Markov-chain Monte Carlo to simulate the thermodynamics of the systems of interest as well as statistical methods to process big data generated from the simulations. Therefore, the research on such complex systems introduces a new paradigm to statistical physics and also opens a window into an overlapping area between computational physics and information science, which makes an interdisciplinary study necessary and helpful. \n\n\n\n I devote my research to this new interdisciplinary area by seeking new connections in both models and algorithms. This dissertation consists of two themes. The first theme is about the research of spin glasses, including a study on the universality of a diluted spin-glass model and the development of algorithms by introducing new tools from artificial intelligence and extending the current algorithms for more general use. I demonstrate that to detect the phase transition in a spin-glass model we can train convolutional neural networks with a different spin-glass model. Then, use the convolutional neural networks to precisely predict the phase transition of the model. I also show that by training the convolutional neural networks with poisoned data, the results can be very unpredictable. Next, I introduce research in modifying the isoenergetic cluster moves for highly connected topologies in spin glasses. The numerical results show that isoenergetic cluster moves can only be effective for graphs with low connectivities due to the relatively small percolation thresholds in topologies with high connectivities and the trade-off between the cluster size and acceptance rate forced by the detailed balance condition. To conclude the first theme, I study the universality of the two dimensional Ising model with bond dilution. This project is inspired by a debate in the grey area that is not covered by Harris criterion: the universality of a two-dimensional Ising model with disorder can not be theoretically explained. The simulation results for the two-dimensional Ising model with bond dilution show that the critical exponent of the correction to the correlation length does not change with disorder, which supports the strong universality scenario. The second theme of this dissertation is the study of the Boolean satisfiability problem through the use of Ising spin form. The Boolean satisfiability problem is the problem of determining if there exists an assignment of Boolean variables that satisfies a given Boolean formula. Considering that there are rarely global algorithms for the Boolean satisfiability problem and that the NP-complete Ising spin glass is written in Boolean variables as well, I use Monte Carlo simulations to find the optimal solutions for the Boolean satisfiability problem by implementing the Metropolis algorithm combined with the Parallel tempering algorithm. The advantage of this method is that the ergodicity of the thermodynamic procedure makes this algorithm global, which can help search for optimal solutions through the entire configuration space. The numerical results show that this physical algorithm has an obvious advantage over the current state-of-art algorithms on a derivative problem, the Boolean maximum satisfiability problem. Finally, I introduce my research on the Boolean satisfiability problem-based membership filter. Since the physical approach has the ability of globally seeking solutions it can help find uncorrelated solutions for the Boolean satisfiability problem-based membership filter, which is the key to improving efficiency for this new filter. Furthermore, I improve the efficiency of the filter by turning the Boolean satisfiability instance into a not-all-equal form to guarantee that the solutions found by our algorithm, Borealis, are uncorrelated. The numerical results show that the efficiency of Boolean satisfiability-based filter can be significantly improved while keeping the false positive rate low.
Spin glasses are experiencing a revival due to applications in quantum information\ntheory. In particular, they are the archetypal native benchmark problem for quantum annealing\nmachines. Furthermore, they find applications in fields as diverse as satisfiability,\nneural networks, and general combinatorial optimization problems. As such, developing\nand improving algorithms and methods to study these computationally complex systems\nis of paramount importance to many disciplines. This body of work attempts to attack\nthe problem of solving combinatorial optimization problems by simulating spin glasses\nfrom three sides: classical algorithm development, suggestions for quantum annealing\ndevice design, and improving measurements in realistic physical systems with inherent\nnoise. I begin with the introduction of a cluster algorithm based on Houdayer’s cluster algorithm\nfor two-dimensional Ising spin-glasses that is applicable to any space dimension\nand speeds up thermalization by several orders of magnitude at low temperatures where\nprevious algorithms have difficulty. I show improvement for the D-Wave chimera topology\nand the three-dimensional cubic lattice that increases with the size of the problem.\nOne consequence of adding cluster moves is that for problems with degenerate solutions,\nground-state sampling is improved. I demonstrate an ergodic algorithm to sample ground\nstates through the use of simple Monte Carlo with parallel tempering and cluster moves.\nIn addition, I present a non-ergodic algorithm to generate new solutions from a bank of\nknown solutions. I compare these results against results from quantum annealing utilizing\nthe D-Wave Inc. quantum annealing device. Finally, I present an algorithm for improving\nthe recovery of ground-state solutions from problems with noise by using thermal fluctuations\nto infer the correct solution at the Nishimori temperature. While this method has been\ndemonstrated analytically and numerically for trivial ferromagnetic and Gaussian distributions, a useful metric for more complex Gaussian distributions with added Gaussian noise\nis unavailable. We show improved recovery of numerical solutions on the chimera graph\nwith a ferromagnetic distribution and added Gaussian noise. Next, I direct my focus to the\ndesign of future generations of quantum annealers. The first design is the two-dimensional\nsquare-lattice bimodal spin glass with next-nearest ferrromagnetic interactions proposed\nby Lemke and Campbell claimed to exhibit a finite-temperature spin-glass state for a particular\nrelative strength of the next-nearest to nearest neighbor interactions. Our results\nfrom finite-temperature simulations show the system is in a paramagnetic state in the thermodynamic\nlimit, thus not useful for quantum annealing device designs that would benefit\nfrom a spin-glass phase transition. The second design is the diluted next-nearest neighbor\nIsing spin-glass with Gaussian interactions in an attempt to improve the estimation\nof critical parameter with smaller system sizes by implementing averaging of observables\nover different graph dilutions. To date, this model has shown no improvement. Finally,\nI make suggestions for the choice of distributions of interactions that are robust to noise\nand present a method for using previously unaccessible continuous distributions. I begin\nwith showing the best-case performance of quantum annealing devices. I show results for\nthe resilience, the probability that the ground-state solution has changed due to inherent\nanalog noise in the device, and present strategies for developing robust instance classes.\nThe analog noise is also detrimental to interactions chosen from continuous distributions.\nUsing Gaussian quadratures, I present a method for discretizing continuous distributions\nto reduce noise effects. Simulations on the D-Wave show that the average residual of\nthe ground-state energy with the true ground-state energy is calculated and shown to be\nsmaller in the case of the discrete distribution.
In this dissertation we study classical and quantum spin systems with applications to the theory of computation. In particular, we examine computational aspects of these systems beyond their ground states by considering the effects of non-zero temperatures and excited energy states. In the first part we show that universal classical computations can be encoded into equilibrium thermal states of classical spin systems, at sufficiently low temperatures which are independent of the system size. In the second part we explore different strategies for optimization with the quantum adiabatic algorithm, and we show that it is possible to increase the success probability for hard random instances by following the counterintuitive strategy of evolving along the Hamiltonian path more rapidly. In the third part we examine the performance of simulated quantum annealing in finding the minimum of an energy function which contains a high energy barrier, and we provide evidence that simulated quantum annealing inherits some of the advantages of quantum annealing which allow it to pass through the high barrier and minimize the energy function efficiently. In the last part we show that the path-integral quantum Monte Carlo method leads to a provably efficient algorithm for approximating the partition function of any 1D generalized transverse Ising spin chain (with position-dependent local fields and frustrated interactions), at temperatures which are independent of the system size.
Disorder is present in many systems in nature and in many different versions. For instance, the dislocations of a crystal lattice, or the randomness of the interaction between magnetic moments. One of the most studied examples is that of spin glasses because they are simple to model but keep most of the very complex features that many disordered systems have. The frustration of the ground state configuration is responsible for the existence of a gap less spectrum of excitations and a rugged and complex free-energy landscape which bring about a very slow relaxation towards the equilibrium state. The main concern of the thesis has been to study what the properties of the typical excitation, i.e. those excitations that are large and contribute dominantly to the physics in the frozen phase. The existence of these large excitations brings about large fluctuations of the order parameter, and we have shown in these theses that this feature can be exploited to study the transition of any spin glass model. Moreover, we have shown that the information about these excitations can be extracted from the statistics of the lowest lying excitations. This is because due to the random nature of spin glasses, the physics obtained from averaging over the whole spectrum of excitations of an infinite sample is equivalent to averaging over many finite systems where only the ground state and the first excitation are considered. The novelty of this approach is that we do not need to make any assumption on what are typical excitations like because we can compute them exactly using numerical methods. Finally, we have investigated the dynamics and more specifically the link between the problem of chaos and the rejuvenation phenomena observed experimentally. Rejuvenation means that when lowering the temperature the aging process restarts again from scratch. This is potentially linked with the chaos assumption which states that equilibrium configurations at two different properties are not correlated. Chaos is a large scale phenomenon possible if entropy fluctuations are large. However, in this thesis we have shown that the response to temperature changes can be large in the absence of chaos close to a localization transition where the Boltzmann weight condenses in a few states. This has been observed in simulation of the Sinai model in which this localization is realized dynamically. In this model, since at low temperatures the system gets trapped in the very deep states, the dynamics is only local, so that only small excitations contribute to the rejuvenation signal that we have been able to observe. Thus, in agreement with the hierarchical picture, rejuvenation is possible even in the absence of chaos and reflects the start of the aging process of small length scales.
Spin glass behavior was first seen in metallic alloys with magnetic impurities dispersed randomly in the main non-magnetic component. Due to the simultaneous presence of quenched disorder and competing ferromagnetic and antiferromagnetic interactions, the nonequilibrium behaviors of spin glasses are intricate and difficult to understand. Experimental research on spin glass materials indicate extremely slow dynamics, suggesting that the direct numerical simulation using local spin flips will take impractical time scales to replicate the nonequilibrium behaviors. This thesis introduces efficient algorithms and heuristics for the numerical simulation of simple models for spin glasses and discusses significant simulation results. The results provide insights into understanding the nonequilibrium behaviors, especially aging and memory, through studying microscopic constituent configurations. The methodology and conclusion presented in this thesis can be potentially extended to address general questions about disordered materials at nonequilibrium. Chapter 1 provides a thorough overview of spin glasses. A detailed introduction on complex nonequilibrium behaviors, including slow dynamics and memory effects, seen in typical experiments of spin glass materials, is presented. A general discussion about the characterization and categorization of memory effects found in many out-of-equilibrium systems is highlighted. Two prevalent theoretical models on spin glasses, the droplet and replica symmetry breaking theory, are described. Lastly, algorithm development and simulation techniques used to study spin glasses are covered. In Chapter 2, a patchwork heuristic is applied to accelerate the relaxation of spin glass models in dimensions d=1d=1d=1 and d=2d=2d=2 with the goal of investigating the dynamics of loss and recovery of spin configurations. A well-designed simulation protocol, consists of a aging and recovery stage, is used to mimic the temperature cycling experiment, where the temperature variations are replaced by the variations of the spin coupling realization. Eventual recovery of memory upon coarsening is seen in two-dimensional Ising spin glasses and one-dimensional clock models, while one-dimensional Ising spin systems do not exhibit configuration memory. A central result is that the coarsening recovery length scale scs_{\mathrm c}sc​ grows faster than the aging length scale ℓ\ellℓ as a power law relation sc∼ℓ2.58s_{\mathrm c}\sim\ell^{2.58}sc​∼ℓ2.58. In Chapter 3, the microscopic dependence of spin glass equilibration on sample history, i.e., the initial configuration and the specific noise history of stochastic dynamics, is examined. The patchwork dynamics is used to simulate the glassy dynamics over a wide range of length scales. The dependence of the nearest-neighbor spin correlations at long time on initial spin configurations and on noise histories are compared. Most of the local spin correlations are independent of the details of evolution, due to the formation of rigid domains. The correlations on a fractal set of domain walls are found to have distinct dependence on the noise history and the initial state. The initial ``nature'' of the state is retained in the domain walls under coarsening more than the ``nurture'' of the noise, while the location of the domain walls at each scale is determined by the frozen disorder (``environment''). We also provide evidence that coarsening with local dynamics at finite temperature gives persistence of overlaps roughly consistent with coarsening at zero temperature, at least over short distances, supporting the use of zero-temperature heuristics to address finite-temperature dynamics and memory.
Spin glasses have been the subject of intense study and considerable controversy for decades, and the low-temperature phase of short-range spin glasses is still poorly understood. Our main goal is to improve our understanding in this area and find an answer to the following question: Are there only a single pair or a countable infinity of pure states in the low temperature phase of the EA spin glass? To that aim we first start by introducing spin glasses and provide a brief history of their research, then proceed to describe our method of simulation, the parallel tempering Monte Carlo algorithm. Next, we present the results of a large-scale numerical study of the equilibrium three-dimensional Edwards-Anderson Ising spin glass with Gaussian disorder. In order to understand how the parallel tempering algorithm works, we measure various static, as well as dynamical quantities, such as the autocorrelation times and round-trip times for the parallel tempering Monte Carlo method. We examine the correlation between static and dynamic observables for _ 5000 disorder realizations and up to 1000 spins down to temperatures at 20% of the critical temperature, and our results show that autocorrelation times are directly correlated with the roughness of the free-energy landscape. In the following chapters, the three- and four-dimensional Edwards-Anderson and mean-field Sherrington-Kirkpatrick Ising spin glasses are studied again via large-scale Monte Carlo simulations at low temperatures, deep within the spinglass phase. Performing a careful statistical analysis of several thousand independent disorder realizations and using an observable that detects peaks in the overlap distribution, we show that the Sherrington-Kirkpatrick and Edwards-Anderson models have a distinctly different low-temperature behavior. We arrive to the following conclusion: The structure of the spin-glass overlap distribution for the Edwards-Anderson model suggests that its low-temperature phase has only a single pair of pure states. Finally we present results for several new observables, along with a few preliminary studies and suggestions for future research.