Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1704.09014

Substochastic Monte Carlo Algorithms

Michael Jarret, Brad Lackey

Published Apr 28, 2017• 8 citations
arXivHTMLPDF

Abstract

In this paper we introduce and formalize Substochastic Monte Carlo (SSMC) algorithms. These algorithms, originally intended to be a better classical foil to quantum annealing than simulated annealing, prove to be worthy optimization algorithms in their own right. In SSMC, a population of walkers is initialized according to a known distribution on an arbitrary search space and varied into the solution of some optimization problem of interest. The first argument of this paper shows how an existing classical algorithm, "Go-With-The-Winners" (GWW), is a limiting case of SSMC when restricted to binary search and particular driving dynamics. Although limiting to GWW, SSMC is more general. We show that (1) GWW can be efficiently simulated within the SSMC framework, (2) SSMC can be exponentially faster than GWW, (3) by naturally incorporating structural information, SSMC can exponentially outperform the quantum algorithm that first inspired it, and (4) SSMC exhibits desirable search features in general spaces. Our approach combines ideas from genetic algorithms (GWW), theoretical probability (Fleming-Viot processes), and quantum computing. Not only do we demonstrate that SSMC is often more efficient than competing algorithms, but we also hope that our results connecting these disciplines will impact each independently. An implemented version of SSMC has previously enjoyed some success as a competitive optimization algorithm for Max-$k$-SAT.

DOI
10.48550/arxiv.1704.09014

Related papers

Adiabatic optimization versus diffusion Monte Carlo methods

Michael Jarret, Stephen P. Jordan, Brad Lackey

Most experimental and theoretical studies of adiabatic optimization use stoquastic Hamiltonians, whose ground states are expressible using only real nonnegative amplitudes. This raises a question as to whether classical Monte Carlo methods can simulate stoquastic adiabatic algorithms with polynomial overhead. Here we analyze diffusion Monte Carlo algorithms. We argue that, based on differences between ${L}_{1}$ and ${L}_{2}$ normalized states, these algorithms suffer from certain obstructions preventing them from efficiently simulating stoquastic adiabatic evolution in generality. In practice however, we obtain good performance by introducing a method that we call Substochastic Monte Carlo. In fact, our simulations are good classical optimization algorithms in their own right, competitive with the best previously known heuristic solvers for MAX-$k$-SAT at $k=2,3,4$.

arXiv:1607.03389•Physical Review A•Oct 13, 2016•35 citations

Quantum-Enhanced Iterative Algorithm for Monte Carlo Simulations

Jincheng Zhang

This paper introduces a novel quantum-enhanced iterative algorithm for Monte Carlo simulations. We propose a hybrid approach combining the strengths of quantum annealing and QAOA to accelerate the exploration of the solution space and improve the accuracy of results. The algorithm systematically explores the solution space, leveraging quantum fluctuations to guide the search process and mitigate the effects of local optima. We demonstrate the effectiveness of this approach through simulations across a range of problems, highlighting its potential to significantly enhance the efficiency and reliability of Monte Carlo methods. The core mechanism centers around the quantum annealing process for initial exploration and the QAOA optimization loop for refinement. This research contributes to the development of more robust and faster simulations, offering a promising step towards broader applicability in various scientific and engineering disciplines.

•Aug 31, 2026•0 citations

Simulating quantum annealing via projective quantum Monte Carlo algorithms

Estelle M. Inack

In this thesis, we implement projective quantum Monte Carlo (PQMC) methods to simulate quantum annealing on classical computers. A detailed derivation of the algorithm is presented. We show that in the regime where the systematic errors are well controlled, PQMC algorithms are indeed capable of simulating the imaginary-time dynamics of the Schroedinger equation both on continuous space models and discrete basis systems. We also demonstrate that the tunneling time of the PQMC method is quadratically faster than the one of incoherent quantum tunneling. It also shows remarkable stability when applied to frustrated systems compared to the path integral Monte Carlo algorithm, the algorithm mostly chosen to do comparisons with quantum annealers. However, a major drawback of the method comes from the finite number of random walkers needed to implement the simulations. It grows exponentially with the system size when no or poor guiding wave-functions are utilized. Nevertheless, we demonstrated that when good enough guiding wave-functions are used -- in our case we choose artificial neural networks -- the computational complexity seems to go from exponential to polynomial in the system size. We advocate for a search of more efficient guiding wave functions since they determine when and how feasible the PQMC simulations are on classical computers, a question closely related to a provable need or speed-up of a quantum computer.

•Oct 26, 2018•0 citations

Enhancing the efficiency of quantum annealing via reinforcement: A path-integral Monte Carlo simulation of the quantum reinforcement algorithm

Abolfazl Ramezanpour

The standard quantum annealing algorithm tries to approach the ground state of a classical system by slowly decreasing the hopping rates of a quantum random walk in the configuration space of the problem, where the on-site energies are provided by the classical energy function. In a quantum reinforcement algorithm, the annealing works instead by increasing gradually the strength of the on-site energies according to the probability of finding the walker on each site of the configuration space. Here, by using the path-integral Monte Carlo simulations of the quantum algorithms, we show that annealing via reinforcement can significantly enhance the success probability of the quantum walker. More precisely, we implement a local version of the quantum reinforcement algorithm, where the system wave function is replaced by an approximate wave function using the local expectation values of the system. We use this algorithm to find solutions to a prototypical constraint satisfaction problem (XORSAT) close to the satisfiability to unsatisfiability phase transition. The study is limited to small problem sizes (a few hundreds of variables), nevertheless, the numerical results suggest that quantum reinforcement may provide a useful strategy to deal with other computationally hard problems and larger problem sizes even as a classical optimization algorithm.

arXiv:1812.02569•Physical Review A•Dec 6, 2018•7 citations

Quantum-Inspired Sampling for Monte Carlo Simulations

Jincheng Zhang

Quantum-inspired sampling is a novel approach to Monte Carlo simulations that aims to overcome the limitations of traditional methods by incorporating quantum-like phenomena – specifically superposition and entanglement – into the sampling process. This paper investigates the potential of utilizing these principles to accelerate convergence, enhance accuracy, and improve the overall efficiency of Monte Carlo simulations, particularly in complex systems. We present a theoretical framework and preliminary implementation demonstrating the effectiveness of this technique. The core mechanism focuses on manipulating the probability distribution to guide the search towards promising solutions, effectively leveraging quantum-inspired dynamics.

•Sep 3, 2026•0 citations

Quantum computation of Restricted Boltzmann Machines by Monte Carlo Methods

Yunkai Yao

In recent years, the diversification of problems that require computers to solve has attracted attention to the construction of meta-heuristics that can be applied to a wide range of problems, and to specialized computers that implement these meta-heuristics in their devices. The representative meta-heuristics are Simulated Annealing (SA) and its extension to quantum computation, Quantum Annealing (QA), and its path-integral Monte Carlo method for classical simulation Crosson and Harrow showed that for certain problems where QA outperformed SA, SQA achieved performance close to that of QA, and SQA sometimes outperformed SA by an exponential time factor. On the other hand, it remains unclear whether SQA can work efficiently on a wide range of other problems. In this study, we experimentally compared SA and SQA on instances of the restricted Boltzmann machine RBM, known as a fundamental building block in deep learning, and 3SAT, a fundamental combinatorial optimization problem. The results show that SQA gives slightly better solutions than SA as the problem size increases for RBM in terms of both accuracy and computation time in our setting, but the opposite trend is observed for 3SAT, indicating that there is no significant difference between the two methods. From the viewpoint of artificial intelligence research, it is necessary to further examine whether deep learning can be made more efficient by applying QA and SQA to RBM.

Highlights in Science Engineering and Technology•Sep 30, 2022•0 citations
In this paper we introduce and formalize Substochastic Monte Carlo (SSMC) algorithms. These algorithms, originally intended to be a better classical foil to quantum annealing than simulated annealing, prove to be worthy optimization algorithms in their own right. In SSMC, a population of walkers is initialized according to a known distribution on an arbitrary search space and varied into the solution of some optimization problem of interest. The first argument of this paper shows how an existing classical algorithm, "Go-With-The-Winners" (GWW), is a limiting case of SSMC when restricted to binary search and particular driving dynamics. Although limiting to GWW, SSMC is more general. We show that (1) GWW can be efficiently simulated within the SSMC framework, (2) SSMC can be exponentially faster than GWW, (3) by naturally incorporating structural information, SSMC can exponentially outperform the quantum algorithm that first inspired it, and (4) SSMC exhibits desirable search features in general spaces. Our approach combines ideas from genetic algorithms (GWW), theoretical probability (Fleming-Viot processes), and quantum computing. Not only do we demonstrate that SSMC is often more efficient than competing algorithms, but we also hope that our results connecting these disciplines will impact each independently. An implemented version of SSMC has previously enjoyed some success as a competitive optimization algorithm for Max-kkk-SAT.
Most experimental and theoretical studies of adiabatic optimization use stoquastic Hamiltonians, whose ground states are expressible using only real nonnegative amplitudes. This raises a question as to whether classical Monte Carlo methods can simulate stoquastic adiabatic algorithms with polynomial overhead. Here we analyze diffusion Monte Carlo algorithms. We argue that, based on differences between L1{L}_{1}L1​ and L2{L}_{2}L2​ normalized states, these algorithms suffer from certain obstructions preventing them from efficiently simulating stoquastic adiabatic evolution in generality. In practice however, we obtain good performance by introducing a method that we call Substochastic Monte Carlo. In fact, our simulations are good classical optimization algorithms in their own right, competitive with the best previously known heuristic solvers for MAX-kkk-SAT at k=2,3,4k=2,3,4k=2,3,4.
This paper introduces a novel quantum-enhanced iterative algorithm for Monte Carlo simulations. We propose a hybrid approach combining the strengths of quantum annealing and QAOA to accelerate the exploration of the solution space and improve the accuracy of results. The algorithm systematically explores the solution space, leveraging quantum fluctuations to guide the search process and mitigate the effects of local optima. We demonstrate the effectiveness of this approach through simulations across a range of problems, highlighting its potential to significantly enhance the efficiency and reliability of Monte Carlo methods. The core mechanism centers around the quantum annealing process for initial exploration and the QAOA optimization loop for refinement. This research contributes to the development of more robust and faster simulations, offering a promising step towards broader applicability in various scientific and engineering disciplines.
In this thesis, we implement projective quantum Monte Carlo (PQMC) methods to simulate quantum annealing on classical computers. A detailed derivation of the algorithm is presented. We show that in the regime where the systematic errors are well controlled, PQMC algorithms are indeed capable of simulating the imaginary-time dynamics of the Schroedinger equation both on continuous space models and discrete basis systems. We also demonstrate that the tunneling time of the PQMC method is quadratically faster than the one of incoherent quantum tunneling. It also shows remarkable stability when applied to frustrated systems compared to the path integral Monte Carlo algorithm, the algorithm mostly chosen to do comparisons with quantum annealers. However, a major drawback of the method comes from the finite number of random walkers needed to implement the simulations. It grows exponentially with the system size when no or poor guiding wave-functions are utilized. Nevertheless, we demonstrated that when good enough guiding wave-functions are used -- in our case we choose artificial neural networks -- the computational complexity seems to go from exponential to polynomial in the system size. We advocate for a search of more efficient guiding wave functions since they determine when and how feasible the PQMC simulations are on classical computers, a question closely related to a provable need or speed-up of a quantum computer.
The standard quantum annealing algorithm tries to approach the ground state of a classical system by slowly decreasing the hopping rates of a quantum random walk in the configuration space of the problem, where the on-site energies are provided by the classical energy function. In a quantum reinforcement algorithm, the annealing works instead by increasing gradually the strength of the on-site energies according to the probability of finding the walker on each site of the configuration space. Here, by using the path-integral Monte Carlo simulations of the quantum algorithms, we show that annealing via reinforcement can significantly enhance the success probability of the quantum walker. More precisely, we implement a local version of the quantum reinforcement algorithm, where the system wave function is replaced by an approximate wave function using the local expectation values of the system. We use this algorithm to find solutions to a prototypical constraint satisfaction problem (XORSAT) close to the satisfiability to unsatisfiability phase transition. The study is limited to small problem sizes (a few hundreds of variables), nevertheless, the numerical results suggest that quantum reinforcement may provide a useful strategy to deal with other computationally hard problems and larger problem sizes even as a classical optimization algorithm.
Quantum-inspired sampling is a novel approach to Monte Carlo simulations that aims to overcome the limitations of traditional methods by incorporating quantum-like phenomena – specifically superposition and entanglement – into the sampling process. This paper investigates the potential of utilizing these principles to accelerate convergence, enhance accuracy, and improve the overall efficiency of Monte Carlo simulations, particularly in complex systems. We present a theoretical framework and preliminary implementation demonstrating the effectiveness of this technique. The core mechanism focuses on manipulating the probability distribution to guide the search towards promising solutions, effectively leveraging quantum-inspired dynamics.
In recent years, the diversification of problems that require computers to solve has attracted attention to the construction of meta-heuristics that can be applied to a wide range of problems, and to specialized computers that implement these meta-heuristics in their devices. The representative meta-heuristics are Simulated Annealing (SA) and its extension to quantum computation, Quantum Annealing (QA), and its path-integral Monte Carlo method for classical simulation Crosson and Harrow showed that for certain problems where QA outperformed SA, SQA achieved performance close to that of QA, and SQA sometimes outperformed SA by an exponential time factor. On the other hand, it remains unclear whether SQA can work efficiently on a wide range of other problems. In this study, we experimentally compared SA and SQA on instances of the restricted Boltzmann machine RBM, known as a fundamental building block in deep learning, and 3SAT, a fundamental combinatorial optimization problem. The results show that SQA gives slightly better solutions than SA as the problem size increases for RBM in terms of both accuracy and computation time in our setting, but the opposite trend is observed for 3SAT, indicating that there is no significant difference between the two methods. From the viewpoint of artificial intelligence research, it is necessary to further examine whether deep learning can be made more efficient by applying QA and SQA to RBM.