Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2502.19576 · Physical Review Research

First- and quasi-second-order optimization algorithms in variational Monte Carlo

Ruojing Peng, Garnet Kin‐Lic Chan

Published Dec 7, 2025• 4 citations
arXivHTMLPDF

Abstract

Many quantum many-body wavefunctions, such as Jastrow-Slater, tensor network, and neural quantum states, are studied with the variational Monte Carlo technique, where stochastic optimization is usually performed to obtain a faithful approximation to the ground state of a given Hamiltonian. While first-order gradient descent methods are commonly used for such optimizations, quasi-second-order optimization formulations offer the potential of faster convergence under certain theoretical conditions, but with a similar cost per sample to first-order methods. However, the relative performance of first- and second-order optimizers is influenced in practice by many factors, including the sampling requirements for a faithful optimization step, the influence of wavefunction quality, as well as the wavefunction parametrization and expressivity. Here, we analyze these performance characteristics of first- and quasi-second-order optimization methods for a variety of Hamiltonians, with the additional context of understanding the scaling of these methods (for good performance) as a function of system size. Our findings help clarify the role of first- and quasi-second-order methods in variational Monte Carlo calculations and the conditions under which they should respectively be used. In particular, we find that unlike in deterministic optimization, where closeness to the variational minimum determines the suitability of second-order methods, in stochastic optimization the main factor is the overall expressivity of the wavefunction: Quasi-second-order methods lead to an overall reduction in cost relative to first-order methods when the wavefunction is sufficiently expressive to represent the ground state, even when starting far away from the ground state. This makes quasi-second-order methods an important technique when used with wavefunctions with arbitrarily improvable accuracy.

DOI
10.1103/r7c3-zq4b

Related papers

Optimization of neural network wave functions in variational Monte Carlo

Yuyang Wang, Xin Liu

The central challenge in materials science and quantum chemistry is solving the electronic Schrodinger equation, complicated by the curse of dimensionality as system size grows. Neural network-based variational Monte Carlo (NN-VMC) offers a promising path forward, achieving unprecedented accuracy at far lower cost than traditional high-level methods. However, the flexibility of neural network wavefunctions introduces a bottleneck: their optimization is high-dimensional, stochastic, and non-convex. This Perspective reviews the evolution of optimization methods in NN-VMC, from stochastic reconfiguration to approximate second-order algorithms and geometric insights. We highlight key challenges currently limiting scalability and efficiency, and outline future opportunities to advance the field. With continued progress in optimization, neural network techniques, and computer architectures, NN-VMC can tackle larger and more complex quantum systems and move from trailing experiments to guiding them.

The Innovation Informatics•Nov 27, 2025•1 citation

Neural network quantum state with proximal optimization: a ground-state searching scheme based on variational Monte Carlo

Feng Chen, Ming Xue

Neural network quantum states (NQS), incorporating with variational Monte Carlo (VMC) method, are shown to be a promising way to investigate quantum many-body physics. Whereas vanilla VMC methods perform one gradient update per sample, we introduce a novel objective function with proximal optimization (PO) that enables multiple updates via reusing the mismatched samples. Our VMC-PO method keeps the advantage of the previous importance sampling gradient optimization algorithm [L. Yang, {\it et al}, Phys. Rev. Research {\bf 2}, 012039(R)(2020)] that efficiently uses sampled states. PO mitigates the numerical instabilities during network updates, which is similar to stochastic reconfiguration (SR) methods, but achieves an alternative and simpler implement with lower computational complexity. We investigate the performance of our VMC-PO algorithm for ground-state searching with a 1-dimensional transverse-field Ising model and 2-dimensional Heisenberg antiferromagnet on a square lattice, and demonstrate that the reached ground-state energies are comparable to state-of-the-art results.

arXiv:2210.16493•Oct 29, 2022•2 citations

Complementary first and second derivative methods for ansatz optimization in variational Monte Carlo

Leon Otis, Eric Neuscamman

We present a comparison between a number of recently introduced low-memory wave function optimization methods for variational Monte Carlo in which we find that first and second derivative methods possess strongly complementary relative advantages. While we find that low-memory variants of the linear method are vastly more efficient at bringing wave functions with disparate types of nonlinear parameters to the vicinity of the energy minimum, accelerated descent approaches are then able to locate the precise minimum with less bias and lower statistical uncertainty. By constructing a simple hybrid approach that combines these methodologies, we show that all of these advantages can be had at once when simultaneously optimizing large determinant expansions, molecular orbital shapes, traditional Jastrow correlation factors, and more nonlinear many-electron Jastrow factors.

arXiv:1904.10087•Physical Chemistry Chemical Physics•Jan 1, 2019•23 citations

Variational Monte Carlo

Richard M. Martin, Lucia Reining, David M. Ceperley

Since the form of PN is the same as that occurring in the statistical mechanics of the classical gas (replace f 2 ( r ij ) by exp[- V ( r ij /kT ]), we can use the same integration techniques that are used in the classical problem. W. L. McMillan, 1965 Summary Building on the random walk methods developed in the previous chapter, we show how to compute properties of many-body trial wavefunctions using a random walk. This method, called variational Monte Carlo, is the simplest stochastic quantum many-body technique. Whereas mean-field methods are usually limited to single determinants, variational Monte Carlo can treat any correlated trial function, as long as its values are computable. We discuss how to optimize such trial wavefunctions, how to compute their momentum distribution, how to use non-local pseudopotentials, how to compute excited states, and how to correct for the finite size of the simulation cell. Deterministic quantum methods have difficulties. For example, the Hartree–Fock method assumes the wavefunction is a single Slater determinant, neglecting correlation. If one expands as a sum of determinants, it is very difficult to have the results size-consistent since the number of determinants needed will grow exponentially with the system size. As we have seen, the DMFT method introduced in Ch. 16 assumes locality. In Ch. 6 we discussed general properties of many-body wavefunctions. Using Monte Carlo methods, we can directly incorporate correlation into a wavefunction, without having to make any further approximations other than the form of the correlation factors. In many cases the energy and other properties are very close to the exact results. Some of the usual restrictions on the form of the many-body wavefunction are not an issue in variational Monte Carlo. The most important generalization of the HF wavefunction is to put correlation directly into the wavefunction via the “Jastrow” factor. At next order, one can use the “backflow” wavefunction, in which correlation is also built into the determinant. The variational Monte Carlo method (VMC) was first used by McMillan [44] to calculate the ground-state properties of superfluid 4 He. One of the key problems at that time was whether the observed superfluid properties were a consequence of Bose condensation.

Cambridge University Press eBooks•May 31, 2016•3 citations

Second-order optimization strategies for neural network quantum states

M. Drissi, J. W. T. Keeble, J. Rozalén Sarmiento +1 more

The Variational Monte Carlo (VMC) method has recently seen important advances through the use of neural network quantum states. While more and more sophisticated ansatze have been designed to tackle a wide variety of quantum many-body problems, modest progress has been made on the associated optimization algorithms. In this work, we revisit the Kronecker-Factored Approximate Curvature (KFAC), an optimizer that has been used extensively in a variety of simulations. We suggest improvements in the scaling and the direction of this optimizer and find that they substantially increase its performance at a negligible additional cost. We also reformulate the VMC approach in a game theory framework, to propose a novel optimizer based on decision geometry. We find that on a practical test case for continuous systems, this new optimizer consistently outperforms any of the KFAC improvements in terms of stability, accuracy and speed of convergence. Beyond VMC, the versatility of this approach suggests that decision geometry could provide a solid foundation for accelerating a broad class of machine learning algorithms. This article is part of the theme issue 'The liminal position of Nuclear Physics: from hadrons to neutron stars'.

arXiv:2401.17550•Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences•Jun 24, 2024•9 citations

Looking elsewhere: improving variational Monte Carlo gradients by importance sampling

Antoine Misery, Luca Gravina, Alessandro Santini +1 more

Abstract Neural-network quantum states (NQSs) offer a powerful and expressive ansatz for representing quantum many-body wave functions. However, their training via Variational Monte Carlo (VMC) methods remains challenging. It is well known that some scenarios—such as sharply peaked wave functions emerging in quantum chemistry—lead to high-variance gradient estimators hindering the effectiveness of variational optimizations. In this work we investigate a systematic strategy to tackle those sampling issues by means of adaptively tuned importance sampling. Our approach is explicitly designed to target the gradient estimator instead of the loss function, and be computationally inexpensive. We benchmarked our approach across the ground-state search of a wide variety of hamiltonians, including frustrated spin systems and ab-initio quantum chemistry. Overall, our approach can reduce the computational cost of vanilla VMC considerably, up to a factor of 100× when targeting highly peaked quantum chemistry wavefunctions.

arXiv:2507.05352•Machine Learning Science and Technology•Jan 14, 2026•15 citations
Many quantum many-body wavefunctions, such as Jastrow-Slater, tensor network, and neural quantum states, are studied with the variational Monte Carlo technique, where stochastic optimization is usually performed to obtain a faithful approximation to the ground state of a given Hamiltonian. While first-order gradient descent methods are commonly used for such optimizations, quasi-second-order optimization formulations offer the potential of faster convergence under certain theoretical conditions, but with a similar cost per sample to first-order methods. However, the relative performance of first- and second-order optimizers is influenced in practice by many factors, including the sampling requirements for a faithful optimization step, the influence of wavefunction quality, as well as the wavefunction parametrization and expressivity. Here, we analyze these performance characteristics of first- and quasi-second-order optimization methods for a variety of Hamiltonians, with the additional context of understanding the scaling of these methods (for good performance) as a function of system size. Our findings help clarify the role of first- and quasi-second-order methods in variational Monte Carlo calculations and the conditions under which they should respectively be used. In particular, we find that unlike in deterministic optimization, where closeness to the variational minimum determines the suitability of second-order methods, in stochastic optimization the main factor is the overall expressivity of the wavefunction: Quasi-second-order methods lead to an overall reduction in cost relative to first-order methods when the wavefunction is sufficiently expressive to represent the ground state, even when starting far away from the ground state. This makes quasi-second-order methods an important technique when used with wavefunctions with arbitrarily improvable accuracy.
The central challenge in materials science and quantum chemistry is solving the electronic Schrodinger equation, complicated by the curse of dimensionality as system size grows. Neural network-based variational Monte Carlo (NN-VMC) offers a promising path forward, achieving unprecedented accuracy at far lower cost than traditional high-level methods. However, the flexibility of neural network wavefunctions introduces a bottleneck: their optimization is high-dimensional, stochastic, and non-convex. This Perspective reviews the evolution of optimization methods in NN-VMC, from stochastic reconfiguration to approximate second-order algorithms and geometric insights. We highlight key challenges currently limiting scalability and efficiency, and outline future opportunities to advance the field. With continued progress in optimization, neural network techniques, and computer architectures, NN-VMC can tackle larger and more complex quantum systems and move from trailing experiments to guiding them.
Neural network quantum states (NQS), incorporating with variational Monte Carlo (VMC) method, are shown to be a promising way to investigate quantum many-body physics. Whereas vanilla VMC methods perform one gradient update per sample, we introduce a novel objective function with proximal optimization (PO) that enables multiple updates via reusing the mismatched samples. Our VMC-PO method keeps the advantage of the previous importance sampling gradient optimization algorithm [L. Yang, {\it et al}, Phys. Rev. Research {\bf 2}, 012039(R)(2020)] that efficiently uses sampled states. PO mitigates the numerical instabilities during network updates, which is similar to stochastic reconfiguration (SR) methods, but achieves an alternative and simpler implement with lower computational complexity. We investigate the performance of our VMC-PO algorithm for ground-state searching with a 1-dimensional transverse-field Ising model and 2-dimensional Heisenberg antiferromagnet on a square lattice, and demonstrate that the reached ground-state energies are comparable to state-of-the-art results.
We present a comparison between a number of recently introduced low-memory wave function optimization methods for variational Monte Carlo in which we find that first and second derivative methods possess strongly complementary relative advantages. While we find that low-memory variants of the linear method are vastly more efficient at bringing wave functions with disparate types of nonlinear parameters to the vicinity of the energy minimum, accelerated descent approaches are then able to locate the precise minimum with less bias and lower statistical uncertainty. By constructing a simple hybrid approach that combines these methodologies, we show that all of these advantages can be had at once when simultaneously optimizing large determinant expansions, molecular orbital shapes, traditional Jastrow correlation factors, and more nonlinear many-electron Jastrow factors.
Since the form of PN is the same as that occurring in the statistical mechanics of the classical gas (replace f 2 ( r ij ) by exp[- V ( r ij /kT ]), we can use the same integration techniques that are used in the classical problem. W. L. McMillan, 1965 Summary Building on the random walk methods developed in the previous chapter, we show how to compute properties of many-body trial wavefunctions using a random walk. This method, called variational Monte Carlo, is the simplest stochastic quantum many-body technique. Whereas mean-field methods are usually limited to single determinants, variational Monte Carlo can treat any correlated trial function, as long as its values are computable. We discuss how to optimize such trial wavefunctions, how to compute their momentum distribution, how to use non-local pseudopotentials, how to compute excited states, and how to correct for the finite size of the simulation cell. Deterministic quantum methods have difficulties. For example, the Hartree–Fock method assumes the wavefunction is a single Slater determinant, neglecting correlation. If one expands as a sum of determinants, it is very difficult to have the results size-consistent since the number of determinants needed will grow exponentially with the system size. As we have seen, the DMFT method introduced in Ch. 16 assumes locality. In Ch. 6 we discussed general properties of many-body wavefunctions. Using Monte Carlo methods, we can directly incorporate correlation into a wavefunction, without having to make any further approximations other than the form of the correlation factors. In many cases the energy and other properties are very close to the exact results. Some of the usual restrictions on the form of the many-body wavefunction are not an issue in variational Monte Carlo. The most important generalization of the HF wavefunction is to put correlation directly into the wavefunction via the “Jastrow” factor. At next order, one can use the “backflow” wavefunction, in which correlation is also built into the determinant. The variational Monte Carlo method (VMC) was first used by McMillan [44] to calculate the ground-state properties of superfluid 4 He. One of the key problems at that time was whether the observed superfluid properties were a consequence of Bose condensation.
The Variational Monte Carlo (VMC) method has recently seen important advances through the use of neural network quantum states. While more and more sophisticated ansatze have been designed to tackle a wide variety of quantum many-body problems, modest progress has been made on the associated optimization algorithms. In this work, we revisit the Kronecker-Factored Approximate Curvature (KFAC), an optimizer that has been used extensively in a variety of simulations. We suggest improvements in the scaling and the direction of this optimizer and find that they substantially increase its performance at a negligible additional cost. We also reformulate the VMC approach in a game theory framework, to propose a novel optimizer based on decision geometry. We find that on a practical test case for continuous systems, this new optimizer consistently outperforms any of the KFAC improvements in terms of stability, accuracy and speed of convergence. Beyond VMC, the versatility of this approach suggests that decision geometry could provide a solid foundation for accelerating a broad class of machine learning algorithms. This article is part of the theme issue 'The liminal position of Nuclear Physics: from hadrons to neutron stars'.
Abstract Neural-network quantum states (NQSs) offer a powerful and expressive ansatz for representing quantum many-body wave functions. However, their training via Variational Monte Carlo (VMC) methods remains challenging. It is well known that some scenarios—such as sharply peaked wave functions emerging in quantum chemistry—lead to high-variance gradient estimators hindering the effectiveness of variational optimizations. In this work we investigate a systematic strategy to tackle those sampling issues by means of adaptively tuned importance sampling. Our approach is explicitly designed to target the gradient estimator instead of the loss function, and be computationally inexpensive. We benchmarked our approach across the ground-state search of a wide variety of hamiltonians, including frustrated spin systems and ab-initio quantum chemistry. Overall, our approach can reduce the computational cost of vanilla VMC considerably, up to a factor of 100× when targeting highly peaked quantum chemistry wavefunctions.