Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1905.00995 · Journal of Chemical Theory and Computation

Beyond Walkers in Stochastic Quantum Chemistry: Reducing Error Using Fast Randomized Iteration

Samuel M. Greene, Robert J. Webber, Jonathan Weare, Timothy C. Berkelbach

Published Aug 7, 2019• 25 citations
arXivHTMLPDF

Abstract

We introduce a family of methods for the full configuration interaction problem in quantum chemistry, based on the fast randomized iteration (FRI) framework [Lim, L.-H.; Weare, J. SIAM Rev. 2017, 59, 547; DOI: 10.1137/15M1040827 ]. These methods, which we term “FCI-FRI”, stochastically impose sparsity during iterations of the power method and can be viewed as a generalization of full configuration interaction quantum Monte Carlo (FCIQMC) without walkers. In addition to the multinomial scheme commonly used to sample excitations in FCIQMC, we present a systematic scheme where excitations are not sampled independently. Performing ground-state calculations on five small molecules at fixed cost, we find that the systematic FCI-FRI scheme is 11–45 times more statistically efficient than the multinomial FCI-FRI scheme, which is in turn 1.4–178 times more statistically efficient than the original FCIQMC algorithm.

DOI
10.1021/acs.jctc.9b00422

Related papers

Improved Fast Randomized Iteration Approach to Full Configuration Interaction

Samuel M. Greene, Robert J. Webber, Jonathan Weare +1 more

We present three modifications to our recently introduced fast randomized iteration method for full configuration interaction (FCI-FRI) and investigate their effects on the method’s performance for Ne, H 2 O, and N 2 . The initiator approximation, originally developed for full configuration interaction quantum Monte Carlo, significantly reduces statistical error in FCI-FRI when few samples are used in compression operations, enabling its application to larger chemical systems. The semistochastic extension, which involves exactly preserving a fixed subset of elements in each compression, improves statistical efficiency in some cases but reduces it in others. We also developed a new approach to sampling excitations that yields consistent improvements in statistical efficiency and reductions in computational cost. We discuss possible strategies based on our findings for improving the performance of stochastic quantum chemistry methods more generally.

arXiv:2005.00654•Journal of Chemical Theory and Computation•Jul 22, 2020•14 citations

Full configuration interaction quantum Monte Carlo for accurate $\textit{ab initio}$ nuclear structure calculations: algorithms and calculation details

Rongzhe Hu, Furong Xu, Baishan Hu +1 more

Full configuration interaction quantum Monte Carlo (FCIQMC) is a stochastic many-body solver that has been widely applied to electronic, molecular, and condensed-matter systems. In this work we apply FCIQMC to $\textit{ab initio}$ nuclear structure calculations using interactions derived from chiral effective field theory. We describe the algorithm in detail, including imaginary-time propagation, excitation generation, estimator choices, the initiator approximation with adaptive shift correction, and reduced-density-matrix (RDM) sampling. Benchmark calculations in small model spaces, where deterministic full configuration interaction (FCI) results are available, validate the stochastic calculation of energies, radii, and RDM-based pure estimators. For large model spaces, we analyze the residual finite-walker bias through systematic walker-number convergence and infinite-walker extrapolations. We also demonstrate that FCIQMC can be extended beyond ground-state calculations by computing the low-lying spectrum of $^6$Li.

arXiv:2607.05525•Jul 6, 2026•0 citations

Full Configuration Interaction Excited-State Energies in Large Active Spaces from Subspace Iteration with Repeated Random Sparsification

Samuel M. Greene, Robert J. Webber, James E. T. Smith +2 more

We present a stable and systematically improvable quantum Monte Carlo (QMC) approach to calculating excited-state energies, which we implement using our fast randomized iteration method for the full configuration interaction problem (FCI-FRI). Unlike previous excited-state quantum Monte Carlo methods, our approach, which is based on an asymmetric variant of subspace iteration, avoids the use of dot products of random vectors and instead relies upon trial vectors to maintain orthogonality and estimate eigenvalues. By leveraging recent advances, we apply our method to calculate ground- and excited-state energies of challenging molecular systems in large active spaces, including the carbon dimer with 8 electrons in 108 orbitals (8e,108o), an oxo-Mn(salen) transition metal complex (28e,28o), ozone (18e,87o), and butadiene (22e,82o). In the majority of these test cases, our approach yields total excited-state energies that agree with those from state-of-the-art methods─including heat-bath CI, the density matrix renormalization group approach, and FCIQMC─to within sub-milliHartree accuracy. In all cases, estimated excitation energies agree to within about 0.1 eV.

arXiv:2201.12164•Journal of Chemical Theory and Computation•Nov 8, 2022•5 citations

An explicitly correlated approach to basis set incompleteness in full configuration interaction quantum Monte Carlo

George H. Booth, Deidre M. Cleland, Ali Alavi +1 more

By performing a stochastic dynamic in a space of Slater determinants, the full configuration interaction quantum Monte Carlo (FCIQMC) method has been able to obtain energies which are essentially free from systematic error to the basis set correlation energy, within small and systematically improvable error bars. However, the weakly exponential scaling with basis size makes converging the energy with respect to basis set costly and in larger systems, impossible. To ameliorate these basis set issues, here we use perturbation theory to couple the FCIQMC wavefunction to an explicitly correlated strongly orthogonal basis of geminals, following the [2](R12) approach of Valeev et al. The required one- and two-particle density matrices are computed on-the-fly during the FCIQMC dynamic, using a sampling procedure which incurs relatively little additional computation expense. The F12 energy corrections are shown to converge rapidly as a function of sampling, both in imaginary time and number of walkers. Our pilot calculations on the binding curve for the carbon dimer, which exhibits strong correlation effects as well as substantial basis set dependence, demonstrate that the accuracy of the FCIQMC-F12 method surpasses that of all previous FCIQMC calculations, and that the F12 correction improves results equivalent to increasing the quality of the one-electron basis by two cardinal numbers.

arXiv:1208.0980•The Journal of Chemical Physics•Oct 28, 2012•61 citations

Semi-stochastic full configuration interaction quantum Monte Carlo: Developments and application

Nick S. Blunt, Simon D. Smart, J. A. F. Kersten +3 more

We expand upon the recent semi-stochastic adaptation to full configuration interaction quantum Monte Carlo (FCIQMC). We present an alternate method for generating the deterministic space without a priori knowledge of the wave function and present stochastic efficiencies for a variety of both molecular and lattice systems. The algorithmic details of an efficient semi-stochastic implementation are presented, with particular consideration given to the effect that the adaptation has on parallel performance in FCIQMC. We further demonstrate the benefit for calculation of reduced density matrices in FCIQMC through replica sampling, where the semi-stochastic adaptation seems to have even larger efficiency gains. We then combine these ideas to produce explicitly correlated corrected FCIQMC energies for the beryllium dimer, for which stochastic errors on the order of wavenumber accuracy are achievable.

arXiv:1502.04847•The Journal of Chemical Physics•May 14, 2015•102 citations

Investigating quantum Monte Carlo methods in Slater determinant bases

W. A. Vigor

In this thesis we investigate the recently developed Full Configuration Interaction Quantum Monte Carlo (FCIQMC) method. This method, unlike the traditional methods in Quantum Monte Carlo (QMC), doesn’t require the use of the uncontrolled fixed node approximation and so potentially it can yield far more accurate results. This means that it can be thought of as a hybrid between the methods used by quantum chemists and QMC, and thus has spawned a new field of stochastic quantum chemistry. The work described in this thesis can be split into three distinct but interrelated parts. We begin with an investigation of the underlying FCIQMC stochastic process. We show that FCIQMC is an example of Markov Chain Monte Carlo. This means we can compute a stochastic matrix from which all details about the Monte-Carlo simulation can be obtained. Unfortunately the size of the space scales unfavourably as a function of system size meaning that we have only managed to compute the matrix for the smallest interesting two determinant system. We then use these results to quantify population control bias in FCIQMC for a two determinant system supplementing these analytical results with empirical results to investigate more realistic systems. We then attempt to quantify the efficiency of the FCIQMC algorithms, defining a measure of efficiency. After this we investigate the dependence of our measure on the system size. The error bar of the most efficient FCIQMC algorithm will decay fastest as a function of computer time. We then draw conclusions about the applicability of the FCIQMC method. Finally we describe an implementation of FCIQMC on a novel data flow computer architecture. In our implementation we made a modification to the FCIQMC algorithm to fit the data flow paradigm. We investigate the efficiency of the modified FCIQMC algorithm.

•Jun 1, 2015•1 citation
We introduce a family of methods for the full configuration interaction problem in quantum chemistry, based on the fast randomized iteration (FRI) framework [Lim, L.-H.; Weare, J. SIAM Rev. 2017, 59, 547; DOI: 10.1137/15M1040827 ]. These methods, which we term “FCI-FRI”, stochastically impose sparsity during iterations of the power method and can be viewed as a generalization of full configuration interaction quantum Monte Carlo (FCIQMC) without walkers. In addition to the multinomial scheme commonly used to sample excitations in FCIQMC, we present a systematic scheme where excitations are not sampled independently. Performing ground-state calculations on five small molecules at fixed cost, we find that the systematic FCI-FRI scheme is 11–45 times more statistically efficient than the multinomial FCI-FRI scheme, which is in turn 1.4–178 times more statistically efficient than the original FCIQMC algorithm.
We present three modifications to our recently introduced fast randomized iteration method for full configuration interaction (FCI-FRI) and investigate their effects on the method’s performance for Ne, H 2 O, and N 2 . The initiator approximation, originally developed for full configuration interaction quantum Monte Carlo, significantly reduces statistical error in FCI-FRI when few samples are used in compression operations, enabling its application to larger chemical systems. The semistochastic extension, which involves exactly preserving a fixed subset of elements in each compression, improves statistical efficiency in some cases but reduces it in others. We also developed a new approach to sampling excitations that yields consistent improvements in statistical efficiency and reductions in computational cost. We discuss possible strategies based on our findings for improving the performance of stochastic quantum chemistry methods more generally.
Full configuration interaction quantum Monte Carlo for accurate ab initio\textit{ab initio}ab initio nuclear structure calculations: algorithms and calculation details
Full configuration interaction quantum Monte Carlo (FCIQMC) is a stochastic many-body solver that has been widely applied to electronic, molecular, and condensed-matter systems. In this work we apply FCIQMC to ab initio\textit{ab initio}ab initio nuclear structure calculations using interactions derived from chiral effective field theory. We describe the algorithm in detail, including imaginary-time propagation, excitation generation, estimator choices, the initiator approximation with adaptive shift correction, and reduced-density-matrix (RDM) sampling. Benchmark calculations in small model spaces, where deterministic full configuration interaction (FCI) results are available, validate the stochastic calculation of energies, radii, and RDM-based pure estimators. For large model spaces, we analyze the residual finite-walker bias through systematic walker-number convergence and infinite-walker extrapolations. We also demonstrate that FCIQMC can be extended beyond ground-state calculations by computing the low-lying spectrum of 6^66Li.
We present a stable and systematically improvable quantum Monte Carlo (QMC) approach to calculating excited-state energies, which we implement using our fast randomized iteration method for the full configuration interaction problem (FCI-FRI). Unlike previous excited-state quantum Monte Carlo methods, our approach, which is based on an asymmetric variant of subspace iteration, avoids the use of dot products of random vectors and instead relies upon trial vectors to maintain orthogonality and estimate eigenvalues. By leveraging recent advances, we apply our method to calculate ground- and excited-state energies of challenging molecular systems in large active spaces, including the carbon dimer with 8 electrons in 108 orbitals (8e,108o), an oxo-Mn(salen) transition metal complex (28e,28o), ozone (18e,87o), and butadiene (22e,82o). In the majority of these test cases, our approach yields total excited-state energies that agree with those from state-of-the-art methods─including heat-bath CI, the density matrix renormalization group approach, and FCIQMC─to within sub-milliHartree accuracy. In all cases, estimated excitation energies agree to within about 0.1 eV.
By performing a stochastic dynamic in a space of Slater determinants, the full configuration interaction quantum Monte Carlo (FCIQMC) method has been able to obtain energies which are essentially free from systematic error to the basis set correlation energy, within small and systematically improvable error bars. However, the weakly exponential scaling with basis size makes converging the energy with respect to basis set costly and in larger systems, impossible. To ameliorate these basis set issues, here we use perturbation theory to couple the FCIQMC wavefunction to an explicitly correlated strongly orthogonal basis of geminals, following the [2](R12) approach of Valeev et al. The required one- and two-particle density matrices are computed on-the-fly during the FCIQMC dynamic, using a sampling procedure which incurs relatively little additional computation expense. The F12 energy corrections are shown to converge rapidly as a function of sampling, both in imaginary time and number of walkers. Our pilot calculations on the binding curve for the carbon dimer, which exhibits strong correlation effects as well as substantial basis set dependence, demonstrate that the accuracy of the FCIQMC-F12 method surpasses that of all previous FCIQMC calculations, and that the F12 correction improves results equivalent to increasing the quality of the one-electron basis by two cardinal numbers.
We expand upon the recent semi-stochastic adaptation to full configuration interaction quantum Monte Carlo (FCIQMC). We present an alternate method for generating the deterministic space without a priori knowledge of the wave function and present stochastic efficiencies for a variety of both molecular and lattice systems. The algorithmic details of an efficient semi-stochastic implementation are presented, with particular consideration given to the effect that the adaptation has on parallel performance in FCIQMC. We further demonstrate the benefit for calculation of reduced density matrices in FCIQMC through replica sampling, where the semi-stochastic adaptation seems to have even larger efficiency gains. We then combine these ideas to produce explicitly correlated corrected FCIQMC energies for the beryllium dimer, for which stochastic errors on the order of wavenumber accuracy are achievable.
In this thesis we investigate the recently developed Full Configuration Interaction Quantum Monte Carlo (FCIQMC) method. This method, unlike the traditional methods in Quantum Monte Carlo (QMC), doesn’t require the use of the uncontrolled fixed node approximation and so potentially it can yield far more accurate results. This means that it can be thought of as a hybrid between the methods used by quantum chemists and QMC, and thus has spawned a new field of stochastic quantum chemistry. The work described in this thesis can be split into three distinct but interrelated parts. We begin with an investigation of the underlying FCIQMC stochastic process. We show that FCIQMC is an example of Markov Chain Monte Carlo. This means we can compute a stochastic matrix from which all details about the Monte-Carlo simulation can be obtained. Unfortunately the size of the space scales unfavourably as a function of system size meaning that we have only managed to compute the matrix for the smallest interesting two determinant system. We then use these results to quantify population control bias in FCIQMC for a two determinant system supplementing these analytical results with empirical results to investigate more realistic systems. We then attempt to quantify the efficiency of the FCIQMC algorithms, defining a measure of efficiency. After this we investigate the dependence of our measure on the system size. The error bar of the most efficient FCIQMC algorithm will decay fastest as a function of computer time. We then draw conclusions about the applicability of the FCIQMC method. Finally we describe an implementation of FCIQMC on a novel data flow computer architecture. In our implementation we made a modification to the FCIQMC algorithm to fit the data flow paradigm. We investigate the efficiency of the modified FCIQMC algorithm.