Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1808.05093 · Journal of Chemical Theory and Computation

Exciting Determinants in Quantum Monte Carlo: Loading the Dice with Fast, Low-Memory Weights

Verena A. Neufeld, Alex J. W. Thom

Published Oct 25, 2018• 29 citations
arXivHTMLPDF

Abstract

High-quality excitation generators are crucial to the effectiveness of coupled cluster Monte Carlo (CCMC) and full configuration interaction Quantum Monte Carlo (FCIQMC) calculations. The heat bath sampling of Holmes et al. [Holmes, A. A.; Changlani, H. J.; Umrigar, C. J. J. Chem. Theory Comput. 2016, 12, 1561-1571.] dramatically increases the efficiency of the spawn step of such algorithms but requires memory storage scaling quartically with system size which can be prohibitive for large systems. Alternatively, Alavi et al. [Smart, S. D.; Booth, G. H.; Alavi, A. Unpublished results.] approximated these weights with weights based on Cauchy-Schwarz-like inequalities calculated on-the-fly. While reducing the memory cost, this algorithm scales linearly in system size computationally. We combine both of these ideas with the single-reference nature of many systems studied and introduce a spawn-sampling algorithm that has low memory requirements (quadratic in basis set size) compared to the heat bath algorithm and only scales either independently of system size (CCMC) or linearly in the number of electrons (FCIQMC) that works especially well on localized orbitals. Tests on small water chains with localized orbitals with CCMC and with an initiator point sample in FCIQMC indicate that it can be equally efficient as the other excitation generators. As the system gets larger, calculations with our new algorithm converge faster than the on-the-fly weight algorithm while having a much more favorable memory scaling than the heat bath algorithm.

DOI
10.1021/acs.jctc.8b00844

Related papers

Efficient Heat-Bath Sampling in Fock Space

Adam A. Holmes, Hitesh J. Changlani, Cyrus J. Umrigar

We introduce an algorithm for sampling many-body quantum states in Fock space. The algorithm efficiently samples states with probability approximately proportional to an arbitrary function of the second-quantized Hamiltonian matrix element connecting the sampled state to the current state. We apply the new sampling algorithm to the recently developed semistochastic full configuration interaction quantum Monte Carlo (S-FCIQMC) method, a semistochastic implementation of the power method for projecting out the ground state energy in a basis of Slater determinants. Our new sampling method requires modest additional computational time and memory compared to uniform sampling but results in newly spawned weights that are approximately of the same magnitude, thereby greatly improving the efficiency of projection. A comparison in efficiency between our sampling algorithm and uniform sampling is performed on the all-electron nitrogen dimer at equilibrium in Dunning's cc-pVXZ basis sets with X ∈ {D, T, Q, 5}, demonstrating a large gain in efficiency that increases with basis set size. In addition, a comparison in efficiency is performed on three all-electron first-row dimers, B2, N2, and F2, in a cc-pVQZ basis, demonstrating that the gain in efficiency compared to uniform sampling also increases dramatically with the number of electrons.

arXiv:1512.03757•Journal of Chemical Theory and Computation•Mar 9, 2016•101 citations

Accelerating Convergence in Fock Space Quantum Monte Carlo Methods

Verena A. Neufeld, Alex J. W. Thom

The convergence of full configuration interaction quantum Monte Carlo (FCIQMC) is accelerated using a quasi-Newton propagation (QN) which can also be applied to coupled cluster Monte Carlo (CCMC). The computational scaling of this optimized propagation is, keeping the additional computational cost to a bare minimum. Its effects are investigated deterministically and stochastically on a model system, the uniform electron gas, with Hilbert space size up to 10 40, and shown to accelerate convergence of the instantaneous projected energy by over an order of magnitude in the FCIQMC test case. Its capabilities are then demonstrated with FCIQMC on an archetypical quantum chemistry problem, the chromium dimer, in an all-electron basis set with Hilbert space size of about 10 22 yielding highly accurate FCI energies.

arXiv:1910.05210•Journal of Chemical Theory and Computation•Jan 16, 2020•10 citations

Accelerating and Converging Stochastic Quantum Chemistry

Verena A. Neufeld

In the last decade, stochastic versions of quantum chemistry methods such as coupled cluster Monte Carlo (CCMC) or full configuration interaction quantum Monte Carlo (FCIQMC) have made highly accurate energy calculations possible that are not accessible to the corresponding deterministic methods (full configuration interaction and coupled cluster) at the same accuracy. CCMC and FCIQMC parallelize well and exploit the sparsity in the wavefunction which decreases memory costs and makes calculations in larger systems tractable. With CCMC it is straightforward to set up high order coupled cluster calculations, such as CCSDTQ5, which includes quintuple excitations explicitly. In this thesis, the convergence of the energy accuracy with the coupled cluster levels up to CCSDTQ5 was tested on the uniform electron gas, a model solid system, for various degrees of electron correlation. This gave information on what coupled cluster level is needed to reach sufficient accuracy when modelling a solid system. Before large solid systems can be modelled, the CCMC and FCIQMC algorithms need to be optimised. The efficiency in one of the crucial steps in these algorithms, the $spawn$ step, was improved, keeping computational and memory costs as low as possible. Furthermore, the convergence of CCMC and FCIQMC was accelerated by employing a quasi-Newton propagation. Using the model system information of what coupled cluster level is needed and having made great progress towards accelerating these methods, the computation of highly accurate energies in solid or large molecular systems should be more feasible in the future.

•Dec 20, 2019•0 citations

Exploiting locality in FCIQMC for fast excitation generation

Oskar Weser, Ali Alavi, Giovanni Li Manni

In this paper we propose an improved excitation generation algorithm for the full configuration interaction quantum monte carlo (FCIQMC) method, which is particularly effective in systems described by localized orbitals. The method is an extension of the precomputed heat-bath (PCHB) strategy of Holmes et al., with more effective sampling of double excitations and a novel approach for non-uniform sampling of single excitations. We demonstrate the effectiveness of the algorithm for a chain of 30 hydrogen atoms with atom-localized orbitals, a stack of benzene molecules, an Fe-porphyrin model complex, whereby we show an overall efficiency gain by a factor of two to four, as measured by variance reduction per wall-clock time.

•May 24, 2023•0 citations

Exploiting locality in FCIQMC for fast excitation generation

Oskar Weser, Ali Alavi, Giovanni Li Manni

In this paper we propose an improved excitation generation algorithm for the full configuration interaction quantum monte carlo (FCIQMC) method, which is particularly effective in systems described by localized orbitals. The method is an extension of the precomputed heat-bath (PCHB) strategy of Holmes et al., with more effective sampling of double excitations and a novel approach for non-uniform sampling of single excitations. We demonstrate the effectiveness of the algorithm for a chain of 30 hydrogen atoms with atom-localized orbitals, a stack of benzene molecules, an Fe-porphyrin model complex, whereby we show an overall efficiency gain by a factor of two to four, as measured by variance reduction per wall-clock time.

•Sep 5, 2023•0 citations

An explicitly correlated approach to basis set incompleteness in full configuration interaction quantum Monte Carlo

George H. Booth, Deidre M. Cleland, Ali Alavi +1 more

By performing a stochastic dynamic in a space of Slater determinants, the full configuration interaction quantum Monte Carlo (FCIQMC) method has been able to obtain energies which are essentially free from systematic error to the basis set correlation energy, within small and systematically improvable error bars. However, the weakly exponential scaling with basis size makes converging the energy with respect to basis set costly and in larger systems, impossible. To ameliorate these basis set issues, here we use perturbation theory to couple the FCIQMC wavefunction to an explicitly correlated strongly orthogonal basis of geminals, following the [2](R12) approach of Valeev et al. The required one- and two-particle density matrices are computed on-the-fly during the FCIQMC dynamic, using a sampling procedure which incurs relatively little additional computation expense. The F12 energy corrections are shown to converge rapidly as a function of sampling, both in imaginary time and number of walkers. Our pilot calculations on the binding curve for the carbon dimer, which exhibits strong correlation effects as well as substantial basis set dependence, demonstrate that the accuracy of the FCIQMC-F12 method surpasses that of all previous FCIQMC calculations, and that the F12 correction improves results equivalent to increasing the quality of the one-electron basis by two cardinal numbers.

arXiv:1208.0980•The Journal of Chemical Physics•Oct 28, 2012•61 citations
High-quality excitation generators are crucial to the effectiveness of coupled cluster Monte Carlo (CCMC) and full configuration interaction Quantum Monte Carlo (FCIQMC) calculations. The heat bath sampling of Holmes et al. [Holmes, A. A.; Changlani, H. J.; Umrigar, C. J. J. Chem. Theory Comput. 2016, 12, 1561-1571.] dramatically increases the efficiency of the spawn step of such algorithms but requires memory storage scaling quartically with system size which can be prohibitive for large systems. Alternatively, Alavi et al. [Smart, S. D.; Booth, G. H.; Alavi, A. Unpublished results.] approximated these weights with weights based on Cauchy-Schwarz-like inequalities calculated on-the-fly. While reducing the memory cost, this algorithm scales linearly in system size computationally. We combine both of these ideas with the single-reference nature of many systems studied and introduce a spawn-sampling algorithm that has low memory requirements (quadratic in basis set size) compared to the heat bath algorithm and only scales either independently of system size (CCMC) or linearly in the number of electrons (FCIQMC) that works especially well on localized orbitals. Tests on small water chains with localized orbitals with CCMC and with an initiator point sample in FCIQMC indicate that it can be equally efficient as the other excitation generators. As the system gets larger, calculations with our new algorithm converge faster than the on-the-fly weight algorithm while having a much more favorable memory scaling than the heat bath algorithm.
We introduce an algorithm for sampling many-body quantum states in Fock space. The algorithm efficiently samples states with probability approximately proportional to an arbitrary function of the second-quantized Hamiltonian matrix element connecting the sampled state to the current state. We apply the new sampling algorithm to the recently developed semistochastic full configuration interaction quantum Monte Carlo (S-FCIQMC) method, a semistochastic implementation of the power method for projecting out the ground state energy in a basis of Slater determinants. Our new sampling method requires modest additional computational time and memory compared to uniform sampling but results in newly spawned weights that are approximately of the same magnitude, thereby greatly improving the efficiency of projection. A comparison in efficiency between our sampling algorithm and uniform sampling is performed on the all-electron nitrogen dimer at equilibrium in Dunning's cc-pVXZ basis sets with X ∈ {D, T, Q, 5}, demonstrating a large gain in efficiency that increases with basis set size. In addition, a comparison in efficiency is performed on three all-electron first-row dimers, B2, N2, and F2, in a cc-pVQZ basis, demonstrating that the gain in efficiency compared to uniform sampling also increases dramatically with the number of electrons.
The convergence of full configuration interaction quantum Monte Carlo (FCIQMC) is accelerated using a quasi-Newton propagation (QN) which can also be applied to coupled cluster Monte Carlo (CCMC). The computational scaling of this optimized propagation is, keeping the additional computational cost to a bare minimum. Its effects are investigated deterministically and stochastically on a model system, the uniform electron gas, with Hilbert space size up to 10 40, and shown to accelerate convergence of the instantaneous projected energy by over an order of magnitude in the FCIQMC test case. Its capabilities are then demonstrated with FCIQMC on an archetypical quantum chemistry problem, the chromium dimer, in an all-electron basis set with Hilbert space size of about 10 22 yielding highly accurate FCI energies.
In the last decade, stochastic versions of quantum chemistry methods such as coupled cluster Monte Carlo (CCMC) or full configuration interaction quantum Monte Carlo (FCIQMC) have made highly accurate energy calculations possible that are not accessible to the corresponding deterministic methods (full configuration interaction and coupled cluster) at the same accuracy. CCMC and FCIQMC parallelize well and exploit the sparsity in the wavefunction which decreases memory costs and makes calculations in larger systems tractable. With CCMC it is straightforward to set up high order coupled cluster calculations, such as CCSDTQ5, which includes quintuple excitations explicitly. In this thesis, the convergence of the energy accuracy with the coupled cluster levels up to CCSDTQ5 was tested on the uniform electron gas, a model solid system, for various degrees of electron correlation. This gave information on what coupled cluster level is needed to reach sufficient accuracy when modelling a solid system. Before large solid systems can be modelled, the CCMC and FCIQMC algorithms need to be optimised. The efficiency in one of the crucial steps in these algorithms, the spawnspawnspawn step, was improved, keeping computational and memory costs as low as possible. Furthermore, the convergence of CCMC and FCIQMC was accelerated by employing a quasi-Newton propagation. Using the model system information of what coupled cluster level is needed and having made great progress towards accelerating these methods, the computation of highly accurate energies in solid or large molecular systems should be more feasible in the future.
In this paper we propose an improved excitation generation algorithm for the full configuration interaction quantum monte carlo (FCIQMC) method, which is particularly effective in systems described by localized orbitals. The method is an extension of the precomputed heat-bath (PCHB) strategy of Holmes et al., with more effective sampling of double excitations and a novel approach for non-uniform sampling of single excitations. We demonstrate the effectiveness of the algorithm for a chain of 30 hydrogen atoms with atom-localized orbitals, a stack of benzene molecules, an Fe-porphyrin model complex, whereby we show an overall efficiency gain by a factor of two to four, as measured by variance reduction per wall-clock time.
In this paper we propose an improved excitation generation algorithm for the full configuration interaction quantum monte carlo (FCIQMC) method, which is particularly effective in systems described by localized orbitals. The method is an extension of the precomputed heat-bath (PCHB) strategy of Holmes et al., with more effective sampling of double excitations and a novel approach for non-uniform sampling of single excitations. We demonstrate the effectiveness of the algorithm for a chain of 30 hydrogen atoms with atom-localized orbitals, a stack of benzene molecules, an Fe-porphyrin model complex, whereby we show an overall efficiency gain by a factor of two to four, as measured by variance reduction per wall-clock time.
By performing a stochastic dynamic in a space of Slater determinants, the full configuration interaction quantum Monte Carlo (FCIQMC) method has been able to obtain energies which are essentially free from systematic error to the basis set correlation energy, within small and systematically improvable error bars. However, the weakly exponential scaling with basis size makes converging the energy with respect to basis set costly and in larger systems, impossible. To ameliorate these basis set issues, here we use perturbation theory to couple the FCIQMC wavefunction to an explicitly correlated strongly orthogonal basis of geminals, following the [2](R12) approach of Valeev et al. The required one- and two-particle density matrices are computed on-the-fly during the FCIQMC dynamic, using a sampling procedure which incurs relatively little additional computation expense. The F12 energy corrections are shown to converge rapidly as a function of sampling, both in imaginary time and number of walkers. Our pilot calculations on the binding curve for the carbon dimer, which exhibits strong correlation effects as well as substantial basis set dependence, demonstrate that the accuracy of the FCIQMC-F12 method surpasses that of all previous FCIQMC calculations, and that the F12 correction improves results equivalent to increasing the quality of the one-electron basis by two cardinal numbers.