Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2609.01301

Self-Healing Diffusion Monte Carlo applied to a simple fermionic model: A critical assessment of the method

Michel Caffarel, Manon Pinar, Anthony Scemama

Published Sep 1, 2026• 1 citation
arXivHTMLPDF

Abstract

We investigate the Self-Healing Diffusion Monte Carlo (SHDMC) method using a one-dimensional model with periodic boundary conditions. An inversion symmetry is introduced to mimic the antisymmetry property of fermionic wave functions, with the bosonic and fermionic sectors being modeled by the even and odd eigenstates, respectively. As in realistic fermionic systems, the nodal structure is only partially constrained by symmetry, making this model a non-trivial testbed for nodal optimization algorithms such as SHDMC. We show that the nodal evolution under SHDMC iterations can be cast into a dynamical system exhibiting both attractive and repulsive fixed points. When applying SHDMC to this model in the absence of statistical noise, the fixed-node energy is found to increase during iterations and the node converges to an incorrect value. This occurs for any finite basis, even when the exact node is representable in it; the attractive fixed point approaches the exact node only as the basis becomes complete, while the convergence toward it becomes increasingly slow. We further show that this problem can be largely cured by modifying the nodal update criterion to give more importance to the nodal region. Our results suggest that, in the general case, an efficient nodal optimization may require both an improved nodal update criterion and a localized basis set allowing local distortions of the trial wave function, as is the case for this model.

DOI
10.48550/arxiv.2609.01301

Related papers

Many-body calculations of low-energy eigenstates in magnetic and periodic systems with self-healing diffusion Monte Carlo: Steps beyond the fixed phase

Fernando Agustín Reboredo

The self-healing diffusion Monte Carlo algorithm (SHDMC) [F. A. Reboredo, R. Q. Hood, and P. R. C. Kent, Phys. Rev. B 79, 195117 (2009); F. A. Reboredo, ibid. 80, 125110 (2009)] is extended to study the ground and excited states of magnetic and periodic systems. The method converges to exact eigenstates as the statistical data collected increase if the wave function is sufficiently flexible. It is shown that the dimensionality of the nodal surface is dependent on whether phase is a scalar function or not. A recursive optimization algorithm is derived from the time evolution of the mixed probability density, which is given by an ensemble of electronic configurations (walkers) with complex weight. This complex weight allows the phase of the fixed-node wave function to move away from the trial wave function phase. This novel approach is both a generalization of SHDMC and the fixed-phase approximation [G. Ortiz, D. M. Ceperley, and R. M. Martin, Phys Rev. Lett. 71, 2777 (1993)]. When used recursively it simultaneously improves the node and the phase. The algorithm is demonstrated to converge to nearly exact solutions of model systems with periodic boundary conditions or applied magnetic fields. The computational cost is proportional to the number of independent degrees of freedom of the phase. The method is applied to obtain low-energy excitations of Hamiltonians with magnetic field. Periodic boundary conditions are also considered optimizing wave functions with twisted boundary conditions which are included in a many-body Bloch phase. The potential applications of this new method to study periodic, magnetic, and complex Hamiltonians are discussed.

arXiv:1008.0359•The Journal of Chemical Physics•May 22, 2012•11 citations

Self-healing diffusion quantum Monte Carlo algorithms: Direct reduction of the fermion sign error in electronic structure calculations

Fernando Agustín Reboredo, Randolph Q. Hood, Paul R. C. Kent

We develop a formalism and present an algorithm for optimization of the trial wave function used in fixed-node diffusion quantum Monte Carlo (DMC) methods. The formalism is based on the DMC mixed estimator of the ground-state probability density. We take advantage of a basic property of the walker configuration distribution generated in a DMC calculation, to (i) project out a multideterminant expansion of the fixed-node ground-state wave function and (ii) to define a cost function that relates the fixed-node ground-state and the noninteracting trial wave functions. We show that (a) locally smoothing out the kink of the fixed-node ground-state wave function at the node generates a new trial wave function with better nodal structure and (b) we argue that the noise in the fixed-node wave function resulting from finite sampling plays a beneficial role, allowing the nodes to adjust toward the ones of the exact many-body ground state in a simulated annealing-like process. Based on these principles, we propose a method to improve both single determinant and multideterminant expansions of the trial wave function. The method can be generalized to other wave-function forms such as pfaffians. We test the method in a model system where benchmark configuration-interaction calculations can be performed and most components of the Hamiltonian are evaluated analytically. Comparing the DMC calculations with the exact solutions, we find that the trial wave function is systematically improved. The overlap of the optimized trial wave function and the exact ground state converges to 100% even starting from wave functions orthogonal to the exact ground state. Similarly, the DMC total energy and density converges to the exact solutions for the model. In the optimization process we find an optimal noninteracting nodal potential of density-functional-like form whose existence was predicted in a previous publication [Phys. Rev. B 77, 245110 (2008)]. Tests of the method are extended to a model system with a conventional Coulomb interaction where we show we can obtain the exact Kohn-Sham effective potential from the DMC data.

arXiv:0808.3417•Physical Review B•May 19, 2009•30 citations

Systematic Reduction of Sign Errors in Many-Body Calculations of Atoms and Molecules

Michal Bajdich, Murilo L. Tiago, Randolph Q. Hood +2 more

The self-healing diffusion Monte Carlo algorithm (SHDMC) is shown to be an accurate and robust method for calculating the ground state of atoms and molecules. By direct comparison with accurate configuration interaction results for the oxygen atom, we show that SHDMC converges systematically towards the ground-state wave function. We present results for the challenging N2 molecule, where the binding energies obtained via both energy minimization and SHDMC are near chemical accuracy (1 kcal/mol). Moreover, we demonstrate that SHDMC is robust enough to find the nodal surface for systems at least as large as C20 starting from random coefficients. SHDMC is a linear-scaling method, in the degrees of freedom of the nodes, that systematically reduces the fermion sign problem.

arXiv:0912.3826•Physical Review Letters•May 11, 2010•29 citations

Systematic reduction of sign errors in many-body problems: Generalization of self-healing diffusion Monte Carlo to excited states

Fernando Agustín Reboredo

A recently developed self-healing diffusion Monte Carlo algorithm [F. A. Reboredo, R. Q. Hood, and P. R. C. Kent, Phys. Rev. B 79, 195117 (2009)] is extended to the calculation of excited states. The formalism is based on an excited-state fixed-node approximation and the mixed estimator of the excited-state probability density. The fixed-node ground-state wave-functions of inequivalent nodal pockets are found simultaneously using a recursive approach. The decay of the wave-function into lower-energy states is prevented using two methods: (i) the projection of the improved trial-wave function into previously calculated eigenstates is removed; and (ii) the reference energy for each nodal pocket is adjusted in order to create a kink in the global fixed-node wave-function, which, when locally smoothed, increases the volume of the higher-energy pockets at the expense of the lower-energy ones until the energies of every pocket become equal. This reference energy method is designed to find nodal structures that are local minima for arbitrary fluctuations of the nodes within a given nodal topology. It is demonstrated in a model system that the algorithm converges to many-body eigenstates in bosonic and fermionic cases.

arXiv:0906.4359•Physical Review B•Sep 14, 2009•11 citations

Active space selection with self-healing diffusion Monte Carlo algorithms for periodic solids

Nicole Spanedda, Jaron T. Krogel, Fernando Agustín Reboredo

Multideterminant Diffusion Monte Carlo (DMC) displays improved accuracy over single determinant DMC. Self-Healing Diffusion Monte Carlo (SHDMC) is a DMC based method that iteratively improves a multideterminant trial wavefunction. Although configuration interaction or complete active space (CAS) methods are very accurate and computationally feasible for many systems, they are not optimal for application to solids. SHDMC is accurate and designed for application to solids, so developing SHDMC based active space selection algorithms is a worthy endeavor. Here, we present and compare active space selection algorithms that are designed for use in conjunction with SHDMC, without relying on external approaches. For benchmarking, we calculated the ground state energy of a small unit cell of graphene and compared the results with a complete basis set extrapolated selected CI and a reference SHDMC trajectory. We found that systematically expanding the active space using an "auto-branching" algorithm optimally balances accuracy with computational practicality. To the best of our knowledge, this is the first work that demonstrates completely self-contained DMC-based active space selection algorithms that do not depend on external methods for determinant selection.

The Journal of Chemical Physics•Aug 3, 2026•0 citations

Grid-based diffusion Monte Carlo for fermions without the fixed-node approximation

Alexander A. Kunitsa, So Hirata

A diffusion Monte Carlo algorithm is introduced that can determine the correct nodal structure of the wave function of a few-fermion system and its ground-state energy without an uncontrolled bias. This is achieved by confining signed random walkers to the points of a uniform infinite spatial grid, allowing them to meet and annihilate one another to establish the nodal structure without the fixed-node approximation. An imaginary-time propagator is derived rigorously from a discretized Hamiltonian, governing a non-Gaussian, sign-flipping, branching, and mutually annihilating random walk of particles. The accuracy of the resulting stochastic representations of a fermion wave function is limited only by the grid and imaginary-time resolutions and can be improved in a controlled manner. The method is tested for a series of model problems including fermions in a harmonic trap as well as the He atom in its singlet or triplet ground state. For the latter case, the energies approach from above with increasing grid resolution and converge within 0.015E_{h} of the exact basis-set-limit value for the grid spacing of 0.08 a.u. with a statistical uncertainty of 10^{-5}E_{h} without an importance sampling or Jastrow factor.

arXiv:1811.03000•Physical review. E•Jan 27, 2020•12 citations
We investigate the Self-Healing Diffusion Monte Carlo (SHDMC) method using a one-dimensional model with periodic boundary conditions. An inversion symmetry is introduced to mimic the antisymmetry property of fermionic wave functions, with the bosonic and fermionic sectors being modeled by the even and odd eigenstates, respectively. As in realistic fermionic systems, the nodal structure is only partially constrained by symmetry, making this model a non-trivial testbed for nodal optimization algorithms such as SHDMC. We show that the nodal evolution under SHDMC iterations can be cast into a dynamical system exhibiting both attractive and repulsive fixed points. When applying SHDMC to this model in the absence of statistical noise, the fixed-node energy is found to increase during iterations and the node converges to an incorrect value. This occurs for any finite basis, even when the exact node is representable in it; the attractive fixed point approaches the exact node only as the basis becomes complete, while the convergence toward it becomes increasingly slow. We further show that this problem can be largely cured by modifying the nodal update criterion to give more importance to the nodal region. Our results suggest that, in the general case, an efficient nodal optimization may require both an improved nodal update criterion and a localized basis set allowing local distortions of the trial wave function, as is the case for this model.
The self-healing diffusion Monte Carlo algorithm (SHDMC) [F. A. Reboredo, R. Q. Hood, and P. R. C. Kent, Phys. Rev. B 79, 195117 (2009); F. A. Reboredo, ibid. 80, 125110 (2009)] is extended to study the ground and excited states of magnetic and periodic systems. The method converges to exact eigenstates as the statistical data collected increase if the wave function is sufficiently flexible. It is shown that the dimensionality of the nodal surface is dependent on whether phase is a scalar function or not. A recursive optimization algorithm is derived from the time evolution of the mixed probability density, which is given by an ensemble of electronic configurations (walkers) with complex weight. This complex weight allows the phase of the fixed-node wave function to move away from the trial wave function phase. This novel approach is both a generalization of SHDMC and the fixed-phase approximation [G. Ortiz, D. M. Ceperley, and R. M. Martin, Phys Rev. Lett. 71, 2777 (1993)]. When used recursively it simultaneously improves the node and the phase. The algorithm is demonstrated to converge to nearly exact solutions of model systems with periodic boundary conditions or applied magnetic fields. The computational cost is proportional to the number of independent degrees of freedom of the phase. The method is applied to obtain low-energy excitations of Hamiltonians with magnetic field. Periodic boundary conditions are also considered optimizing wave functions with twisted boundary conditions which are included in a many-body Bloch phase. The potential applications of this new method to study periodic, magnetic, and complex Hamiltonians are discussed.
We develop a formalism and present an algorithm for optimization of the trial wave function used in fixed-node diffusion quantum Monte Carlo (DMC) methods. The formalism is based on the DMC mixed estimator of the ground-state probability density. We take advantage of a basic property of the walker configuration distribution generated in a DMC calculation, to (i) project out a multideterminant expansion of the fixed-node ground-state wave function and (ii) to define a cost function that relates the fixed-node ground-state and the noninteracting trial wave functions. We show that (a) locally smoothing out the kink of the fixed-node ground-state wave function at the node generates a new trial wave function with better nodal structure and (b) we argue that the noise in the fixed-node wave function resulting from finite sampling plays a beneficial role, allowing the nodes to adjust toward the ones of the exact many-body ground state in a simulated annealing-like process. Based on these principles, we propose a method to improve both single determinant and multideterminant expansions of the trial wave function. The method can be generalized to other wave-function forms such as pfaffians. We test the method in a model system where benchmark configuration-interaction calculations can be performed and most components of the Hamiltonian are evaluated analytically. Comparing the DMC calculations with the exact solutions, we find that the trial wave function is systematically improved. The overlap of the optimized trial wave function and the exact ground state converges to 100% even starting from wave functions orthogonal to the exact ground state. Similarly, the DMC total energy and density converges to the exact solutions for the model. In the optimization process we find an optimal noninteracting nodal potential of density-functional-like form whose existence was predicted in a previous publication [Phys. Rev. B 77, 245110 (2008)]. Tests of the method are extended to a model system with a conventional Coulomb interaction where we show we can obtain the exact Kohn-Sham effective potential from the DMC data.
The self-healing diffusion Monte Carlo algorithm (SHDMC) is shown to be an accurate and robust method for calculating the ground state of atoms and molecules. By direct comparison with accurate configuration interaction results for the oxygen atom, we show that SHDMC converges systematically towards the ground-state wave function. We present results for the challenging N2 molecule, where the binding energies obtained via both energy minimization and SHDMC are near chemical accuracy (1 kcal/mol). Moreover, we demonstrate that SHDMC is robust enough to find the nodal surface for systems at least as large as C20 starting from random coefficients. SHDMC is a linear-scaling method, in the degrees of freedom of the nodes, that systematically reduces the fermion sign problem.
A recently developed self-healing diffusion Monte Carlo algorithm [F. A. Reboredo, R. Q. Hood, and P. R. C. Kent, Phys. Rev. B 79, 195117 (2009)] is extended to the calculation of excited states. The formalism is based on an excited-state fixed-node approximation and the mixed estimator of the excited-state probability density. The fixed-node ground-state wave-functions of inequivalent nodal pockets are found simultaneously using a recursive approach. The decay of the wave-function into lower-energy states is prevented using two methods: (i) the projection of the improved trial-wave function into previously calculated eigenstates is removed; and (ii) the reference energy for each nodal pocket is adjusted in order to create a kink in the global fixed-node wave-function, which, when locally smoothed, increases the volume of the higher-energy pockets at the expense of the lower-energy ones until the energies of every pocket become equal. This reference energy method is designed to find nodal structures that are local minima for arbitrary fluctuations of the nodes within a given nodal topology. It is demonstrated in a model system that the algorithm converges to many-body eigenstates in bosonic and fermionic cases.
Multideterminant Diffusion Monte Carlo (DMC) displays improved accuracy over single determinant DMC. Self-Healing Diffusion Monte Carlo (SHDMC) is a DMC based method that iteratively improves a multideterminant trial wavefunction. Although configuration interaction or complete active space (CAS) methods are very accurate and computationally feasible for many systems, they are not optimal for application to solids. SHDMC is accurate and designed for application to solids, so developing SHDMC based active space selection algorithms is a worthy endeavor. Here, we present and compare active space selection algorithms that are designed for use in conjunction with SHDMC, without relying on external approaches. For benchmarking, we calculated the ground state energy of a small unit cell of graphene and compared the results with a complete basis set extrapolated selected CI and a reference SHDMC trajectory. We found that systematically expanding the active space using an "auto-branching" algorithm optimally balances accuracy with computational practicality. To the best of our knowledge, this is the first work that demonstrates completely self-contained DMC-based active space selection algorithms that do not depend on external methods for determinant selection.
A diffusion Monte Carlo algorithm is introduced that can determine the correct nodal structure of the wave function of a few-fermion system and its ground-state energy without an uncontrolled bias. This is achieved by confining signed random walkers to the points of a uniform infinite spatial grid, allowing them to meet and annihilate one another to establish the nodal structure without the fixed-node approximation. An imaginary-time propagator is derived rigorously from a discretized Hamiltonian, governing a non-Gaussian, sign-flipping, branching, and mutually annihilating random walk of particles. The accuracy of the resulting stochastic representations of a fermion wave function is limited only by the grid and imaginary-time resolutions and can be improved in a controlled manner. The method is tested for a series of model problems including fermions in a harmonic trap as well as the He atom in its singlet or triplet ground state. For the latter case, the energies approach from above with increasing grid resolution and converge within 0.015E_{h} of the exact basis-set-limit value for the grid spacing of 0.08 a.u. with a statistical uncertainty of 10^{-5}E_{h} without an importance sampling or Jastrow factor.