Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:1309.4665 · The Journal of Chemical Physics

Generalizing the self-healing diffusion Monte Carlo approach to finite temperature: A path for the optimization of low-energy many-body bases

Fernando Agustín Reboredo, Jeongnim Kim

Published Feb 19, 2014• 3 citations
arXivHTMLPDF

Abstract

A statistical method is derived for the calculation of thermodynamic properties of many-body systems at low temperatures. This method is based on the self-healing diffusion Monte Carlo method for complex functions [F. A. Reboredo, J. Chem. Phys. 136, 204101 (2012)] and some ideas of the correlation function Monte Carlo approach [D. M. Ceperley and B. Bernu, J. Chem. Phys. 89, 6316 (1988)]. In order to allow the evolution in imaginary time to describe the density matrix, we remove the fixed-node restriction using complex antisymmetric guiding wave functions. In the process we obtain a parallel algorithm that optimizes a small subspace of the many-body Hilbert space to provide maximum overlap with the subspace spanned by the lowest-energy eigenstates of a many-body Hamiltonian. We show in a model system that the partition function is progressively maximized within this subspace. We show that the subspace spanned by the small basis systematically converges towards the subspace spanned by the lowest energy eigenstates. Possible applications of this method for calculating the thermodynamic properties of many-body systems near the ground state are discussed. The resulting basis can also be used to accelerate the calculation of the ground or excited states with quantum Monte Carlo.

DOI
10.1063/1.4861222

Related papers

Many-body calculations of low-energy eigenstates in magnetic and periodic systems with self-healing diffusion Monte Carlo: Steps beyond the fixed phase

Fernando Agustín Reboredo

The self-healing diffusion Monte Carlo algorithm (SHDMC) [F. A. Reboredo, R. Q. Hood, and P. R. C. Kent, Phys. Rev. B 79, 195117 (2009); F. A. Reboredo, ibid. 80, 125110 (2009)] is extended to study the ground and excited states of magnetic and periodic systems. The method converges to exact eigenstates as the statistical data collected increase if the wave function is sufficiently flexible. It is shown that the dimensionality of the nodal surface is dependent on whether phase is a scalar function or not. A recursive optimization algorithm is derived from the time evolution of the mixed probability density, which is given by an ensemble of electronic configurations (walkers) with complex weight. This complex weight allows the phase of the fixed-node wave function to move away from the trial wave function phase. This novel approach is both a generalization of SHDMC and the fixed-phase approximation [G. Ortiz, D. M. Ceperley, and R. M. Martin, Phys Rev. Lett. 71, 2777 (1993)]. When used recursively it simultaneously improves the node and the phase. The algorithm is demonstrated to converge to nearly exact solutions of model systems with periodic boundary conditions or applied magnetic fields. The computational cost is proportional to the number of independent degrees of freedom of the phase. The method is applied to obtain low-energy excitations of Hamiltonians with magnetic field. Periodic boundary conditions are also considered optimizing wave functions with twisted boundary conditions which are included in a many-body Bloch phase. The potential applications of this new method to study periodic, magnetic, and complex Hamiltonians are discussed.

arXiv:1008.0359•The Journal of Chemical Physics•May 22, 2012•11 citations

Systematic reduction of sign errors in many-body problems: Generalization of self-healing diffusion Monte Carlo to excited states

Fernando Agustín Reboredo

A recently developed self-healing diffusion Monte Carlo algorithm [F. A. Reboredo, R. Q. Hood, and P. R. C. Kent, Phys. Rev. B 79, 195117 (2009)] is extended to the calculation of excited states. The formalism is based on an excited-state fixed-node approximation and the mixed estimator of the excited-state probability density. The fixed-node ground-state wave-functions of inequivalent nodal pockets are found simultaneously using a recursive approach. The decay of the wave-function into lower-energy states is prevented using two methods: (i) the projection of the improved trial-wave function into previously calculated eigenstates is removed; and (ii) the reference energy for each nodal pocket is adjusted in order to create a kink in the global fixed-node wave-function, which, when locally smoothed, increases the volume of the higher-energy pockets at the expense of the lower-energy ones until the energies of every pocket become equal. This reference energy method is designed to find nodal structures that are local minima for arbitrary fluctuations of the nodes within a given nodal topology. It is demonstrated in a model system that the algorithm converges to many-body eigenstates in bosonic and fermionic cases.

arXiv:0906.4359•Physical Review B•Sep 14, 2009•11 citations

Self-healing diffusion quantum Monte Carlo algorithms: Direct reduction of the fermion sign error in electronic structure calculations

Fernando Agustín Reboredo, Randolph Q. Hood, Paul R. C. Kent

We develop a formalism and present an algorithm for optimization of the trial wave function used in fixed-node diffusion quantum Monte Carlo (DMC) methods. The formalism is based on the DMC mixed estimator of the ground-state probability density. We take advantage of a basic property of the walker configuration distribution generated in a DMC calculation, to (i) project out a multideterminant expansion of the fixed-node ground-state wave function and (ii) to define a cost function that relates the fixed-node ground-state and the noninteracting trial wave functions. We show that (a) locally smoothing out the kink of the fixed-node ground-state wave function at the node generates a new trial wave function with better nodal structure and (b) we argue that the noise in the fixed-node wave function resulting from finite sampling plays a beneficial role, allowing the nodes to adjust toward the ones of the exact many-body ground state in a simulated annealing-like process. Based on these principles, we propose a method to improve both single determinant and multideterminant expansions of the trial wave function. The method can be generalized to other wave-function forms such as pfaffians. We test the method in a model system where benchmark configuration-interaction calculations can be performed and most components of the Hamiltonian are evaluated analytically. Comparing the DMC calculations with the exact solutions, we find that the trial wave function is systematically improved. The overlap of the optimized trial wave function and the exact ground state converges to 100% even starting from wave functions orthogonal to the exact ground state. Similarly, the DMC total energy and density converges to the exact solutions for the model. In the optimization process we find an optimal noninteracting nodal potential of density-functional-like form whose existence was predicted in a previous publication [Phys. Rev. B 77, 245110 (2008)]. Tests of the method are extended to a model system with a conventional Coulomb interaction where we show we can obtain the exact Kohn-Sham effective potential from the DMC data.

arXiv:0808.3417•Physical Review B•May 19, 2009•30 citations

Finite-Temperature Variational Monte Carlo Method for Strongly Correlated Electron Systems

Kensaku Takai, Kota Ido, Takahiro Misawa +2 more

A new computational method for finite-temperature properties of strongly correlated electrons is proposed by extending the variational Monte Carlo method originally developed for the ground state. The method is based on the path integral in the imaginary-time formulation, starting from the infinite-temperature state that is well approximated by a small number of certain random initial states. Lower temperatures are progressively reached by the imaginary-time evolution. The algorithm follows the framework of the quantum transfer matrix and finite-temperature Lanczos methods, but we extends them to treat much larger system sizes without the negative sign problem by optimizing the truncated Hilbert space on the basis of the time-dependent variational principle (TDVP). This optimization algorithm is equivalent to the stochastic reconfiguration (SR) method that has been frequently used for the ground state to optimally truncate the Hilbert space. The obtained finite-temperature states allow an interpretation based on the thermal pure quantum (TPQ) state instead of the conventional canonical-ensemble average. Our method is tested for the one- and two-dimensional Hubbard models and its accuracy and efficiency are demonstrated.

arXiv:1510.05352•Journal of the Physical Society of Japan•Feb 18, 2016•22 citations

Alleviation of the Fermion-Sign Problem by Optimization of Many-Body Wave Functions

Cyrus J. Umrigar, Julien Toulouse, Claudia Filippi +2 more

We present a simple, robust, and highly efficient method for optimizing all parameters of many-body wave functions in quantum Monte Carlo calculations, applicable to continuum systems and lattice models. Based on a strong zero-variance principle, diagonalization of the Hamiltonian matrix in the space spanned by the wave function and its derivatives determines the optimal parameters. It systematically reduces the fixed-node error, as demonstrated by the calculation of the binding energy of the small but challenging C(2) molecule to the experimental accuracy of 0.02 eV.

arXiv:cond-mat/0611094•Physical Review Letters•Mar 15, 2007•506 citations

EXTENSIONS FOR THE RIGID-BODY QUANTUM MONTE CARLO METHOD

Chris Smith

Solving the Schrodinger equation and finding excited states for quantum mechanical many-body systems is a fundamental problem. If this problem is formulated in terms of integrals, the dimensionality of the configuration space is often too high to perform the integrations required directly. This is because the volume of configuration space increases exponentially with dimension quickly, making its complete exploration impossible. Monte Carlo methods provide a way to estimate these integrals by statistically sampling a subset of configuration space, and these methods provide 1/√ N convergence regardless of dimension. For many problems involving the quantum mechanics of molecules there exists a large time scale separation between the high-frequency internal vibrations, and low-frequency intermolecular motions. This separation motivates the rigid-body approximation which freezes internal degrees of freedom in order to study intermolecular effects. The reduction in the dimensionality of configuration space further increases the range of accessible problems. This thesis is devoted to the construction and implementation of algorithms which incorporate the rigid-body approximation into existing Monte Carlo methods for solving the quantum mechanical many-body problem. Monte Carlo estimators are constructed as averages over samples drawn from some probability distribution. If this distribution is known in closed form the samples can be generated by application of the Metropolis algorithm. In most cases the distribution is not known in closed form or even representable with a finite number of variables. If this distribution is the dominant eigenstate of some known operator then a stochastic implementation of the power method can be used to generate the required samples. For the quantum mechanical problem this operator can be taken to be the imaginary-time evolution operator and its application can be represented in terms of random walks. For rigid bodies, this method involves the implementation of rotational Brownian motion. The use of quaternion algebra to implement this rotational motion enhances simplicity, performance, and numerical stability. The method described above can be generalized to investigate excited state properties using correlation function Monte Carlo which is a Monte Carlo implementation of the Rayleigh-Ritz variational method. This generalization requires the construction of a trial subspace which is then subjected to the variational method resulting in a generalized eigenvalue problem. It is important to represent optimized trial states accurately and efficiently. For this purpose, we write trial states as functions of invariant polynomials of the interparticle distances. By reducing the number of free interparticle distances, the rigid-body approximation greatly simplifies

•Jan 1, 2010•0 citations
A statistical method is derived for the calculation of thermodynamic properties of many-body systems at low temperatures. This method is based on the self-healing diffusion Monte Carlo method for complex functions [F. A. Reboredo, J. Chem. Phys. 136, 204101 (2012)] and some ideas of the correlation function Monte Carlo approach [D. M. Ceperley and B. Bernu, J. Chem. Phys. 89, 6316 (1988)]. In order to allow the evolution in imaginary time to describe the density matrix, we remove the fixed-node restriction using complex antisymmetric guiding wave functions. In the process we obtain a parallel algorithm that optimizes a small subspace of the many-body Hilbert space to provide maximum overlap with the subspace spanned by the lowest-energy eigenstates of a many-body Hamiltonian. We show in a model system that the partition function is progressively maximized within this subspace. We show that the subspace spanned by the small basis systematically converges towards the subspace spanned by the lowest energy eigenstates. Possible applications of this method for calculating the thermodynamic properties of many-body systems near the ground state are discussed. The resulting basis can also be used to accelerate the calculation of the ground or excited states with quantum Monte Carlo.
The self-healing diffusion Monte Carlo algorithm (SHDMC) [F. A. Reboredo, R. Q. Hood, and P. R. C. Kent, Phys. Rev. B 79, 195117 (2009); F. A. Reboredo, ibid. 80, 125110 (2009)] is extended to study the ground and excited states of magnetic and periodic systems. The method converges to exact eigenstates as the statistical data collected increase if the wave function is sufficiently flexible. It is shown that the dimensionality of the nodal surface is dependent on whether phase is a scalar function or not. A recursive optimization algorithm is derived from the time evolution of the mixed probability density, which is given by an ensemble of electronic configurations (walkers) with complex weight. This complex weight allows the phase of the fixed-node wave function to move away from the trial wave function phase. This novel approach is both a generalization of SHDMC and the fixed-phase approximation [G. Ortiz, D. M. Ceperley, and R. M. Martin, Phys Rev. Lett. 71, 2777 (1993)]. When used recursively it simultaneously improves the node and the phase. The algorithm is demonstrated to converge to nearly exact solutions of model systems with periodic boundary conditions or applied magnetic fields. The computational cost is proportional to the number of independent degrees of freedom of the phase. The method is applied to obtain low-energy excitations of Hamiltonians with magnetic field. Periodic boundary conditions are also considered optimizing wave functions with twisted boundary conditions which are included in a many-body Bloch phase. The potential applications of this new method to study periodic, magnetic, and complex Hamiltonians are discussed.
A recently developed self-healing diffusion Monte Carlo algorithm [F. A. Reboredo, R. Q. Hood, and P. R. C. Kent, Phys. Rev. B 79, 195117 (2009)] is extended to the calculation of excited states. The formalism is based on an excited-state fixed-node approximation and the mixed estimator of the excited-state probability density. The fixed-node ground-state wave-functions of inequivalent nodal pockets are found simultaneously using a recursive approach. The decay of the wave-function into lower-energy states is prevented using two methods: (i) the projection of the improved trial-wave function into previously calculated eigenstates is removed; and (ii) the reference energy for each nodal pocket is adjusted in order to create a kink in the global fixed-node wave-function, which, when locally smoothed, increases the volume of the higher-energy pockets at the expense of the lower-energy ones until the energies of every pocket become equal. This reference energy method is designed to find nodal structures that are local minima for arbitrary fluctuations of the nodes within a given nodal topology. It is demonstrated in a model system that the algorithm converges to many-body eigenstates in bosonic and fermionic cases.
We develop a formalism and present an algorithm for optimization of the trial wave function used in fixed-node diffusion quantum Monte Carlo (DMC) methods. The formalism is based on the DMC mixed estimator of the ground-state probability density. We take advantage of a basic property of the walker configuration distribution generated in a DMC calculation, to (i) project out a multideterminant expansion of the fixed-node ground-state wave function and (ii) to define a cost function that relates the fixed-node ground-state and the noninteracting trial wave functions. We show that (a) locally smoothing out the kink of the fixed-node ground-state wave function at the node generates a new trial wave function with better nodal structure and (b) we argue that the noise in the fixed-node wave function resulting from finite sampling plays a beneficial role, allowing the nodes to adjust toward the ones of the exact many-body ground state in a simulated annealing-like process. Based on these principles, we propose a method to improve both single determinant and multideterminant expansions of the trial wave function. The method can be generalized to other wave-function forms such as pfaffians. We test the method in a model system where benchmark configuration-interaction calculations can be performed and most components of the Hamiltonian are evaluated analytically. Comparing the DMC calculations with the exact solutions, we find that the trial wave function is systematically improved. The overlap of the optimized trial wave function and the exact ground state converges to 100% even starting from wave functions orthogonal to the exact ground state. Similarly, the DMC total energy and density converges to the exact solutions for the model. In the optimization process we find an optimal noninteracting nodal potential of density-functional-like form whose existence was predicted in a previous publication [Phys. Rev. B 77, 245110 (2008)]. Tests of the method are extended to a model system with a conventional Coulomb interaction where we show we can obtain the exact Kohn-Sham effective potential from the DMC data.
A new computational method for finite-temperature properties of strongly correlated electrons is proposed by extending the variational Monte Carlo method originally developed for the ground state. The method is based on the path integral in the imaginary-time formulation, starting from the infinite-temperature state that is well approximated by a small number of certain random initial states. Lower temperatures are progressively reached by the imaginary-time evolution. The algorithm follows the framework of the quantum transfer matrix and finite-temperature Lanczos methods, but we extends them to treat much larger system sizes without the negative sign problem by optimizing the truncated Hilbert space on the basis of the time-dependent variational principle (TDVP). This optimization algorithm is equivalent to the stochastic reconfiguration (SR) method that has been frequently used for the ground state to optimally truncate the Hilbert space. The obtained finite-temperature states allow an interpretation based on the thermal pure quantum (TPQ) state instead of the conventional canonical-ensemble average. Our method is tested for the one- and two-dimensional Hubbard models and its accuracy and efficiency are demonstrated.
We present a simple, robust, and highly efficient method for optimizing all parameters of many-body wave functions in quantum Monte Carlo calculations, applicable to continuum systems and lattice models. Based on a strong zero-variance principle, diagonalization of the Hamiltonian matrix in the space spanned by the wave function and its derivatives determines the optimal parameters. It systematically reduces the fixed-node error, as demonstrated by the calculation of the binding energy of the small but challenging C(2) molecule to the experimental accuracy of 0.02 eV.
Solving the Schrodinger equation and finding excited states for quantum mechanical many-body systems is a fundamental problem. If this problem is formulated in terms of integrals, the dimensionality of the configuration space is often too high to perform the integrations required directly. This is because the volume of configuration space increases exponentially with dimension quickly, making its complete exploration impossible. Monte Carlo methods provide a way to estimate these integrals by statistically sampling a subset of configuration space, and these methods provide 1/√ N convergence regardless of dimension. For many problems involving the quantum mechanics of molecules there exists a large time scale separation between the high-frequency internal vibrations, and low-frequency intermolecular motions. This separation motivates the rigid-body approximation which freezes internal degrees of freedom in order to study intermolecular effects. The reduction in the dimensionality of configuration space further increases the range of accessible problems. This thesis is devoted to the construction and implementation of algorithms which incorporate the rigid-body approximation into existing Monte Carlo methods for solving the quantum mechanical many-body problem. Monte Carlo estimators are constructed as averages over samples drawn from some probability distribution. If this distribution is known in closed form the samples can be generated by application of the Metropolis algorithm. In most cases the distribution is not known in closed form or even representable with a finite number of variables. If this distribution is the dominant eigenstate of some known operator then a stochastic implementation of the power method can be used to generate the required samples. For the quantum mechanical problem this operator can be taken to be the imaginary-time evolution operator and its application can be represented in terms of random walks. For rigid bodies, this method involves the implementation of rotational Brownian motion. The use of quaternion algebra to implement this rotational motion enhances simplicity, performance, and numerical stability. The method described above can be generalized to investigate excited state properties using correlation function Monte Carlo which is a Monte Carlo implementation of the Rayleigh-Ritz variational method. This generalization requires the construction of a trial subspace which is then subjected to the variational method resulting in a generalized eigenvalue problem. It is important to represent optimized trial states accurately and efficiently. For this purpose, we write trial states as functions of invariant polynomials of the interparticle distances. By reducing the number of free interparticle distances, the rigid-body approximation greatly simplifies