This thesis details four research projects related to zero temperature quantum Monte Carlo. Chapters 2-4 focus on continuum quantum Monte Carlo, and specifically its application to molecular systems; whereas Chapter 5 focuses on quantum Monte Carlo in a discrete space. Chapter 2 focuses on improving upon the single-particle basis functions employed in quantum Monte Carlo calculations for molecular systems. For calculations requiring non-diverging pseudopotentials, a class of functions is introduced that is capable of producing the short- and long-range asymptotic behavior of the exact wavefunction. It is demonstrated that this form of basis function produces superior accuracy and efficiency when compared to the basis sets typically employed in quantum Monte Carlo. Although the basis functions introduced in Chapter 2 are capable of producing superior results, it is necessary that the parameters of the functional form are near-optimal for the full potential of the functions to be realized. Chapter 3 introduces a simple yet general method for constructing basis sets of a desired functional form appropriate for molecular electronic structure calculations. A standard basis set is created for each of the elements from hydrogen to argon. Chapter 4 explores the effect of different aspects of the trial wavefunction on the accuracy of quantum Monte Carlo. By systematically testing the effect of the basis size, orbital quality, and determinant expansion quality, this work offers guidance to quantum Monte Carlo practitioners for achieving results to within chemical accuracy of experiment. In Chapter 5, semistochastic projection, a hybrid of deterministic and stochastic projection, is introduced for finding the dominant eigenvalue and eigenvector of a matrix. This method, like stochastic projection, is applicable to matrices well beyond the size that can be handled by deterministic methods. Semistochastic projection improves over stochastic projection by significantly reducing the computational time required to obtain the eigenvalue within a specified statistical uncertainty. After the semistochastic projection method is introduced, it is applied to determine the ground state energy of the Hamiltonian in a discrete basis. This special case of semistochastic projection, dubbed semistochastic quantum Monte Carlo, is shown to be orders of magnitude more efficient than stochastic quantum Monte Carlo.
This thesis details four research projects related to zero temperature quantum Monte Carlo. Chapters 2-4 focus on continuum quantum Monte Carlo, and specifically its application to molecular systems; whereas Chapter 5 focuses on quantum Monte Carlo in a discrete space. Chapter 2 focuses on improving upon the single-particle basis functions employed in quantum Monte Carlo calculations for molecular systems. For calculations requiring non-diverging pseudopotentials, a class of functions is introduced that is capable of producing the short- and long-range asymptotic behavior of the exact wavefunction. It is demonstrated that this form of basis function produces superior accuracy and efficiency when compared to the basis sets typically employed in quantum Monte Carlo. Although the basis functions introduced in Chapter 2 are capable of producing superior results, it is necessary that the parameters of the functional form are near-optimal for the full potential of the functions to be realized. Chapter 3 introduces a simple yet general method for constructing basis sets of a desired functional form appropriate for molecular electronic structure calculations. A standard basis set is created for each of the elements from hydrogen to argon. Chapter 4 explores the effect of different aspects of the trial wavefunction on the accuracy of quantum Monte Carlo. By systematically testing the effect of the basis size, orbital quality, and determinant expansion quality, this work offers guidance to quantum Monte Carlo practitioners for achieving results to within chemical accuracy of experiment. In Chapter 5, semistochastic projection, a hybrid of deterministic and stochastic projection, is introduced for finding the dominant eigenvalue and eigenvector of a matrix. This method, like stochastic projection, is applicable to matrices well beyond the size that can be handled by deterministic methods. Semistochastic projection improves over stochastic projection by significantly reducing the computational time required to obtain the eigenvalue within a specified statistical uncertainty. After the semistochastic projection method is introduced, it is applied to determine the ground state energy of the Hamiltonian in a discrete basis. This special case of semistochastic projection, dubbed semistochastic quantum Monte Carlo, is shown to be orders of magnitude more efficient than stochastic quantum Monte Carlo.
This thesis is divided into three chapters. In the first chapter we outline a simple and numerically inexpensive approach to describe the spectral features of the single-impurity Anderson model. The method combines aspects of the density matrix embedding theory (DMET) approach with a spectral broadening approach inspired by those used in numerical renormalization group (NRG) methods. At zero temperature for a wide range of U , the spectral function produced by this approach is found to be in good agreement with general expectations as well as more advanced and complex numerical methods such as DMRG-based schemes. The theory developed here is simply transferable to more complex impurity problems The second chapter outlines the density matrix embedding methodology in the context of electronic structure applications. We formulate analytical gradients for energies obtained from DMET focusing on two scenarios: RHF-in-RHF embedding and FCI-in-RHF embedding. The former involves solving the small embedded system at Restricted Hartree-Fock (RHF) level of theory. This serves to check the validity of the formulas by reproducing the RHF results on the full system for energies and gradients. The latter scenario employs full configuration interaction (FCI) as a high level solver for the small embedded system. Our results show that only Hellmann-Feynman terms, which involve derivatives of one- and two-electron terms in the atomic orbital basis, are required to calculate energy gradients in both cases. We applied our methodology to the problem of H 10 ring dissociation where the analytical gradients matched those obtained numerically. The gradient formulation is applicable to geometry optimization of strongly correlated molecules and solids. It can also be used in ab initio molecular dynamics where forces on nuclei are obtained from DMET energy gradients. In the final chapter we focus on the study of finite-temperature equilibrium properties of quantum systems in continuous space. We formulate an expansion of the partition function in continuous-time and use Monte Carlo to sample terms in the resulting infinite series. Such a strategy has been highly successful in quantum lattice models but has found scant application in off-lattice systems. The Monte Carlo estimate of the average energy of quantum particles in continuous space subject to simple model potentials is found to converge with low statistical error to the exact solutions even when very high perturbation order is required. We outline two ways in which the algorithm can be applied to more complex problems. First, by drawing an analogy between the formulation in continuous-time with the discretized, Trotter factorized version of standard path integral Monte Carlo (PIMC). This allows one to use the suite of standard PIMC moves to carry out the position sampling required to obtain the weight of each time configuration. Finally, we propose an alternate route by fitting the many-particle potential with multidimensional Gaussians which provides an analytical form for the position integrals.
Quantum Monte Carlo (QMC) is one of the most promising methods for solving quantum many-body problems. QMC combines known analytical properties of wave functions, results from other methods, and stochastic techniques, into a powerful tool for investigation of the electronic structure of real materials. Furthermore, the method has a favorable scaling ( O[N3] in the number of electrons), perfect scalability on parallel architectures, and can be applied to a wide range of systems. Our work has focused both on expanding the capabilities of QMC for calculation of quantities beyond energies, such as interatomic forces, and on application of the method to challenging problems in nanostructure materials research. For the calculation of interatomic forces we have implemented a finite difference correlated sampling method. The correlated sampling enables us to avoid the problem of statistical noise in evaluating the energy differences and allows us to obtain forces with an average 1% error. We have analyzed the effect of the method's main approximations on the estimate of the forces, both by theoretical arguments and by performing a variety of tests on small systems. Furthermore, we have used this newly developed method for estimating equilibrium geometries in a problem where other methods have failed. QMC enabled us to treat the electron correlation effects with high accuracy and to provide accurate predictions in a number of interesting applications. In particular, for carbon rings of C4N+2 stoichiometry we have resolved a long-standing problem regarding the competition between the aromaticity and second order Jahn-Teller effects. We have found that the dominant mechanism at small and intermediate sizes, which stabilizes the bond angle and bond length alternated geometries, is the secondorder Jahn-Teller effect while the aromatic isomer is always found to be a transition state. These high accuracy calculations which have involved multi-reference wave functions, extensive variational optimizations, and the use of massively parallel platforms demonstrate clearly the unique capabilities of the QMC approach.
The chapter 2, we deal with the challenge b). It focuses on the variational Monte Carlo (VMC) and the wavefunction optimization methods based on VMC. The performance of different methods are displayed through the op- timization of the Jastrow factor in our test case Beryllium dimer and the efficiency is improving surprisingly during the evolution of these methods. In chapter 3, we focus on the challenge a). It describes the wavefunc- tion ansatz used by our simulation. In this thesis, we introduce the atomic hybrid orbitals which significantly increase the compactness of our wavefunc- tion without hurting accuracy. This chapter also explain how to optimize the determinant in a way that the number of variational parameters scales only linearly with the system size. This further helps the efficiency of the wavefunction optimization. In chapters 4 and 5, the issue c) is explained in detail. In chapter 4, a second order Langevin dynamics (SLD) scheme is devised particularly for QMC and this thesis improves this scheme by developing a better integration method. Here, we also highlight the remarkable power of the force covari- ance matrix which can be defined only in QMC and is capable of accelerating the slow modes of a dynamics. In chapter 5, this SLD for QMC is validated through intensive benchmarking on the calculation of the vibrational frequen- cies of water and other small molecules. It is shown that many systematic biases in our MD scheme and QMC evaluation can be controlled so that we are confident to push forward this ab initio molecular dynamics for applica- tions on large systems. Finally in chapter 6, we perform the simulation of liquid water with all the preparation done in the previous chapters. The results are encouraging since we’ve closed the discrepancy of the peak positions of RDFs between experi- ments and ab initio simulations. The power of QMC is also demonstrated by the fact that the shapes of our RDFs are much less structured than previous DFT-based ab initio simulations even if the two water molecule interaction is dealt with the same level of accuracy as the DFT/BLYP calculation. In this chapter, we have also studied the features of hydrogen bonds in our simulation of liquid water. All our results indicate that it is important to consider the quantum nature of the ions for a faithful description of liquid water. This will be left for future studies, possible in principle even within the QMC approach.
Electronic structure quantum Monte Carlo Quantum Monte Carlo (QMC) is an advanced simulation methodology for studies of manybody quantum systems. The QMC approaches combine analytical insights with stochastic computational techniques for efficient solution of several classes of important many-body problems such as the stationary Schrödinger equation. QMC methods of various flavors have been applied to a great variety of systems spanning continuous and lattice quantum models, molecular and condensed systems, BEC-BCS ultracold condensates, nuclei, etc. In this review, we focus on the electronic structure QMC, i.e., methods relevant for systems described by the electron-ion Hamiltonians. Some of the key QMC achievements include direct treatment of electron correlation, accuracy in predicting energy differences and favorable scaling in the system size. Calculations of atoms, molecules, clusters and solids have demonstrated QMC applicability to real systems with hundreds of electrons while providing 90-95% of the correlation energy and energy differences typically within a few percent of experiments. Advances in accuracy beyond these limits are hampered by the so-called fixed-node approximation which is used to circumvent the notorious fermion sign problem. Many-body nodes of fermion states and their properties have therefore become one of the important topics for further progress in predictive power and efficiency of QMC calculations. Some of our recent results on the wave function nodes and related nodal domain topologies will be briefly reviewed. This includes analysis of few-electron systems and descriptions of exact and approximate nodes using transformations and projections of the highly-dimensional nodal hypersurfaces into the 3D space. Studies of fermion nodes offer new insights into topological properties of eigenstates such as explicit demonstrations that generic fermionic ground states exhibit the minimal number of two nodal domains. Recently proposed trial wave functions based on Pfaffians with pairing orbitals are presented and their nodal properties are tested in calculations of first row atoms and molecules. Finally, backflow "dressed" coordinates are introduced as another possibility for capturing correlation effects and for decreasing the fixed-node bias.
This thesis focuses on the development, application, and high-performance implementation of numerical methods for simulating quantum many-body systems. In the first chapter, I provide an overview of several most successful conventional approaches for simulating quantum many-body systems, along with their current limitations. Then, the basic properties of the quantum spin model, which will be the subject of study in the following chapters, and its ground state are briefly summarized. Additionally, I discuss the background and the motivations of the research projects carried out during my PhD research. Chapter 2 introduces two numerical algorithms that are extensively used in this thesis, which are exact diagonalization (ED) and variational Monte Carlo. I outline the process of constructing a Hamiltonian matrix and employing iterative methods for exact diagonalization. Subsequently, I introduce the mechanism of the four important components in the ``standard" variational Monte Carlo that are widely used in the most recent research. In Chapter 3, we propose a symmetry-projected variational ansatz in the form of linear combinations of simple restricted Boltzmann machines. This construction allows one to explore states outside of the original variational manifold and increase the representation power with moderate computational effort. Besides allowing one to restore spatial symmetries, an expansion in terms of Krylov states using a Lanczos recursion offers a solution that can further improve the quantum state accuracy. We illustrate these ideas with an application to the Heisenberg J1−J2 model on the square lattice, a paradigmatic problem under debate in condensed matter physics,and achieve state-of-the-art accuracy in the representation of the ground state. In Chapter 4, we present a variational approach based on a Chebyshev expansion of the spectral function, and each Chebyshev polynomial is represented by a neural network quantum state. The Chebyshev moments are obtained by recursively applying the Hamiltonian and projecting on the space of variational states using a modified natural gradient descent method. We compare this approach with a modified approximation of the spectral function which uses a Krylov subspace constructed from the "Chebyshev wave functions." We present results for the one-dimensional and two-dimensional Heisenberg models on the square lattice and compare them with those obtained by other methods in the literature. In Chapter 5, we describe a method to carry out thermodynamic simulations of quantum many-body models using typicality and variational representations of quantum states. Minimally entangled typical thermal states (METTS) are a construction that allows one to solve for the imaginary time evolution of quantum many-body systems. By using wave functions that are weakly entangled, one can take advantage of efficient representations in the form of matrixproduct states. We generalize these ideas to arbitrary variational wave functions and we focus, as an illustration, on the particular case of restricted Boltzmann machines. We demonstrate the application of the method to quantum spin systems in one and two spatial dimensions. In Chapter 6, we study the properties of the impurity band in heavily doped nonmagnetic semiconductors using the Jacobi-Davidson algorithm and the supervised deep learning method. The disorder averaged inverse participation ratio and Thouless number calculation show us the rich structure inside the impurity band. A convolutional neural network model, which is trained to distinguish the extended/localized phase of the Anderson model with high accuracy, shows us the results in good agreement with the conventional approach. Together, we find that there are three mobility edges in the impurity band for a specific on-site impurity potential, which means the presence of the extended states while filling the impurity band. In the final chapter, Chapter 7, we discuss the implementation of architecture-aware optimizations for spin dynamics simulations on x86 CPUs and Nvidia GPUs. The time cost of evaluating the spin-spin correlation functions in real space increases quadratically as the number of spins N, leading to significant computational effort, making the simulation of large spin systems very challenging. We propose to use a highly optimized general matrix multiply (GEMM) subroutine to calculate the dynamical spin-spin correlation function that can achieve near-optimal hardware utilization. Furthermore, we fuse the element-wise operations in the calculation of S(q,t) into the in-house GEMM kernel to reduce memory latency. On Nvidia GPU, we perform the on-the-fly calculation in the epilogue of the GEMM subroutine to avoid saving intermediate results on global memory, which significantly reduces memory usage and achieves better performance than cuBLAS.--Author's abstract
Quantum Monte Carlo (QMC) methods have received considerable attention over past decades due to their great promise for providing a direct solution to the many-body Schrodinger equation in electronic systems. Thanks to their low scaling with the number of particles, QMC methods present a compelling competitive alternative for the accurate study of large molecular systems and solid state calculations. In spite of such promise, the method has not permeated the quantum chemistry community broadly, mainly because of the fixed-node error, which can be large and whose control is difficult. In this Perspective, we present a systematic application of large scale multideterminant expansions in QMC and report on its impressive performance with first row dimers and the 55 molecules of the G1 test set. We demonstrate the potential of this strategy for systematically reducing the fixed-node error in the wave function and for achieving chemical accuracy in energy predictions. When compared to traditional quantum chemistry methods like MP2, CCSD(T), and various DFT approximations, the QMC results show a marked improvement over all of them. In fact, only the explicitly correlated CCSD(T) method with a large basis set produces more accurate results. Further developments in trial wave functions and algorithmic improvements appear promising for rendering QMC as the benchmark standard in large electronic systems.