The combination of continuum many-body quantum physics and Monte Carlo methods provide a powerful and well established approach to first principles calculations for large systems. Replacing the exact solution of the problem with a statistical estimate requires a measure of the random error in the estimate for it to be useful. Such a measure of confidence is usually provided by assuming the central limit theorem to hold true. In what follows it is demonstrated that, for the most popular implementation of the variational Monte Carlo method, the central limit theorem has limited validity, or is invalid and must be replaced by a generalized central limit theorem. Estimates of the total energy and the variance of the local energy are examined in detail, and shown to exhibit uncontrolled statistical errors through an explicit derivation of the distribution of the random error. Several examples are given of estimated quantities for which the central limit theorem is not valid. The approach used is generally applicable to characterizing the random error of estimates, and to quantum Monte Carlo methods beyond variational Monte Carlo.
The combination of continuum many-body quantum physics and Monte Carlo methods provide a powerful and well established approach to first principles calculations for large systems. Replacing the exact solution of the problem with a statistical estimate requires a measure of the random error in the estimate for it to be useful. Such a measure of confidence is usually provided by assuming the central limit theorem to hold true. In what follows it is demonstrated that, for the most popular implementation of the variational Monte Carlo method, the central limit theorem has limited validity, or is invalid and must be replaced by a generalized central limit theorem. Estimates of the total energy and the variance of the local energy are examined in detail, and shown to exhibit uncontrolled statistical errors through an explicit derivation of the distribution of the random error. Several examples are given of estimated quantities for which the central limit theorem is not valid. The approach used is generally applicable to characterizing the random error of estimates, and to quantum Monte Carlo methods beyond variational Monte Carlo.
Expectation values of physical quantities may accurately be obtained by the evaluation of integrals within many-body quantum mechanics, and these multidimensional integrals may be estimated using Monte Carlo methods. In a previous publication it has been shown that for the simplest, most commonly applied strategy in continuum quantum Monte Carlo, the random error in the resulting estimates is not well controlled. At best the central limit theorem is valid in its weakest form, and at worst it is invalid and replaced by an alternative generalized central limit theorem and non-normal random error. In both cases the random error is not controlled. Here we consider a new "residual sampling strategy" that reintroduces the central limit theorem in its strongest form, and provides full control of the random error in estimates. Estimates of the total energy and the variance of the local energy within variational Monte Carlo are considered in detail, and the approach presented may be generalized to expectation values of other operators, and to other variants of the quantum Monte Carlo method.
Quantum mechanics for many-body systems may be reduced to the evaluation of integrals in 3N dimensions using Monte Carlo, providing the Quantum Monte Carlo ab initio methods. Here we limit ourselves to expectation values for trial wave functions, that is to variational quantum Monte Carlo. Almost all previous implementations employ samples distributed as the physical probability density of the trial wave function, and assume the central limit theorem to be valid. In this paper we provide an analysis of random error in estimation and optimization that leads naturally to new sampling strategies with improved computational and statistical properties. A rigorous lower limit to the random error is derived, and an efficient sampling strategy presented that significantly increases computational efficiency. In addition the infinite variance heavy tailed random errors of optimum parameters in conventional methods are replaced with a Normal random error, strengthening the theoretical basis of optimization. The method is applied to a number of first row systems and compared with previously published results.
In quantum systems, physical quantities of interest can be expressed as expectation values of a probability distribution, which allows their estimation by Markov Chain Monte Carlo (MCMC) methods. This approach, an instance of Quantum Monte Carlo (QMC), plays a central role in obtaining predictions of system properties relevant to condensed matter and high energy physics. The use of Hamiltonian dynamics to design a Markov kernel, known as Hybrid or Hamiltonian Monte Carlo (HMC), is widespread in quantum applications. In this context, it is standard to use an HMC kernel that is ``adjusted'' with the Metropolis-Hastings (MH) criterion, so that estimates of expectations converge to their true value in the limit of infinite sample size. However, recent work in computational statistics suggests that an \emph{unadjusted} HMC kernel can be significantly more efficient, while safely maintaining an asymptotic bias which is small relative to the error arising from the variance of the finite sample size. We adapt this approach to the QMC setting, focusing on a challenging and high-dimensional \emph{spin-fermion} model of a quantum phase transition. We find that unadjusted methods outperform adjusted HMC in terms of effective sample size per gradient call, while retaining accurate results.
Quantum Averages and Statistical Samplings In this chapter, we discuss the general framework in which the variational Monte Carlo methods are defined and few important implementations for interacting systems of bosons and fermions on the lattice. The main advantage of considering this approach relies on the variational principle that has been shown in section 1.4: the energy of a given quantum state is always bounded from below by the exact ground-state one, giving us the route to obtain the best possible solution to the problem. In most cases, a suitable parametrization of the variational wave function allows us to consider a wide range of different quantum phases (e.g., metals, superconductors, and insulators). By performing an optimization of the parameters, we can reach the lowest-energy state, which is expected to capture the correct ground-state behavior. Therefore, variational wave functions represent a flexible and valuable approach to get important insights into the low-energy properties of models that cannot be solved by exact methods. By contrast, the main limitation of this approach is the fact that it is based on a given Ansatz , which may contain a relevant bias that cannot be removed within the chosen parametrization. We also mention that variational wave functions can be easily defined and treated for a wide class of models, irrespective of the range of interactions and the dimension of the local (i.e., single-site) Hilbert space, which can be even infinite and does not need the use of an uncontrolled cutoff to work with a finite-dimensional space. In this respect, variational Monte Carlo is better than other methods, like densitymatrix renormalization group or tensor-network methods in which the complexity dramatically increases with both the range of the interaction and the dimension of the local Hilbert space (White, 1992; Schollwöck, 2005, 2011). Let us start by describing the general framework in which variational Monte Carlo methods are defined. First of all, we fix a complete basis set in the Hilbert space, in which (for simplicity) the states are taken to be orthogonal and normalized such that: Then, any quantum state can be written as: In turn, the expectation value of an operator over a given variational wave function takes the following form: The main problem in evaluating the expectation value is that the number of configurations in the sum is exponentially large with the number of particles.
… a general method, suitable for electronic computing machines, of calculating the properties of any substance which may be considered as composed of interacting individual molecules. N. Metropolis et al. , 1953 Summary Quantum Monte Carlo methods have been very useful in providing exact results, or, at least, exact constraints on properties of electronic systems, in particular for the homogeneous electron gas. The results are, in many cases, more accurate than those from other quantum many-body methods, and provide unique capabilities and insights. In this chapter we introduce the general properties of stochastic methods and motivate their use on the quantum many-body problem. In particular, we discuss Markov chains and the computation of error estimates. The methods that we introduce in the next four chapters are quite different from those in Parts II and III: stochastic or quantum Monte Carlo methods. In stochastic methods, instead of solving deterministically for properties of the quantum many-body system, one sets up a random walk that samples for the properties. Historically the most important role of QMC for the electronic structure field has been to provide input into the other methods, most notably the QMC calculation of the HEG [109], used for the exchange– correlation functional in DFT. A second important role has been as benchmarks for other methods such asGW. There are systems for which QMC is uniquely suited, for example the Wigner transition in the low-density electron gas, see Sec. 3.1. In this chapter we introduce general properties of simulations, in particular Markov chains, and error estimates. In the following chapters we will apply this theory to three general classes of quantum Monte Carlo algorithms, namely variational (Ch. 23), projector (Ch. 24), and path-integral Monte Carlo (Ch. 25); Ch. 18 already introduced the QMC calculation of the impurity Green's function used in the dynamical mean-field method.We note that there are a variety of other QMC methods not covered in this book. Simulations First let us define what we mean by a simulation, since the word has other meanings in applied science. The dimensionality of phase space (i.e., the Hilbert space for a quantum system) is large or infinite. Even a classical system requires the positions and momenta of all particles, and, hence, the phase space for N classical particles has dimensionality 6 N .