Many computational methods in ab initio quantum chemistry are formulated in terms of high-order tensor contractions, whose cost determines the size of system that can be studied. We introduce stochastic tensor contraction to perform such operations with greatly reduced cost, and present its application to the gold-standard quantum chemistry method, coupled cluster theory with up to perturbative triples. For total energy errors more stringent than chemical accuracy, we reduce the computational scaling to that of mean-field theory, while starting to approach the mean-field absolute cost, thereby challenging the existing cost-to-accuracy landscape. Benchmarks against state-of-the-art local correlation approximations further show that we achieve an order-of-magnitude improvement in both total computation time and error, with significantly reduced sensitivity to system dimensionality and electron delocalization. We conclude that stochastic tensor contraction is a powerful computational primitive to accelerate a wide range of quantum chemistry.
Many computational methods in ab initio quantum chemistry are formulated in terms of high-order tensor contractions, whose cost determines the size of system that can be studied. We introduce stochastic tensor contraction to perform such operations with greatly reduced cost, and present its application to the gold-standard quantum chemistry method, coupled cluster theory with up to perturbative triples. For total energy errors more stringent than chemical accuracy, we reduce the computational scaling to that of mean-field theory, while starting to approach the mean-field absolute cost, thereby challenging the existing cost-to-accuracy landscape. Benchmarks against state-of-the-art local correlation approximations further show that we achieve an order-of-magnitude improvement in both total computation time and error, with significantly reduced sensitivity to system dimensionality and electron delocalization. We conclude that stochastic tensor contraction is a powerful computational primitive to accelerate a wide range of quantum chemistry.
Second-order Moller--Plesset perturbation theory (MP2) is one of the simplest correlated wave-function methods, but its conventional O(N5) cost limits its application to large systems. Stochastic tensor contraction (STC) has recently appeared as a general technique to evaluate high-order tensor contractions in quantum chemistry. Here, we apply STC to the exchange contribution of Laplace-transformed MP2, which is the source of O(N5) scaling in the formulation. The resulting STC exchange algorithm has an O(N3) deterministic setup cost and an O(N2) stochastic cost at fixed absolute error. The estimator is unbiased and provides a way to specify the target stochastic error by estimating the number of required samples before the full calculation. We implement the algorithm using a hybrid deterministic--stochastic evaluation strategy, with grouped index sampling, to reduce the computational prefactor. Over a range of benchmark molecules containing up to ∼7000 basis functions, the stochastic exchange evaluation takes as little as 1/270 of the time of a complete DF-MP2 calculation on the same system. Within the Laplace-transformed formulation, the O(N4) scaling direct contribution is thus the only significant cost. Our results further substantiate the power of STC to serve as a general tensor-contraction engine for quantum chemistry.
A constant goal of quantum chemistry is devising accurate and computationally effective methods for molecular simulations. In this work an application of tensor decompositions in the context of highly accurate coupled cluster theory, which is often considered a "gold standard", is investigated. The scheme we develop is aimed to mitigate the steep growth of the computational cost with the system size, and hence to overcome the "curse of dimensionality" common in many potent methods in electronic structure. We show how to reduce the computational effort of the restricted coupled cluster with singles and doubles (RCCSD) by two orders of magnitude by introducing alternative parameterizations of the method using "canonical polyad decomposition" (CPD) and "tensor hypercontraction" (THC) formats. After describing CPD and THC formats in detail, we demonstrate how to cast regular index based tensors into a decomposed form. The number of parameters and the accuracy of these representations depend on the expansion length (rank) of the approximation. We investigate the dependence of rank upon the size of the system and a target accuracy and show it to be low for typical tensors in electronic structure. We then provide a generic procedure to reformulate any coupled cluster method using tensor decompositions. Two specific approximate methods, THC-RCCSD and CPD-RCCSD, are derived. We demonstrate the accuracy of these new approaches by calculating energies of a large set of organic molecules, as well as by simulations of Hubbard models. Finally, it is shown how the restriction of the number of parameters in approximate coupled cluster can improve the accuracy in the challenging strong correlation regime. We conclude by discussing a connection of our findings to other new developments in the coupled cluster theory and propose possible extensions of our approach.
Calculation of high-rank tensor contractions plays a central role in computational physics, quantum chemistry, and computer science. The ability to perform a tensor contraction within a given computational budget poses a challenge to feasibility and restricts the types of systems that can be investigated computationally. We present the development and implementation of the Stratified Stochastic Tensor Contraction (SSTC) method as an alternative to sequential evaluation of tensor contraction. The SSTC approach partitions the tensor indices into stratified segments and employs composite index mappings to guide efficient sampling. By leveraging intrinsic structure within tensors, SSTC achieves rapid convergence to exact results with controllable sampling errors. We demonstrate the method on representative cases, two-point Coulomb integrals, four-point kernels, and correlation energy calculations using 2nd order Møller–Plesset perturbation theory, all of which are relevant to explicitly correlated electronic structure theory. In all examples, the SSTC method provides an accurate estimate of the tensor contraction with systematically reducible errors. We present the theory of exact tensor contractions as a foundation for the stochastic approach, followed by the mathematical derivation of the SSTC framework. Key components include the construction of a composite index to enable loop compression, and the application of functional minimization techniques for variance reduction. A discussion comparing sequential and stochastic contraction strategies, analysis of the distribution of sampling points through cumulative distribution functions and correlations between sampling assignments and kernel values are presented. A description of the SSTC method’s impact on computational clock times and dependence on segment number is included. Additional considerations include sampling with vs without replacement and the computational advantages of index mapping. These results highlight the effectiveness of the SSTC method as a versatile and scalable alternative to the conventional sequential tensor contraction approach, with broad applicability to quantum chemistry, many-body physics, stochastic quantum mechanics, and tensor-based machine learning.
Slater determinants have underpinned quantum chemistry for nearly a century, yet their full potential has remained challenging to exploit. In this work, we show that a variational wavefunction composed of a few hundred optimized non-orthogonal determinants can achieve energy accuracies comparable to the state of the art. This is obtained by introducing an optimization method that leverages the quadratic dependence of the variational energy on the orbitals of each determinant, enabling an exact iterative optimization, and uses an efficient tensor-contraction algorithm to evaluate the effective Hamiltonian with a computational cost that scales as the fourth power of the number of basis functions. We benchmark the accuracy of the proposed method with exact full-configuration interaction results where available, and we achieve lower variational energies than coupled cluster (CCSD(T)) for several molecules in the double-zeta basis. Accurate description of electronic wave functions typically requires large numbers of Slater determinants. Here, the authors develop an optimization method that achieves state-of-the-art accuracy for small molecules with only few hundred determinants.
For many decades, quantum chemical method development has been dominated by algorithms which involve increasingly complex series of tensor contractions over one-electron orbital spaces. Procedures for their derivation and implementation have evolved to require the minimum amount of logic and rely heavily on computationally efficient library-based matrix algebra and optimised paging schemes. In this regard, the recent development of exact stochastic quantum chemical algorithms to reduce computational scaling and memory overhead requires a contrasting algorithmic philosophy, but one which when implemented efficiently can achieve higher accuracy/cost ratios with small random errors. Additionally, they can exploit the continuing trend for massive parallelisation which hinders the progress of deterministic high-level quantum chemical algorithms. In the Quantum Monte Carlo community, stochastic algorithms are ubiquitous but the discrete Fock space of quantum chemical methods is often unfamiliar, and the methods introduce new concepts required for algorithmic efficiency. In this paper, we explore these concepts and detail an algorithm used for Full Configuration Interaction Quantum Monte Carlo (FCIQMC), which is implemented and available in MOLPRO and as a standalone code, and is designed for high-level parallelism and linear-scaling with walker number. Many of the algorithms are also in use in, or can be transferred to, other stochastic quantum chemical methods and implementations. We apply these algorithms to the strongly correlated chromium dimer to demonstrate their efficiency and parallelism.
Coupled-cluster methods offer unprecedented accuracy for a wide range of chemically important properties, but the steep scaling of computational cost with system size makes widespread use challenging. Local approximations, building on the short-range nature of electron correlation effects in insulators, help a great deal, but are much more complicated than their canonical counterparts. In this work we discuss an automated implementation scheme for local coupled-cluster methods, based on an interpreter and an underlying representation of sparse tensors. We demonstrate the efficacy of the approach through implementation of a very wide range of singles-and-doubles-based coupled-cluster schemes.