One of the major obstacles in modern quantum chemistry is the need to employ exceedingly large one-electron basis sets in electron correlation methods to obtain reliably accurate results. The family of explicitly correlated wave function methods circumvents this issue by introducing terms that explicitly depend on the interelectronic distance, thereby enforcing the correct electron–electron cusp behavior, albeit at the cost of additional complicated many-electron integrals when evaluated without further approximation. The main focus of the present work is the efficient, low-scaling evaluation of explicitly correlated approaches, examined here through the explicitly correlated correction to second-order Møller–Plesset perturbation theory (MP2-F12) as a representative example. While these methods are highly effective in reducing the basis set incompleteness error, the cost associated with the corresponding correction often far exceeds that of the underlying correlation method. To overcome these limitations, several techniques and strategies are introduced to significantly reduce computational demand and resolve the main bottlenecks that arise. A particularly straightforward approach is provided by the scaled MP2-F12 ansatz, which introduces a single empirically determined factor that scales the direct-type geminal–geminal terms to closely reproduce the MP2-F12 correction, thereby omitting the most expensive exchange-type contributions. Furthermore, the computation of Fock matrix elements spanning multiple orbital spaces is drastically accelerated by extending techniques originally developed for Hartree–Fock and density functional theory. The direct contributions are evaluated using a modified resolution-of-the-identity Coulomb (RI-J) approach employing the J-engine ansatz for integral construction, while the exchange contributions are treated via three-dimensional numerical quadrature in the form of the seminumerical sn-LinK method. These approaches reduce the computational cost by more than three orders of magnitude compared to the approximation-free evaluation while maintaining high accuracy, with additional speedups achieved by exploiting the massive parallelism of graphics processing units. The central focus of this work is the efficient decomposition of complicated exchange-type multi-electron integrals, where numerical quadrature plays a key role in improving performance. The complementary auxiliary basis set resolution of the identity (CABS-RI) reduces the most expensive exchange-type integral to a three-electron integral, which is then efficiently decomposed via numerical quadrature. In this context, a highly efficient batch-wise, distance-dependent integral screening exploiting the short-range behavior of F12 operators is introduced, significantly improving performance and enabling near-linear-scaling evaluations while retaining high accuracy. These strategies are extended to all exchange-type contributions in F12 theory, leading to an alternative formulation of integrals better suited for efficient factorization. A novel combination of numerical quadrature with density fitting is presented for the efficient computation of products of four-center two-electron integrals, alongside algorithms covering all exchange-type contributions, including advantageous batching strategies. In general, the formal computational cost with system size M is reduced from O(M⁵) to O(M⁴), with further improvements appearing feasible through the use of localized molecular orbitals combined with advanced integral screening techniques.
One of the major obstacles in modern quantum chemistry is the need to employ exceedingly large one-electron basis sets in electron correlation methods to obtain reliably accurate results. The family of explicitly correlated wave function methods circumvents this issue by introducing terms that explicitly depend on the interelectronic distance, thereby enforcing the correct electron–electron cusp behavior, albeit at the cost of additional complicated many-electron integrals when evaluated without further approximation. The main focus of the present work is the efficient, low-scaling evaluation of explicitly correlated approaches, examined here through the explicitly correlated correction to second-order Møller–Plesset perturbation theory (MP2-F12) as a representative example. While these methods are highly effective in reducing the basis set incompleteness error, the cost associated with the corresponding correction often far exceeds that of the underlying correlation method. To overcome these limitations, several techniques and strategies are introduced to significantly reduce computational demand and resolve the main bottlenecks that arise. A particularly straightforward approach is provided by the scaled MP2-F12 ansatz, which introduces a single empirically determined factor that scales the direct-type geminal–geminal terms to closely reproduce the MP2-F12 correction, thereby omitting the most expensive exchange-type contributions. Furthermore, the computation of Fock matrix elements spanning multiple orbital spaces is drastically accelerated by extending techniques originally developed for Hartree–Fock and density functional theory. The direct contributions are evaluated using a modified resolution-of-the-identity Coulomb (RI-J) approach employing the J-engine ansatz for integral construction, while the exchange contributions are treated via three-dimensional numerical quadrature in the form of the seminumerical sn-LinK method. These approaches reduce the computational cost by more than three orders of magnitude compared to the approximation-free evaluation while maintaining high accuracy, with additional speedups achieved by exploiting the massive parallelism of graphics processing units. The central focus of this work is the efficient decomposition of complicated exchange-type multi-electron integrals, where numerical quadrature plays a key role in improving performance. The complementary auxiliary basis set resolution of the identity (CABS-RI) reduces the most expensive exchange-type integral to a three-electron integral, which is then efficiently decomposed via numerical quadrature. In this context, a highly efficient batch-wise, distance-dependent integral screening exploiting the short-range behavior of F12 operators is introduced, significantly improving performance and enabling near-linear-scaling evaluations while retaining high accuracy. These strategies are extended to all exchange-type contributions in F12 theory, leading to an alternative formulation of integrals better suited for efficient factorization. A novel combination of numerical quadrature with density fitting is presented for the efficient computation of products of four-center two-electron integrals, alongside algorithms covering all exchange-type contributions, including advantageous batching strategies. In general, the formal computational cost with system size M is reduced from O(M⁵) to O(M⁴), with further improvements appearing feasible through the use of localized molecular orbitals combined with advanced integral screening techniques.
We present a formulation of the explicitly correlated second-order Møller-Plesset (MP2-F12) energy in which all nontrivial post-mean-field steps are formulated with linear computational complexity in system size. The two key ideas are the use of pair-natural orbitals for compact representation of wave function amplitudes and the use of domain approximation to impose the block sparsity. This development utilizes the concepts for sparse representation of tensors described in the context of the domain based local pair-natural orbital-MP2 (DLPNO-MP2) method by us recently [Pinski et al., J. Chem. Phys. 143, 034108 (2015)]. Novel developments reported here include the use of domains not only for the projected atomic orbitals, but also for the complementary auxiliary basis set (CABS) used to approximate the three- and four-electron integrals of the F12 theory, and a simplification of the standard B intermediate of the F12 theory that avoids computation of four-index two-electron integrals that involve two CABS indices. For quasi-1-dimensional systems (n-alkanes), the ON DLPNO-MP2-F12 method becomes less expensive than the conventional ON(5) MP2-F12 for n between 10 and 15, for double- and triple-zeta basis sets; for the largest alkane, C200H402, in def2-TZVP basis, the observed computational complexity is N(∼1.6), largely due to the cubic cost of computing the mean-field operators. The method reproduces the canonical MP2-F12 energy with high precision: 99.9% of the canonical correlation energy is recovered with the default truncation parameters. Although its cost is significantly higher than that of DLPNO-MP2 method, the cost increase is compensated by the great reduction of the basis set error due to explicit correlation.
First-principles methods are a valuable tool to study the electronic structure of systems and explore the quantum-mechanical mechanisms driving them on the microscopic scale. Semi-local Density-Functional Approximations (DFAs) are still very popular due to the good balance between accuracy and computational efficiency. However, the instantaneous electronic interactions are described with an averaged potential in these methods, which is often insufficient to describe charge transfers or subtle many-body correlations. A promising way to improve the description of such interactions is the usage of advanced correlation methods which explicitly treat the electronic interactions in a many-body picture. Well known methods form this class are e.g. the Random- Phase Approximation (RPA), 2nd Order Møller-Plesset Perturbation Theory (MP2) and Coupled-Cluster Theory (CC). Unfortunately, the time and memory requirements for all these methods suffer from a steep scaling with system size in their canonical formulations. Several lower-scaling reformulations exist for these methods, but the at least cubic memory requirements and the increased algorithmic complexity prevented any efficient parallelization of these methods so far. In my thesis I developed a new lower-scaling technique for advanced correlation methods to address this challenge. The key components of this technique are the Laplace-Transformation (LT) and a new local Resolution of Identity (RI) strategy, named RI-LVL. Together, they significantly reduce the memory requirement without sacrificing accuracy and allow for an efficient parallelization by means of à priori known sparsity patterns. In combination with established integral screening techniques, the computational scaling can also be reduced considerably. The potential of this new approach is demonstrated at the example of an in-memory LT-MP2 with a MPI/OpenMP hybrid parallelization. It features an at worst cubic computational scaling, a quadratic memory scaling and a high parallel efficiency. Based on the Numeric Atom-Centered Orbital (NAO) framework used in the Fritz Haber Institute ab initio molecular simulations (FHI-aims) code, this implementation can handle both molecular and periodic systems with the same numerical footing. I will also discuss in detail how the combination of the LT and RI- LVL can be applied to RPA calculations. The accuracy and performance of my LT- MP2 is demonstrated in detail for both molecular and periodic systems. In addition, the convergence of the MP2 level adsorption energy of water on a rutile titanium dioxide (TiO2) surface in the low coverage limit is explored. This new LT-MP2 recovers more than 99.9% of the canonical MP2 correlation energy and can handle TiO2 surfaces with up to 270 atoms in the unit cell.
Quantum chemistry plays an important role in elucidating molecular geometries, electronic states, and reaction mechanisms, because of the developments of a variety of theoretical methods, such as Hartree-Fock (HF), Møler-Plesset (MP) perturbation, configuration interaction (CI), coupled-cluster (CC), and density functional theory (DFT) methods. Electronic structure calculations have been carried out by not only theoretical chemists but also experimental chemists. DFT is currently most widely used to investigate large molecules in the ground state as well as small molecules because of the low computational cost. However, the generally used functionals fail to describe correctly non-covalent interactions that are important for host-guest molecules, self-assembly, and molecular recognition, and they tend to underestimate reaction barriers. Many attempts have been made to develop new functionals and add semiempirical or empirical correction terms to standard functionals, but no generally accepted DFT method has emerged yet. Second-order Møler-Plesset perturbation theory (MP2) is the simplest method that includes electron correlation important for non-covalent interactions and reaction barriers nonempirically. However, the computational cost of MP2 is considerably higher than that of DFT. In addition, much larger sizes of fast memory and hard disk are required in MP2 calculations. These make MP2 calculations increasingly difficult for larger molecules. Since workstation or personal computer (PC) clusters have become popular for quantum chemistry calculations, an efficient parallel calculation is a solution of the problem. Therefore, new parallel algorithms for MP2 energy and gradient calculations are presented in this thesis. Furthermore, an efficient algorithm for the generation of two-electron repulsion integrals (ERIs) which is important in quantum chemistry calculations is also presented. For the calculations of excited states, different approaches are required: for example, CI, multi-configuration self-consistent field (MCSCF), time-dependent DFT (TDDFT), and symmetry adapted cluster (SAC)/SAC-CI methods. One of the most accurate methods is SAC/SAC-CI, as demonstrated for many molecules. In this thesis, SAC/SAC-CI calculations of ground, ionized, and excited states are presented. This thesis consists of five chapters: a new algorithm of two-electron repulsion integral calculations (Chapter I), a new parallel algorithm of MP2 energy calculations (Chapter II), a new parallel algorithm of MP2 energy gradient calculations (Chapter III), applications of MP2 calculations (Chapter IV), and SAC/SAC-CI calculations of ionized and excited states (Chapter V). In quantum chemistry calculations, the generation of ERIs is one of the most basic subjects and is the most time-consuming step especially in direct SCF calculations. Many algorithms have been developed to reduce the computational cost. In Pople-Hehre algorithm, Cartesian axes are rotated to make several coordinate components zero or constant, so that these components are skipped in the generation of ERIs. In McMurchie-Davidson algorithm, ERIs are generated from (ss|ss) type integrals using a recurrence relation derived from Hermite polynomials. By combining these two algorithms, a new algorithm is developed in Chapter I. The results show that the new algorithm reduces the computational cost by 10 - 40%, as compared with the original algorithms. It is notable that the generation of ERIs including d functions is considerably fast. The program implemented officially in GAMESS in 2004 has been used all over the world. In quantum mechanics, perturbation methods can be used for adding corrections to reference solutions. In the MP perturbation method, a sum over Fock operators is used as the reference term, and the exact two-electron repulsion operator minus twice the average two-electron repulsion operator is used as the perturbation term. It is the advantage that the MP perturbation method is size consistent and size extensive, unlike truncated CI methods. The zero-order wave function is the HF Slater determinant, and the zero-order energy is expressed as a sum of occupied molecular orbital (MO) energies. The first-order perturbation is the correction for the overcounting of two-electron repulsions at zero-order, and the first-order energy corresponds to the HF energy. The MP correlation starts at second-order. In general, second-order (MP2) accounts for 80 - 90% of electron correlation. Therefore, MP2 is focused in this thesis since it is applicable to large molecules with considerable reliability and low computational cost. The formal computational scaling of MP2 energy calculations with respect to molecular size is fifth order, much higher than that of DFT energy calculations. Therefore, less expensive methods, such as Local MP2, density fitting (resolution of identity, RI) MP2, and Laplace Transform MP2, have been developed. However, all of these methods include approximations or cut-offs that need to be checked against full MP2 energies. An alternative approach to reduce the computational cost is to parallelize MP2 energy calculations. A number of papers on parallel MP2 energy calculations have been published. Almost all of them are based on simple parallelization methods that distribute only atomic orbital (AO) or MO indices to each processor. These methods have a disadvantage since intermediate integrals are broadcasted to all CPUs or the same AO ERIs are generated in all processors. Baker and Pulay developed a new parallel algorithm using SaebøAlmlöf integral transformation method. This algorithm parallelizes the first half transformation by AO indices and the second half transformation by MO indices. The advantages are that the total amount of network communication is independent of the number of processors and the AO integrals are generated only once. The disadvantage is the I/O overhead for the sorting of half-transformed integrals. A new parallel algorithm for MP2 energy calculations based on the two-step parallelization idea is presented in Chapter II. In this algorithm, AO indices are distributed in the AO integral generation and the first three quarter transformation, and MO indices are distributed in the last quarter transformation and MP2 energy calculation. Because the algorithm makes the sorting of intermediate integrals very simple, the parallel efficiency is highly improved and the I/O overhead is removed. Furthermore, the algorithm reduces highly the floating point operation (FLOP) count as well as the required memory and hard disk space, in comparison with other algorithms. Test calculations of taxol (C47H51NO14) and luciferin (C11H8N2O3S2) were performed on a cluster of Pentium 4 computers connected by gigabit Ethernet. The parallel scaling of the developed code is excellent up to the largest number of processors we have tested. For instance, the elapsed time for the MP2 energy calculations on 16 processors is on average 15.4 times faster than that on the single-processor. Determination of molecular geometries and reaction paths is a fundamental task in quantum chemistry and requires energy gradients with respect to nuclear coordinates. In Chapter III, a new parallel algorithm for MP2 energy gradient calculations is presented. The algorithm consists of 5 steps, the integral transformation, the MP2 amplitude calculation, the MP2 Lagrangian calculation, the coupled-perturbed HF calculation, and the integral derivative calculation. All steps are parallelized by distributing AO or MO indices. The algorithm also reduces the FLOP count, the required memory, and hard disk space. Test calculations of MP2 energy gradients were performed for taxol and luciferin on a cluster of Pentium 4 computers. The speedups are very good up to 80 CPU cores we have tested. For instance, the speedup ratios are 28.2 - 33.0 on 32 processors, corresponding to 88% - 103% of linear speedup. This indicates the high parallel efficiency of the present algorithm. The calculation of taxol with 6-31G(d) (1032 contracted basis functions) finishes within 2 hours on 32 processors, which requires only 1.8GB memory and 13.4GB hard disk per processor. Therefore, geometry optimization of molecules with 1000 basis functions can be easily performed using standard PC clusters. In Chapter IV, several applications of MP2 are performed using the program developed in Chapters II and III. Some molecules that DFT cannot treat well are optimized at the MP2 level. Geometry optimization is also carried out using the spin-component scaled (SCS) MP2 method. In this method, a different scaling is employed for the same and opposite spin components of the MP2 energy, so that SCS-MP2 performs as well as the much more costly CCSD(T) method at a high level of theory. SAC theory is developed for ground states and based on CC theory that describes higher-order electron correlation. The main factor of electron correlation is collisions of two electrons. In CC theory, most collisions of four electrons can be taken in as the product of collisions of tw
Second-order Møller-Plesset perturbation theory using the Resolution-of-the-Identity approximation (RI-MP2) is a state-of-the-art approach to accurately estimate many-body electronic correlation effects. This is critical for predicting the physicochemical properties of complex molecular systems; however, the scale of these calculations is limited by their extremely high computational cost. In this paper, a novel many-GPU algorithm and implementation of a molecular-fragmentation-based RI-MP2 method are presented that enable correlated calculations on over 180,000 electrons and 45,000 atoms using up to the entire Summit supercomputer in 12 minutes. The implementation demonstrates remarkable speedups with respect to other current GPU and CPU codes, excellent strong scalability on Summit achieving 89.1% parallel efficiency on 4600 nodes, and shows nearly-ideal weak scaling up to 612 nodes. This work makes feasible ab initio correlated quantum chemistry calculations on significantly larger molecular scales than before on both large supercomputing systems and on commodity clusters, with a potential for major impact on progress in chemical, physical, biological and engineering sciences.
The development of novel double-hybrid density functionals offers new levels of accuracy and is leading to fresh insights into the fundamental properties of matter. Hartree-Fock exact exchange and correlated wave function methods, such as second-order Møller-Plesset (MP2) and direct random phase approximation (dRPA), are usually required to build such functionals. Their high computational cost is a concern, and their application to large and periodic systems is, therefore, limited. In this work, low-scaling methods for Hartree-Fock exchange (HFX), SOS-MP2, and direct RPA energy gradients are developed and implemented in the CP2K software package. The use of the resolution-of-the-identity approximation with a short range metric and atom-centered basis functions leads to sparsity, allowing for sparse tensor contractions to take place. These operations are efficiently performed with the newly developed Distributed Block-sparse Tensors (DBT) and Distributed Block-sparse Matrices (DBM) libraries, which scale to hundreds of graphics processing unit (GPU) nodes. The resulting methods, resolution-of-the-identity (RI)-HFX, SOS-MP2, and dRPA, were benchmarked on large supercomputers. They exhibit favorable sub-cubic scaling with system size, good strong scaling performance, and GPU acceleration up to a factor of 3. These developments will allow for double-hybrid level calculations of large and periodic condensed phase systems to take place on a more regular basis.
Post-Hartree-Fock methods are wavefunction-based quantum chemistry approaches that explicitly account for the electron correlation beyond the mean-field approximation, allowing accurate determination of electron orbitals and energies in a given system. However, their computational cost scales as the fourth power or higher with respect to the number of atoms, severely limiting their practical applications. This paper proposes an efficient GPU implementation of the Møller-Plesset method, a post-Hartree-Fock approach based on perturbation theory. We focus on the computation of second- and thirdorder perturbation energies (MP2 and MP3) for closed-shell systems, which incorporate electron correlation on top of the Hartree-Fock energy. To accelerate the extensive contraction operations arising in the Møller-Plesset method, our implementation employs a formulation that maximizes the use of highly optimized matrix multiplication routines. Furthermore, we effectively utilize computational capabilities of GPU architecture through a hierarchical reduction using warp-level primitives and shared memory, as well as contiguous coalesced access to matrix elements. Performance evaluation on an NVIDIA A100 GPU shows up to 255.5 and 71.1 times speedups for the MP2 correlation energy computation, compared with the widely used quantum chemistry software package PySCF and its GPU plugin GPU4PySCF, respectively. In the MP3 calculations, our DGEMM-based implementation achieves a maximum speedup of 96.2 times over PySCF.