Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Lower-scaling advanced correlation methods with local Resolution of Identity strategies

Arvid Conrad Ihrig

Published Jan 1, 2017• 0 citations
Publisher

Abstract

First-principles methods are a valuable tool to study the electronic structure of systems and explore the quantum-mechanical mechanisms driving them on the microscopic scale. Semi-local Density-Functional Approximations (DFAs) are still very popular due to the good balance between accuracy and computational efficiency. However, the instantaneous electronic interactions are described with an averaged potential in these methods, which is often insufficient to describe charge transfers or subtle many-body correlations. A promising way to improve the description of such interactions is the usage of advanced correlation methods which explicitly treat the electronic interactions in a many-body picture. Well known methods form this class are e.g. the Random- Phase Approximation (RPA), 2nd Order Møller-Plesset Perturbation Theory (MP2) and Coupled-Cluster Theory (CC). Unfortunately, the time and memory requirements for all these methods suffer from a steep scaling with system size in their canonical formulations. Several lower-scaling reformulations exist for these methods, but the at least cubic memory requirements and the increased algorithmic complexity prevented any efficient parallelization of these methods so far. In my thesis I developed a new lower-scaling technique for advanced correlation methods to address this challenge. The key components of this technique are the Laplace-Transformation (LT) and a new local Resolution of Identity (RI) strategy, named RI-LVL. Together, they significantly reduce the memory requirement without sacrificing accuracy and allow for an efficient parallelization by means of à priori known sparsity patterns. In combination with established integral screening techniques, the computational scaling can also be reduced considerably. The potential of this new approach is demonstrated at the example of an in-memory LT-MP2 with a MPI/OpenMP hybrid parallelization. It features an at worst cubic computational scaling, a quadratic memory scaling and a high parallel efficiency. Based on the Numeric Atom-Centered Orbital (NAO) framework used in the Fritz Haber Institute ab initio molecular simulations (FHI-aims) code, this implementation can handle both molecular and periodic systems with the same numerical footing. I will also discuss in detail how the combination of the LT and RI- LVL can be applied to RPA calculations. The accuracy and performance of my LT- MP2 is demonstrated in detail for both molecular and periodic systems. In addition, the convergence of the MP2 level adsorption energy of water on a rutile titanium dioxide (TiO2) surface in the low coverage limit is explored. This new LT-MP2 recovers more than 99.9% of the canonical MP2 correlation energy and can handle TiO2 surfaces with up to 270 atoms in the unit cell.

DOI
10.17169/refubium-16003

Related papers

Formulation and implementation of accurate and efficient low-scaling methods for explicitly correlated F12 theory

Lars Urban

One of the major obstacles in modern quantum chemistry is the need to employ exceedingly large one-electron basis sets in electron correlation methods to obtain reliably accurate results. The family of explicitly correlated wave function methods circumvents this issue by introducing terms that explicitly depend on the interelectronic distance, thereby enforcing the correct electron–electron cusp behavior, albeit at the cost of additional complicated many-electron integrals when evaluated without further approximation. The main focus of the present work is the efficient, low-scaling evaluation of explicitly correlated approaches, examined here through the explicitly correlated correction to second-order Møller–Plesset perturbation theory (MP2-F12) as a representative example. While these methods are highly effective in reducing the basis set incompleteness error, the cost associated with the corresponding correction often far exceeds that of the underlying correlation method. To overcome these limitations, several techniques and strategies are introduced to significantly reduce computational demand and resolve the main bottlenecks that arise. A particularly straightforward approach is provided by the scaled MP2-F12 ansatz, which introduces a single empirically determined factor that scales the direct-type geminal–geminal terms to closely reproduce the MP2-F12 correction, thereby omitting the most expensive exchange-type contributions. Furthermore, the computation of Fock matrix elements spanning multiple orbital spaces is drastically accelerated by extending techniques originally developed for Hartree–Fock and density functional theory. The direct contributions are evaluated using a modified resolution-of-the-identity Coulomb (RI-J) approach employing the J-engine ansatz for integral construction, while the exchange contributions are treated via three-dimensional numerical quadrature in the form of the seminumerical sn-LinK method. These approaches reduce the computational cost by more than three orders of magnitude compared to the approximation-free evaluation while maintaining high accuracy, with additional speedups achieved by exploiting the massive parallelism of graphics processing units. The central focus of this work is the efficient decomposition of complicated exchange-type multi-electron integrals, where numerical quadrature plays a key role in improving performance. The complementary auxiliary basis set resolution of the identity (CABS-RI) reduces the most expensive exchange-type integral to a three-electron integral, which is then efficiently decomposed via numerical quadrature. In this context, a highly efficient batch-wise, distance-dependent integral screening exploiting the short-range behavior of F12 operators is introduced, significantly improving performance and enabling near-linear-scaling evaluations while retaining high accuracy. These strategies are extended to all exchange-type contributions in F12 theory, leading to an alternative formulation of integrals better suited for efficient factorization. A novel combination of numerical quadrature with density fitting is presented for the efficient computation of products of four-center two-electron integrals, alongside algorithms covering all exchange-type contributions, including advantageous batching strategies. In general, the formal computational cost with system size M is reduced from O(M⁵) to O(M⁴), with further improvements appearing feasible through the use of localized molecular orbitals combined with advanced integral screening techniques.

•Jan 1, 2026•0 citations

Development of low-scaling methods to calculate ground state energies and analytical gradients based on the adiabatic-connection fluctuation-dissipation theorem

Matthias Beuerle

New methods to efficiently calculate energetics and first order-properties for mean-field and correlated electronic structure theories are presented. In linear-scaling short-range hybrid calculations new integral screening criteria exploiting the locality of the attenuated Coulomb operator are introduced that allow to significantly increase the performance of these density functionals. This enables short-range hybrid calculations at a similar cost as pure semi-local density functional theory (DFT) calculations with increased accuracy due to the admixture of exchange. At the level of correlated electronic structure theory, the realm of systems which can be calculated with a linear-scaling random-phase-approximation (RPA) method is extended with a novel multi-node parallel algorithm. Furthermore, more efficient quadrature schemes are used based on the equivalence of the employed integral transforms with the Fourier transform of the non-interacting polarizability. In combination with a new way to introduce Cholesky orbitals this results in a more effient and numerically more accurate linear-scaling RPA correlation energy method with improved memory requirements. Combining these techniques further with an approach to calculate analytical first order properties using quantities from many body perturbation theory, allows to present a low-scaling method that gives access to RPA gradients for molecular systems with several hundred atoms. Moreover linear- and low-scaling methods to calculate different beyond RPA correlation energies are devised, exploiting the locality of exchange type contractions. This enables to apply these more accurate RPA methods to significantly larger systems, which allows to demonstrate the gain in accuracy for large, dispersion dominated systems. The newly developed methods extend the scope of RPA and RPA with exchange correlation energies, and first order RPA properties significantly, while the accuracy is under full numerical control. Furthermore, there is no overhead to the respective canonical algorithm, making the presented methods competitive also for small system sizes. Finally, a new beyond RPA scheme is presented that combines the benefits of plain RPA and RPA with second-order screened exchange, leading to a more balanced, highly accurate post Kohn-Sham method.

•Jan 1, 2019•0 citations

Enabling large-scale correlated electronic structure calculations: scaling the RI-MP2 method on summit

Giuseppe M. J. Barca, Jorge Luis Galvez Vallejo, David Poole +4 more

Second-order Møller-Plesset perturbation theory using the Resolution-of-the-Identity approximation (RI-MP2) is a state-of-the-art approach to accurately estimate many-body electronic correlation effects. This is critical for predicting the physicochemical properties of complex molecular systems; however, the scale of these calculations is limited by their extremely high computational cost. In this paper, a novel many-GPU algorithm and implementation of a molecular-fragmentation-based RI-MP2 method are presented that enable correlated calculations on over 180,000 electrons and 45,000 atoms using up to the entire Summit supercomputer in 12 minutes. The implementation demonstrates remarkable speedups with respect to other current GPU and CPU codes, excellent strong scalability on Summit achieving 89.1% parallel efficiency on 4600 nodes, and shows nearly-ideal weak scaling up to 612 nodes. This work makes feasible ab initio correlated quantum chemistry calculations on significantly larger molecular scales than before on both large supercomputing systems and on commodity clusters, with a potential for major impact on progress in chemical, physical, biological and engineering sciences.

International Conference for High Performance Computing, Networking, Storage and Analysis (SC)•Oct 21, 2021•19 citations

Sparse tensor based nuclear gradients for periodic Hartree–Fock and low-scaling correlated wave function methods in the CP2K software package: A massively parallel and GPU accelerated implementation

Augustin Bussy, Ole Schütt, Jürg Hutter

The development of novel double-hybrid density functionals offers new levels of accuracy and is leading to fresh insights into the fundamental properties of matter. Hartree-Fock exact exchange and correlated wave function methods, such as second-order Møller-Plesset (MP2) and direct random phase approximation (dRPA), are usually required to build such functionals. Their high computational cost is a concern, and their application to large and periodic systems is, therefore, limited. In this work, low-scaling methods for Hartree-Fock exchange (HFX), SOS-MP2, and direct RPA energy gradients are developed and implemented in the CP2K software package. The use of the resolution-of-the-identity approximation with a short range metric and atom-centered basis functions leads to sparsity, allowing for sparse tensor contractions to take place. These operations are efficiently performed with the newly developed Distributed Block-sparse Tensors (DBT) and Distributed Block-sparse Matrices (DBM) libraries, which scale to hundreds of graphics processing unit (GPU) nodes. The resulting methods, resolution-of-the-identity (RI)-HFX, SOS-MP2, and dRPA, were benchmarked on large supercomputers. They exhibit favorable sub-cubic scaling with system size, good strong scaling performance, and GPU acceleration up to a factor of 3. These developments will allow for double-hybrid level calculations of large and periodic condensed phase systems to take place on a more regular basis.

The Journal of Chemical Physics•Apr 27, 2023•19 citations

Development of Efficient Algorithms for Quantum Chemistry Calculations of Large Molecules

和也 石村, カズヤ イシムラ, Kazuya Ishimura

Quantum chemistry plays an important role in elucidating molecular geometries, electronic states, and reaction mechanisms, because of the developments of a variety of theoretical methods, such as Hartree-Fock (HF), Møler-Plesset (MP) perturbation, configuration interaction (CI), coupled-cluster (CC), and density functional theory (DFT) methods. Electronic structure calculations have been carried out by not only theoretical chemists but also experimental chemists. DFT is currently most widely used to investigate large molecules in the ground state as well as small molecules because of the low computational cost. However, the generally used functionals fail to describe correctly non-covalent interactions that are important for host-guest molecules, self-assembly, and molecular recognition, and they tend to underestimate reaction barriers. Many attempts have been made to develop new functionals and add semiempirical or empirical correction terms to standard functionals, but no generally accepted DFT method has emerged yet. Second-order Møler-Plesset perturbation theory (MP2) is the simplest method that includes electron correlation important for non-covalent interactions and reaction barriers nonempirically. However, the computational cost of MP2 is considerably higher than that of DFT. In addition, much larger sizes of fast memory and hard disk are required in MP2 calculations. These make MP2 calculations increasingly difficult for larger molecules. Since workstation or personal computer (PC) clusters have become popular for quantum chemistry calculations, an efficient parallel calculation is a solution of the problem. Therefore, new parallel algorithms for MP2 energy and gradient calculations are presented in this thesis. Furthermore, an efficient algorithm for the generation of two-electron repulsion integrals (ERIs) which is important in quantum chemistry calculations is also presented. For the calculations of excited states, different approaches are required: for example, CI, multi-configuration self-consistent field (MCSCF), time-dependent DFT (TDDFT), and symmetry adapted cluster (SAC)/SAC-CI methods. One of the most accurate methods is SAC/SAC-CI, as demonstrated for many molecules. In this thesis, SAC/SAC-CI calculations of ground, ionized, and excited states are presented. This thesis consists of five chapters: a new algorithm of two-electron repulsion integral calculations (Chapter I), a new parallel algorithm of MP2 energy calculations (Chapter II), a new parallel algorithm of MP2 energy gradient calculations (Chapter III), applications of MP2 calculations (Chapter IV), and SAC/SAC-CI calculations of ionized and excited states (Chapter V). In quantum chemistry calculations, the generation of ERIs is one of the most basic subjects and is the most time-consuming step especially in direct SCF calculations. Many algorithms have been developed to reduce the computational cost. In Pople-Hehre algorithm, Cartesian axes are rotated to make several coordinate components zero or constant, so that these components are skipped in the generation of ERIs. In McMurchie-Davidson algorithm, ERIs are generated from (ss|ss) type integrals using a recurrence relation derived from Hermite polynomials. By combining these two algorithms, a new algorithm is developed in Chapter I. The results show that the new algorithm reduces the computational cost by 10 - 40%, as compared with the original algorithms. It is notable that the generation of ERIs including d functions is considerably fast. The program implemented officially in GAMESS in 2004 has been used all over the world. In quantum mechanics, perturbation methods can be used for adding corrections to reference solutions. In the MP perturbation method, a sum over Fock operators is used as the reference term, and the exact two-electron repulsion operator minus twice the average two-electron repulsion operator is used as the perturbation term. It is the advantage that the MP perturbation method is size consistent and size extensive, unlike truncated CI methods. The zero-order wave function is the HF Slater determinant, and the zero-order energy is expressed as a sum of occupied molecular orbital (MO) energies. The first-order perturbation is the correction for the overcounting of two-electron repulsions at zero-order, and the first-order energy corresponds to the HF energy. The MP correlation starts at second-order. In general, second-order (MP2) accounts for 80 - 90% of electron correlation. Therefore, MP2 is focused in this thesis since it is applicable to large molecules with considerable reliability and low computational cost. The formal computational scaling of MP2 energy calculations with respect to molecular size is fifth order, much higher than that of DFT energy calculations. Therefore, less expensive methods, such as Local MP2, density fitting (resolution of identity, RI) MP2, and Laplace Transform MP2, have been developed. However, all of these methods include approximations or cut-offs that need to be checked against full MP2 energies. An alternative approach to reduce the computational cost is to parallelize MP2 energy calculations. A number of papers on parallel MP2 energy calculations have been published. Almost all of them are based on simple parallelization methods that distribute only atomic orbital (AO) or MO indices to each processor. These methods have a disadvantage since intermediate integrals are broadcasted to all CPUs or the same AO ERIs are generated in all processors. Baker and Pulay developed a new parallel algorithm using SaebøAlmlöf integral transformation method. This algorithm parallelizes the first half transformation by AO indices and the second half transformation by MO indices. The advantages are that the total amount of network communication is independent of the number of processors and the AO integrals are generated only once. The disadvantage is the I/O overhead for the sorting of half-transformed integrals. A new parallel algorithm for MP2 energy calculations based on the two-step parallelization idea is presented in Chapter II. In this algorithm, AO indices are distributed in the AO integral generation and the first three quarter transformation, and MO indices are distributed in the last quarter transformation and MP2 energy calculation. Because the algorithm makes the sorting of intermediate integrals very simple, the parallel efficiency is highly improved and the I/O overhead is removed. Furthermore, the algorithm reduces highly the floating point operation (FLOP) count as well as the required memory and hard disk space, in comparison with other algorithms. Test calculations of taxol (C47H51NO14) and luciferin (C11H8N2O3S2) were performed on a cluster of Pentium 4 computers connected by gigabit Ethernet. The parallel scaling of the developed code is excellent up to the largest number of processors we have tested. For instance, the elapsed time for the MP2 energy calculations on 16 processors is on average 15.4 times faster than that on the single-processor. Determination of molecular geometries and reaction paths is a fundamental task in quantum chemistry and requires energy gradients with respect to nuclear coordinates. In Chapter III, a new parallel algorithm for MP2 energy gradient calculations is presented. The algorithm consists of 5 steps, the integral transformation, the MP2 amplitude calculation, the MP2 Lagrangian calculation, the coupled-perturbed HF calculation, and the integral derivative calculation. All steps are parallelized by distributing AO or MO indices. The algorithm also reduces the FLOP count, the required memory, and hard disk space. Test calculations of MP2 energy gradients were performed for taxol and luciferin on a cluster of Pentium 4 computers. The speedups are very good up to 80 CPU cores we have tested. For instance, the speedup ratios are 28.2 - 33.0 on 32 processors, corresponding to 88% - 103% of linear speedup. This indicates the high parallel efficiency of the present algorithm. The calculation of taxol with 6-31G(d) (1032 contracted basis functions) finishes within 2 hours on 32 processors, which requires only 1.8GB memory and 13.4GB hard disk per processor. Therefore, geometry optimization of molecules with 1000 basis functions can be easily performed using standard PC clusters. In Chapter IV, several applications of MP2 are performed using the program developed in Chapters II and III. Some molecules that DFT cannot treat well are optimized at the MP2 level. Geometry optimization is also carried out using the spin-component scaled (SCS) MP2 method. In this method, a different scaling is employed for the same and opposite spin components of the MP2 energy, so that SCS-MP2 performs as well as the much more costly CCSD(T) method at a high level of theory. SAC theory is developed for ground states and based on CC theory that describes higher-order electron correlation. The main factor of electron correlation is collisions of two electrons. In CC theory, most collisions of four electrons can be taken in as the product of collisions of tw

•Sep 28, 2007•0 citations

Sparse maps—A systematic infrastructure for reduced-scaling electronic structure methods. I. An efficient and simple linear scaling local MP2 method that uses an intermediate basis of pair natural orbitals

Peter Pinski, Christoph Riplinger, Edward F. Valeev +1 more

In this work, a systematic infrastructure is described that formalizes concepts implicit in previous work and greatly simplifies computer implementation of reduced-scaling electronic structure methods. The key concept is sparse representation of tensors using chains of sparse maps between two index sets. Sparse map representation can be viewed as a generalization of compressed sparse row, a common representation of a sparse matrix, to tensor data. By combining few elementary operations on sparse maps (inversion, chaining, intersection, etc.), complex algorithms can be developed, illustrated here by a linear-scaling transformation of three-center Coulomb integrals based on our compact code library that implements sparse maps and operations on them. The sparsity of the three-center integrals arises from spatial locality of the basis functions and domain density fitting approximation. A novel feature of our approach is the use of differential overlap integrals computed in linear-scaling fashion for screening products of basis functions. Finally, a robust linear scaling domain based local pair natural orbital second-order Möller-Plesset (DLPNO-MP2) method is described based on the sparse map infrastructure that only depends on a minimal number of cutoff parameters that can be systematically tightened to approach 100% of the canonical MP2 correlation energy. With default truncation thresholds, DLPNO-MP2 recovers more than 99.9% of the canonical resolution of the identity MP2 (RI-MP2) energy while still showing a very early crossover with respect to the computational effort. Based on extensive benchmark calculations, relative energies are reproduced with an error of typically <0.2 kcal/mol. The efficiency of the local MP2 (LMP2) method can be drastically improved by carrying out the LMP2 iterations in a basis of pair natural orbitals. While the present work focuses on local electron correlation, it is of much broader applicability to computation with sparse tensors in quantum chemistry and beyond.

The Journal of Chemical Physics•Jul 21, 2015•320 citations
First-principles methods are a valuable tool to study the electronic structure of systems and explore the quantum-mechanical mechanisms driving them on the microscopic scale. Semi-local Density-Functional Approximations (DFAs) are still very popular due to the good balance between accuracy and computational efficiency. However, the instantaneous electronic interactions are described with an averaged potential in these methods, which is often insufficient to describe charge transfers or subtle many-body correlations. A promising way to improve the description of such interactions is the usage of advanced correlation methods which explicitly treat the electronic interactions in a many-body picture. Well known methods form this class are e.g. the Random- Phase Approximation (RPA), 2nd Order Møller-Plesset Perturbation Theory (MP2) and Coupled-Cluster Theory (CC). Unfortunately, the time and memory requirements for all these methods suffer from a steep scaling with system size in their canonical formulations. Several lower-scaling reformulations exist for these methods, but the at least cubic memory requirements and the increased algorithmic complexity prevented any efficient parallelization of these methods so far. In my thesis I developed a new lower-scaling technique for advanced correlation methods to address this challenge. The key components of this technique are the Laplace-Transformation (LT) and a new local Resolution of Identity (RI) strategy, named RI-LVL. Together, they significantly reduce the memory requirement without sacrificing accuracy and allow for an efficient parallelization by means of à priori known sparsity patterns. In combination with established integral screening techniques, the computational scaling can also be reduced considerably. The potential of this new approach is demonstrated at the example of an in-memory LT-MP2 with a MPI/OpenMP hybrid parallelization. It features an at worst cubic computational scaling, a quadratic memory scaling and a high parallel efficiency. Based on the Numeric Atom-Centered Orbital (NAO) framework used in the Fritz Haber Institute ab initio molecular simulations (FHI-aims) code, this implementation can handle both molecular and periodic systems with the same numerical footing. I will also discuss in detail how the combination of the LT and RI- LVL can be applied to RPA calculations. The accuracy and performance of my LT- MP2 is demonstrated in detail for both molecular and periodic systems. In addition, the convergence of the MP2 level adsorption energy of water on a rutile titanium dioxide (TiO2) surface in the low coverage limit is explored. This new LT-MP2 recovers more than 99.9% of the canonical MP2 correlation energy and can handle TiO2 surfaces with up to 270 atoms in the unit cell.
One of the major obstacles in modern quantum chemistry is the need to employ exceedingly large one-electron basis sets in electron correlation methods to obtain reliably accurate results. The family of explicitly correlated wave function methods circumvents this issue by introducing terms that explicitly depend on the interelectronic distance, thereby enforcing the correct electron–electron cusp behavior, albeit at the cost of additional complicated many-electron integrals when evaluated without further approximation. The main focus of the present work is the efficient, low-scaling evaluation of explicitly correlated approaches, examined here through the explicitly correlated correction to second-order Møller–Plesset perturbation theory (MP2-F12) as a representative example. While these methods are highly effective in reducing the basis set incompleteness error, the cost associated with the corresponding correction often far exceeds that of the underlying correlation method. To overcome these limitations, several techniques and strategies are introduced to significantly reduce computational demand and resolve the main bottlenecks that arise. A particularly straightforward approach is provided by the scaled MP2-F12 ansatz, which introduces a single empirically determined factor that scales the direct-type geminal–geminal terms to closely reproduce the MP2-F12 correction, thereby omitting the most expensive exchange-type contributions. Furthermore, the computation of Fock matrix elements spanning multiple orbital spaces is drastically accelerated by extending techniques originally developed for Hartree–Fock and density functional theory. The direct contributions are evaluated using a modified resolution-of-the-identity Coulomb (RI-J) approach employing the J-engine ansatz for integral construction, while the exchange contributions are treated via three-dimensional numerical quadrature in the form of the seminumerical sn-LinK method. These approaches reduce the computational cost by more than three orders of magnitude compared to the approximation-free evaluation while maintaining high accuracy, with additional speedups achieved by exploiting the massive parallelism of graphics processing units. The central focus of this work is the efficient decomposition of complicated exchange-type multi-electron integrals, where numerical quadrature plays a key role in improving performance. The complementary auxiliary basis set resolution of the identity (CABS-RI) reduces the most expensive exchange-type integral to a three-electron integral, which is then efficiently decomposed via numerical quadrature. In this context, a highly efficient batch-wise, distance-dependent integral screening exploiting the short-range behavior of F12 operators is introduced, significantly improving performance and enabling near-linear-scaling evaluations while retaining high accuracy. These strategies are extended to all exchange-type contributions in F12 theory, leading to an alternative formulation of integrals better suited for efficient factorization. A novel combination of numerical quadrature with density fitting is presented for the efficient computation of products of four-center two-electron integrals, alongside algorithms covering all exchange-type contributions, including advantageous batching strategies. In general, the formal computational cost with system size M is reduced from O(M⁵) to O(M⁴), with further improvements appearing feasible through the use of localized molecular orbitals combined with advanced integral screening techniques.
New methods to efficiently calculate energetics and first order-properties for mean-field and correlated electronic structure theories are presented. In linear-scaling short-range hybrid calculations new integral screening criteria exploiting the locality of the attenuated Coulomb operator are introduced that allow to significantly increase the performance of these density functionals. This enables short-range hybrid calculations at a similar cost as pure semi-local density functional theory (DFT) calculations with increased accuracy due to the admixture of exchange. At the level of correlated electronic structure theory, the realm of systems which can be calculated with a linear-scaling random-phase-approximation (RPA) method is extended with a novel multi-node parallel algorithm. Furthermore, more efficient quadrature schemes are used based on the equivalence of the employed integral transforms with the Fourier transform of the non-interacting polarizability. In combination with a new way to introduce Cholesky orbitals this results in a more effient and numerically more accurate linear-scaling RPA correlation energy method with improved memory requirements. Combining these techniques further with an approach to calculate analytical first order properties using quantities from many body perturbation theory, allows to present a low-scaling method that gives access to RPA gradients for molecular systems with several hundred atoms. Moreover linear- and low-scaling methods to calculate different beyond RPA correlation energies are devised, exploiting the locality of exchange type contractions. This enables to apply these more accurate RPA methods to significantly larger systems, which allows to demonstrate the gain in accuracy for large, dispersion dominated systems. The newly developed methods extend the scope of RPA and RPA with exchange correlation energies, and first order RPA properties significantly, while the accuracy is under full numerical control. Furthermore, there is no overhead to the respective canonical algorithm, making the presented methods competitive also for small system sizes. Finally, a new beyond RPA scheme is presented that combines the benefits of plain RPA and RPA with second-order screened exchange, leading to a more balanced, highly accurate post Kohn-Sham method.
Second-order Møller-Plesset perturbation theory using the Resolution-of-the-Identity approximation (RI-MP2) is a state-of-the-art approach to accurately estimate many-body electronic correlation effects. This is critical for predicting the physicochemical properties of complex molecular systems; however, the scale of these calculations is limited by their extremely high computational cost. In this paper, a novel many-GPU algorithm and implementation of a molecular-fragmentation-based RI-MP2 method are presented that enable correlated calculations on over 180,000 electrons and 45,000 atoms using up to the entire Summit supercomputer in 12 minutes. The implementation demonstrates remarkable speedups with respect to other current GPU and CPU codes, excellent strong scalability on Summit achieving 89.1% parallel efficiency on 4600 nodes, and shows nearly-ideal weak scaling up to 612 nodes. This work makes feasible ab initio correlated quantum chemistry calculations on significantly larger molecular scales than before on both large supercomputing systems and on commodity clusters, with a potential for major impact on progress in chemical, physical, biological and engineering sciences.
The development of novel double-hybrid density functionals offers new levels of accuracy and is leading to fresh insights into the fundamental properties of matter. Hartree-Fock exact exchange and correlated wave function methods, such as second-order Møller-Plesset (MP2) and direct random phase approximation (dRPA), are usually required to build such functionals. Their high computational cost is a concern, and their application to large and periodic systems is, therefore, limited. In this work, low-scaling methods for Hartree-Fock exchange (HFX), SOS-MP2, and direct RPA energy gradients are developed and implemented in the CP2K software package. The use of the resolution-of-the-identity approximation with a short range metric and atom-centered basis functions leads to sparsity, allowing for sparse tensor contractions to take place. These operations are efficiently performed with the newly developed Distributed Block-sparse Tensors (DBT) and Distributed Block-sparse Matrices (DBM) libraries, which scale to hundreds of graphics processing unit (GPU) nodes. The resulting methods, resolution-of-the-identity (RI)-HFX, SOS-MP2, and dRPA, were benchmarked on large supercomputers. They exhibit favorable sub-cubic scaling with system size, good strong scaling performance, and GPU acceleration up to a factor of 3. These developments will allow for double-hybrid level calculations of large and periodic condensed phase systems to take place on a more regular basis.
Quantum chemistry plays an important role in elucidating molecular geometries, electronic states, and reaction mechanisms, because of the developments of a variety of theoretical methods, such as Hartree-Fock (HF), Møler-Plesset (MP) perturbation, configuration interaction (CI), coupled-cluster (CC), and density functional theory (DFT) methods. Electronic structure calculations have been carried out by not only theoretical chemists but also experimental chemists. DFT is currently most widely used to investigate large molecules in the ground state as well as small molecules because of the low computational cost. However, the generally used functionals fail to describe correctly non-covalent interactions that are important for host-guest molecules, self-assembly, and molecular recognition, and they tend to underestimate reaction barriers. Many attempts have been made to develop new functionals and add semiempirical or empirical correction terms to standard functionals, but no generally accepted DFT method has emerged yet. Second-order Møler-Plesset perturbation theory (MP2) is the simplest method that includes electron correlation important for non-covalent interactions and reaction barriers nonempirically. However, the computational cost of MP2 is considerably higher than that of DFT. In addition, much larger sizes of fast memory and hard disk are required in MP2 calculations. These make MP2 calculations increasingly difficult for larger molecules. Since workstation or personal computer (PC) clusters have become popular for quantum chemistry calculations, an efficient parallel calculation is a solution of the problem. Therefore, new parallel algorithms for MP2 energy and gradient calculations are presented in this thesis. Furthermore, an efficient algorithm for the generation of two-electron repulsion integrals (ERIs) which is important in quantum chemistry calculations is also presented. For the calculations of excited states, different approaches are required: for example, CI, multi-configuration self-consistent field (MCSCF), time-dependent DFT (TDDFT), and symmetry adapted cluster (SAC)/SAC-CI methods. One of the most accurate methods is SAC/SAC-CI, as demonstrated for many molecules. In this thesis, SAC/SAC-CI calculations of ground, ionized, and excited states are presented. This thesis consists of five chapters: a new algorithm of two-electron repulsion integral calculations (Chapter I), a new parallel algorithm of MP2 energy calculations (Chapter II), a new parallel algorithm of MP2 energy gradient calculations (Chapter III), applications of MP2 calculations (Chapter IV), and SAC/SAC-CI calculations of ionized and excited states (Chapter V). In quantum chemistry calculations, the generation of ERIs is one of the most basic subjects and is the most time-consuming step especially in direct SCF calculations. Many algorithms have been developed to reduce the computational cost. In Pople-Hehre algorithm, Cartesian axes are rotated to make several coordinate components zero or constant, so that these components are skipped in the generation of ERIs. In McMurchie-Davidson algorithm, ERIs are generated from (ss|ss) type integrals using a recurrence relation derived from Hermite polynomials. By combining these two algorithms, a new algorithm is developed in Chapter I. The results show that the new algorithm reduces the computational cost by 10 - 40%, as compared with the original algorithms. It is notable that the generation of ERIs including d functions is considerably fast. The program implemented officially in GAMESS in 2004 has been used all over the world. In quantum mechanics, perturbation methods can be used for adding corrections to reference solutions. In the MP perturbation method, a sum over Fock operators is used as the reference term, and the exact two-electron repulsion operator minus twice the average two-electron repulsion operator is used as the perturbation term. It is the advantage that the MP perturbation method is size consistent and size extensive, unlike truncated CI methods. The zero-order wave function is the HF Slater determinant, and the zero-order energy is expressed as a sum of occupied molecular orbital (MO) energies. The first-order perturbation is the correction for the overcounting of two-electron repulsions at zero-order, and the first-order energy corresponds to the HF energy. The MP correlation starts at second-order. In general, second-order (MP2) accounts for 80 - 90% of electron correlation. Therefore, MP2 is focused in this thesis since it is applicable to large molecules with considerable reliability and low computational cost. The formal computational scaling of MP2 energy calculations with respect to molecular size is fifth order, much higher than that of DFT energy calculations. Therefore, less expensive methods, such as Local MP2, density fitting (resolution of identity, RI) MP2, and Laplace Transform MP2, have been developed. However, all of these methods include approximations or cut-offs that need to be checked against full MP2 energies. An alternative approach to reduce the computational cost is to parallelize MP2 energy calculations. A number of papers on parallel MP2 energy calculations have been published. Almost all of them are based on simple parallelization methods that distribute only atomic orbital (AO) or MO indices to each processor. These methods have a disadvantage since intermediate integrals are broadcasted to all CPUs or the same AO ERIs are generated in all processors. Baker and Pulay developed a new parallel algorithm using SaebøAlmlöf integral transformation method. This algorithm parallelizes the first half transformation by AO indices and the second half transformation by MO indices. The advantages are that the total amount of network communication is independent of the number of processors and the AO integrals are generated only once. The disadvantage is the I/O overhead for the sorting of half-transformed integrals. A new parallel algorithm for MP2 energy calculations based on the two-step parallelization idea is presented in Chapter II. In this algorithm, AO indices are distributed in the AO integral generation and the first three quarter transformation, and MO indices are distributed in the last quarter transformation and MP2 energy calculation. Because the algorithm makes the sorting of intermediate integrals very simple, the parallel efficiency is highly improved and the I/O overhead is removed. Furthermore, the algorithm reduces highly the floating point operation (FLOP) count as well as the required memory and hard disk space, in comparison with other algorithms. Test calculations of taxol (C47H51NO14) and luciferin (C11H8N2O3S2) were performed on a cluster of Pentium 4 computers connected by gigabit Ethernet. The parallel scaling of the developed code is excellent up to the largest number of processors we have tested. For instance, the elapsed time for the MP2 energy calculations on 16 processors is on average 15.4 times faster than that on the single-processor. Determination of molecular geometries and reaction paths is a fundamental task in quantum chemistry and requires energy gradients with respect to nuclear coordinates. In Chapter III, a new parallel algorithm for MP2 energy gradient calculations is presented. The algorithm consists of 5 steps, the integral transformation, the MP2 amplitude calculation, the MP2 Lagrangian calculation, the coupled-perturbed HF calculation, and the integral derivative calculation. All steps are parallelized by distributing AO or MO indices. The algorithm also reduces the FLOP count, the required memory, and hard disk space. Test calculations of MP2 energy gradients were performed for taxol and luciferin on a cluster of Pentium 4 computers. The speedups are very good up to 80 CPU cores we have tested. For instance, the speedup ratios are 28.2 - 33.0 on 32 processors, corresponding to 88% - 103% of linear speedup. This indicates the high parallel efficiency of the present algorithm. The calculation of taxol with 6-31G(d) (1032 contracted basis functions) finishes within 2 hours on 32 processors, which requires only 1.8GB memory and 13.4GB hard disk per processor. Therefore, geometry optimization of molecules with 1000 basis functions can be easily performed using standard PC clusters. In Chapter IV, several applications of MP2 are performed using the program developed in Chapters II and III. Some molecules that DFT cannot treat well are optimized at the MP2 level. Geometry optimization is also carried out using the spin-component scaled (SCS) MP2 method. In this method, a different scaling is employed for the same and opposite spin components of the MP2 energy, so that SCS-MP2 performs as well as the much more costly CCSD(T) method at a high level of theory. SAC theory is developed for ground states and based on CC theory that describes higher-order electron correlation. The main factor of electron correlation is collisions of two electrons. In CC theory, most collisions of four electrons can be taken in as the product of collisions of tw
In this work, a systematic infrastructure is described that formalizes concepts implicit in previous work and greatly simplifies computer implementation of reduced-scaling electronic structure methods. The key concept is sparse representation of tensors using chains of sparse maps between two index sets. Sparse map representation can be viewed as a generalization of compressed sparse row, a common representation of a sparse matrix, to tensor data. By combining few elementary operations on sparse maps (inversion, chaining, intersection, etc.), complex algorithms can be developed, illustrated here by a linear-scaling transformation of three-center Coulomb integrals based on our compact code library that implements sparse maps and operations on them. The sparsity of the three-center integrals arises from spatial locality of the basis functions and domain density fitting approximation. A novel feature of our approach is the use of differential overlap integrals computed in linear-scaling fashion for screening products of basis functions. Finally, a robust linear scaling domain based local pair natural orbital second-order Möller-Plesset (DLPNO-MP2) method is described based on the sparse map infrastructure that only depends on a minimal number of cutoff parameters that can be systematically tightened to approach 100% of the canonical MP2 correlation energy. With default truncation thresholds, DLPNO-MP2 recovers more than 99.9% of the canonical resolution of the identity MP2 (RI-MP2) energy while still showing a very early crossover with respect to the computational effort. Based on extensive benchmark calculations, relative energies are reproduced with an error of typically <0.2 kcal/mol. The efficiency of the local MP2 (LMP2) method can be drastically improved by carrying out the LMP2 iterations in a basis of pair natural orbitals. While the present work focuses on local electron correlation, it is of much broader applicability to computation with sparse tensors in quantum chemistry and beyond.