The integration of quantum chemical methods with high-performance computing is indispensable for handling large systems with modest accuracy or even small systems but with high accuracy. Continuing with the unified implementation of nonrelativistic and relativistic wave function methods within the MetaWave platform ( J. Phys. Chem. A 2025, 129, 5170), we present here a unified MPI parallelization of the methods by abstracting every computational step of a method as a dynamically scheduled loop via ghost process, followed by a global reduction of local results from each node. The algorithmic abstraction enables the use of a single MPI template in various steps of different methods. Taking iCIPT2 [ J. Chem. Theory Comput. 2021, 17, 949] as a showcase, the parallel efficiencies achieve 94% and 89% on 16 nodes (1024 cores) for the perturbation and whole calculations, respectively. Further combined with an improved algorithm for the matrix-vector product in the matrix diagonalization and an orbital-configuration-based semistochastic estimator for the perturbation correction, this renders large active space calculations possible, so as to obtain benchmarks for the automerization of cyclobutadiene, ground-state energy of benzene, and potential energy profile of ozone. It is also shown that the error of iCIPT2 follows a power law with respect to the number of configuration state functions.
The integration of quantum chemical methods with high-performance computing is indispensable for handling large systems with modest accuracy or even small systems but with high accuracy. Continuing with the unified implementation of nonrelativistic and relativistic wave function methods within the MetaWave platform ( J. Phys. Chem. A 2025, 129, 5170), we present here a unified MPI parallelization of the methods by abstracting every computational step of a method as a dynamically scheduled loop via ghost process, followed by a global reduction of local results from each node. The algorithmic abstraction enables the use of a single MPI template in various steps of different methods. Taking iCIPT2 [ J. Chem. Theory Comput. 2021, 17, 949] as a showcase, the parallel efficiencies achieve 94% and 89% on 16 nodes (1024 cores) for the perturbation and whole calculations, respectively. Further combined with an improved algorithm for the matrix-vector product in the matrix diagonalization and an orbital-configuration-based semistochastic estimator for the perturbation correction, this renders large active space calculations possible, so as to obtain benchmarks for the automerization of cyclobutadiene, ground-state energy of benzene, and potential energy profile of ozone. It is also shown that the error of iCIPT2 follows a power law with respect to the number of configuration state functions.
The physics of strongly correlated materials poses one of the most challenging problems in condensed-matter sciences. Standard approximations applicable to wide classes of materials such as the local density approximation fail, due to the importance of the Coulomb repulsion between localized electrons. Instead, we resort to non-perturbative many-body methods. The calculations are, however, only feasible for rather small model systems. The full Hamiltonian of a real material is approximated by a model Hamiltonian comprising only the most important electronic degrees of freedom, while the effect of all other electrons is included in an average way by renormalizing the parameters. Realistic calculations of strongly correlated materials need to include sufficiently many of these electronic degrees of freedom. The new generation of massively parallel supercomputers allows for these realistic calculations. However, exploiting their computational power requires newly devised algorithms. As a solver we use the Lanczos method, which needs the full many-body state of the correlated system. It is thus limited by the available main memory. The foremost problem for a distributed-memory implementation is that the multiplication of the Hamiltonian to the many-body state leads to highly non-local memory access patterns. A simple yet important observation leads to an efficient solution: in the kinetic term of the Hamiltonian the electron-spin is conserved. Thus, writing the many-body vector as a matrix v(iup,idn), where the indices label spin-configurations, we find that the hopping term only connects vector elements that differ in one index. Hence, storing entire slices v(iup,:) on one node, the kinetic term for the spin-down electrons is local to that process. After transposing v, the same is true for the hopping of the spin-up electrons. With an efficient matrix transpose, implemented via MPI collectives, we thus obtain a version of the Lanczos method that efficiently well on JUBL, Jülich's Blue Gene/L. Using the code we treated two-orbital Hubbard Models which show interesting Mott-band insulator transitions. Kohn's criterium which determines the phase of a system by ground-state properties alone, namely the response of the ground-state energies to a vector potential, was employed. This vector potential can be equivalently regarded as a change in boundary conditions, requiring complex wave vectors. We found that half-filled systems become metallic in the region between a band and Mott insulating phase. To extrapolate to infinite system sizes and therefore getting access to an arbitrarily high resolution in reciprocal space, we use cluster perturbation theory (CPT). It works by diagonalizing a finite cluster exactly and then treating the hopping between identical clusters perturbatively in strong coupling perturbation theory. This leads to an effectively infinite chain. Due to our efficient Lanczos implementation it is possible to calculate relatively large clusters, minimizing finite-size effects. The combination of our Lanczos code and CPT allowed for a treatment of the the organic metal TTF-TCNQ. We were able to solve a long-standing problem in the interpretation of its experimental spectra. Being an interesting one-dimensional metal TTF-TCNQ has been studied thoroughly for more than 30 years. Theoretical estimates as well as experimental measurements suggest values for the parameters of the Hubbard model t and U. With these values Hubbard model calculations show qualitatively the same features as APRES experiments, namely the signatures of spin-charge separation at the Gamma-point. But in order to fit the experimental data to the numerical calculations t has to be doubled, which translates into a broadening of the spectra. This ad-hoc adjustment is not only unsatisfactory but also the temperature dependence of the spectral function is incorrectly reproduced. We resolved this problem by properly including nearest-neighbor Coulomb interactions. Recent DFT calculations show that indeed the commonly used values of t and U are correct. But Coulomb interactions between electrons on neighboring sites are also significant and must not be neglected. Thus, we studied the effect of the next-neighbor interaction parameter V being at about U/2. Including V in our Lanczos calculations for obtaining the angular-integrated spectral function shows that its effect is to broaden the spectra, comparable to increasing the value of t. Moreover, we found that doubling t indeed mimics the effect of Vapprox U/2. Surprisingly, the broadening of the spectrum as a result of V can be understood in first-order Rayleigh-Schrödinger perturbation theory.
We present, to the best of our knowledge, the first attempt to exploit the super-computer platform for quantum chemical density matrix renormalization group (QC-DMRG) calculations. We have developed the parallel scheme based on the in-house MPI global memory library, which combines operator and symmetry sector parallelisms, and tested its performance on three different molecules, all typical candidates for QC-DMRG calculations. In case of the largest calculation, which is the nitrogenase FeMo cofactor cluster with the active space comprising 113 electrons in 76 orbitals and bond dimension equal to 6000, our parallel approach scales up to approximately 2000 CPU cores.
Quantum chemistry plays an important role in elucidating molecular geometries, electronic states, and reaction mechanisms, because of the developments of a variety of theoretical methods, such as Hartree-Fock (HF), Møler-Plesset (MP) perturbation, configuration interaction (CI), coupled-cluster (CC), and density functional theory (DFT) methods. Electronic structure calculations have been carried out by not only theoretical chemists but also experimental chemists. DFT is currently most widely used to investigate large molecules in the ground state as well as small molecules because of the low computational cost. However, the generally used functionals fail to describe correctly non-covalent interactions that are important for host-guest molecules, self-assembly, and molecular recognition, and they tend to underestimate reaction barriers. Many attempts have been made to develop new functionals and add semiempirical or empirical correction terms to standard functionals, but no generally accepted DFT method has emerged yet. Second-order Møler-Plesset perturbation theory (MP2) is the simplest method that includes electron correlation important for non-covalent interactions and reaction barriers nonempirically. However, the computational cost of MP2 is considerably higher than that of DFT. In addition, much larger sizes of fast memory and hard disk are required in MP2 calculations. These make MP2 calculations increasingly difficult for larger molecules. Since workstation or personal computer (PC) clusters have become popular for quantum chemistry calculations, an efficient parallel calculation is a solution of the problem. Therefore, new parallel algorithms for MP2 energy and gradient calculations are presented in this thesis. Furthermore, an efficient algorithm for the generation of two-electron repulsion integrals (ERIs) which is important in quantum chemistry calculations is also presented. For the calculations of excited states, different approaches are required: for example, CI, multi-configuration self-consistent field (MCSCF), time-dependent DFT (TDDFT), and symmetry adapted cluster (SAC)/SAC-CI methods. One of the most accurate methods is SAC/SAC-CI, as demonstrated for many molecules. In this thesis, SAC/SAC-CI calculations of ground, ionized, and excited states are presented. This thesis consists of five chapters: a new algorithm of two-electron repulsion integral calculations (Chapter I), a new parallel algorithm of MP2 energy calculations (Chapter II), a new parallel algorithm of MP2 energy gradient calculations (Chapter III), applications of MP2 calculations (Chapter IV), and SAC/SAC-CI calculations of ionized and excited states (Chapter V). In quantum chemistry calculations, the generation of ERIs is one of the most basic subjects and is the most time-consuming step especially in direct SCF calculations. Many algorithms have been developed to reduce the computational cost. In Pople-Hehre algorithm, Cartesian axes are rotated to make several coordinate components zero or constant, so that these components are skipped in the generation of ERIs. In McMurchie-Davidson algorithm, ERIs are generated from (ss|ss) type integrals using a recurrence relation derived from Hermite polynomials. By combining these two algorithms, a new algorithm is developed in Chapter I. The results show that the new algorithm reduces the computational cost by 10 - 40%, as compared with the original algorithms. It is notable that the generation of ERIs including d functions is considerably fast. The program implemented officially in GAMESS in 2004 has been used all over the world. In quantum mechanics, perturbation methods can be used for adding corrections to reference solutions. In the MP perturbation method, a sum over Fock operators is used as the reference term, and the exact two-electron repulsion operator minus twice the average two-electron repulsion operator is used as the perturbation term. It is the advantage that the MP perturbation method is size consistent and size extensive, unlike truncated CI methods. The zero-order wave function is the HF Slater determinant, and the zero-order energy is expressed as a sum of occupied molecular orbital (MO) energies. The first-order perturbation is the correction for the overcounting of two-electron repulsions at zero-order, and the first-order energy corresponds to the HF energy. The MP correlation starts at second-order. In general, second-order (MP2) accounts for 80 - 90% of electron correlation. Therefore, MP2 is focused in this thesis since it is applicable to large molecules with considerable reliability and low computational cost. The formal computational scaling of MP2 energy calculations with respect to molecular size is fifth order, much higher than that of DFT energy calculations. Therefore, less expensive methods, such as Local MP2, density fitting (resolution of identity, RI) MP2, and Laplace Transform MP2, have been developed. However, all of these methods include approximations or cut-offs that need to be checked against full MP2 energies. An alternative approach to reduce the computational cost is to parallelize MP2 energy calculations. A number of papers on parallel MP2 energy calculations have been published. Almost all of them are based on simple parallelization methods that distribute only atomic orbital (AO) or MO indices to each processor. These methods have a disadvantage since intermediate integrals are broadcasted to all CPUs or the same AO ERIs are generated in all processors. Baker and Pulay developed a new parallel algorithm using SaebøAlmlöf integral transformation method. This algorithm parallelizes the first half transformation by AO indices and the second half transformation by MO indices. The advantages are that the total amount of network communication is independent of the number of processors and the AO integrals are generated only once. The disadvantage is the I/O overhead for the sorting of half-transformed integrals. A new parallel algorithm for MP2 energy calculations based on the two-step parallelization idea is presented in Chapter II. In this algorithm, AO indices are distributed in the AO integral generation and the first three quarter transformation, and MO indices are distributed in the last quarter transformation and MP2 energy calculation. Because the algorithm makes the sorting of intermediate integrals very simple, the parallel efficiency is highly improved and the I/O overhead is removed. Furthermore, the algorithm reduces highly the floating point operation (FLOP) count as well as the required memory and hard disk space, in comparison with other algorithms. Test calculations of taxol (C47H51NO14) and luciferin (C11H8N2O3S2) were performed on a cluster of Pentium 4 computers connected by gigabit Ethernet. The parallel scaling of the developed code is excellent up to the largest number of processors we have tested. For instance, the elapsed time for the MP2 energy calculations on 16 processors is on average 15.4 times faster than that on the single-processor. Determination of molecular geometries and reaction paths is a fundamental task in quantum chemistry and requires energy gradients with respect to nuclear coordinates. In Chapter III, a new parallel algorithm for MP2 energy gradient calculations is presented. The algorithm consists of 5 steps, the integral transformation, the MP2 amplitude calculation, the MP2 Lagrangian calculation, the coupled-perturbed HF calculation, and the integral derivative calculation. All steps are parallelized by distributing AO or MO indices. The algorithm also reduces the FLOP count, the required memory, and hard disk space. Test calculations of MP2 energy gradients were performed for taxol and luciferin on a cluster of Pentium 4 computers. The speedups are very good up to 80 CPU cores we have tested. For instance, the speedup ratios are 28.2 - 33.0 on 32 processors, corresponding to 88% - 103% of linear speedup. This indicates the high parallel efficiency of the present algorithm. The calculation of taxol with 6-31G(d) (1032 contracted basis functions) finishes within 2 hours on 32 processors, which requires only 1.8GB memory and 13.4GB hard disk per processor. Therefore, geometry optimization of molecules with 1000 basis functions can be easily performed using standard PC clusters. In Chapter IV, several applications of MP2 are performed using the program developed in Chapters II and III. Some molecules that DFT cannot treat well are optimized at the MP2 level. Geometry optimization is also carried out using the spin-component scaled (SCS) MP2 method. In this method, a different scaling is employed for the same and opposite spin components of the MP2 energy, so that SCS-MP2 performs as well as the much more costly CCSD(T) method at a high level of theory. SAC theory is developed for ground states and based on CC theory that describes higher-order electron correlation. The main factor of electron correlation is collisions of two electrons. In CC theory, most collisions of four electrons can be taken in as the product of collisions of tw
With advances in algorithms and growing computing powers, quantum Monte Carlo (QMC) methods have become a leading contender for high accuracy calculations for the electronic structure of realistic systems. The performance gain on recent HPC systems is largely driven by increasing parallelism: the number of compute cores of a SMP and the number of SMPs have been going up, as the Top500 list attests. However, the available memory as well as the communication and memory bandwidth per element has not kept pace with the increasing parallelism. This severely limits the applicability of QMC and the problem size it can handle. OpenMP/MPI hybrid programming provides applications with simple but effective solutions to overcome efficiency and scalability bottlenecks on large-scale clusters based on multi/many-core SMPs. We discuss the design and implementation of hybrid methods in QMCPACK and analyze its performance on current HPC platforms characterized by various memory and communication hierarchies.
Accurate evaluation of electron correlations is essential for the reliable quantitative description of electronic structures in strongly correlated systems, including bond-dissociating molecules, polyradicals, large conjugated molecules, and transition metal complexes. To provide a user-friendly tool for studying such challenging systems, our team developed Kylin 1.0 [J. Comput. Chem. 44, 1316 (2023)], an ab initio quantum chemistry program designed for efficient density matrix renormalization group (DMRG) and post-DMRG methods, enabling high-accuracy calculations with large active spaces. We have now further advanced the software with the release of Kylin 1.3, featuring optimized DMRG algorithms and an improved tensor contraction scheme in the diagonalization step. Benchmark calculations on the Mn4CaO5 cluster demonstrate a remarkable speed-up of up to 16 fater than Kylin 1.0. Moreover, a more user-friendly and efficient algorithm [J. Chem. Theory Comput. 17, 3414 (2021)] for sampling configurations from DMRG wavefunction is implemented as well. Additionally, we have also implemented a spin-adapted version of the externally contracted multi-reference configuration interaction (EC-MRCI) method [J. Phys. Chem. A 128, 958 (2024)], further enhancing the program’s efficiency and accuracy for electron correlation calculations.
Various strategies to implement efficiently quantum Monte Carlo (QMC) simulations for large chemical systems are presented. These include: (i) the introduction of an efficient algorithm to calculate the computationally expensive Slater matrices. This novel scheme is based on the use of the highly localized character of atomic Gaussian basis functions (not the molecular orbitals as usually done), (ii) the possibility of keeping the memory footprint minimal, (iii) the important enhancement of single-core performance when efficient optimization tools are used, and (iv) the definition of a universal, dynamic, fault-tolerant, and load-balanced framework adapted to all kinds of computational platforms (massively parallel machines, clusters, or distributed grids). These strategies have been implemented in the QMC=Chem code developed at Toulouse and illustrated with numerical applications on small peptides of increasing sizes (158, 434, 1056, and 1731 electrons). Using 10-80 k computing cores of the Curie machine (GENCI-TGCC-CEA, France), QMC=Chem has been shown to be capable of running at the petascale level, thus demonstrating that for this machine a large part of the peak performance can be achieved. Implementation of large-scale QMC simulations for future exascale platforms with a comparable level of efficiency is expected to be feasible.