This study explores the application of neural network variational Monte Carlo (NN-VMC) for the computation of low-lying excited states in molecular systems. Our focus lies on the implementation and evaluation of two distinct methodologies, the penalty method and a novel modification of the auxiliary wave function (AW) method, within the framework of the FermiNet-based NN-VMC package. Importantly, this specific application has not been previously reported.Our investigation advocates for the efficacy of the modified AW method, emphasizing its superior robustness when compared to the penalty method. This methodological advancement introduces a valuable tool for the scientific community, offering a distinctive approach to target low-lying excited states. We anticipate that the modified AW method will garner interest within the research community, serving as a complementary and robust alternative to existing techniques. Moreover, this contribution enriches the ongoing development of various neural network ansatz, further expanding the toolkit available for the accurate exploration of excited states in molecular systems.
This study explores the application of neural network variational Monte Carlo (NN-VMC) for the computation of low-lying excited states in molecular systems. Our focus lies on the implementation and evaluation of two distinct methodologies, the penalty method and a novel modification of the auxiliary wave function (AW) method, within the framework of the FermiNet-based NN-VMC package. Importantly, this specific application has not been previously reported.Our investigation advocates for the efficacy of the modified AW method, emphasizing its superior robustness when compared to the penalty method. This methodological advancement introduces a valuable tool for the scientific community, offering a distinctive approach to target low-lying excited states. We anticipate that the modified AW method will garner interest within the research community, serving as a complementary and robust alternative to existing techniques. Moreover, this contribution enriches the ongoing development of various neural network ansatz, further expanding the toolkit available for the accurate exploration of excited states in molecular systems.
Describing the electronic structure of molecules using computational methods is of central importance in many areas of chemical research and industry. To this day, the variational quantum Monte Carlo (VMC) algorithm, which utilizes the variational principle of quantum mechanics to optimize an ansatz towards the true electronic wave function, is one of the lesser employed of such computational methods. While it is generally applicable, and provides direct access to the wave function, its accuracy has been limited by insufficiently expressive ansatzes. This barrier was recently lifted with the introduction of deep-learning-based ansatzes, providing unprecedented flexibility and corresponding accuracy, at the cost of increased computational requirements. In this thesis, our implementation of the VMC algorithm with deep-learning ansatzes is described, along with a number of developments facilitating the computation of electronic excited states, extraction of various observables, and characterization of potential energy surfaces, at a reduced computational cost. The method is implemented as open-source software, employing a common framework to encompass most ansatzes present in the literature. Utilizing the direct wave function access granted by VMC, an approach is developed to extract one-electron reduced densities, that are free from Gaussian basis set effects. Significant advances in the methodology of computing electronic excited states via the ladder-of-states approach are made, including an improved form of the overlap penalty term with an automatically determined prefactor, and a new loss term with which the total spin of the solution can be selected. The efficiency of computing excited potential energy surfaces are enhanced by optimizing a single ansatz for a range of molecular configurations. To enable such transferable training in the presence of state crossings, a dynamic, geometry-wise ordering in the ladder of states is introduced. Geometry-optimization-based tasks are identified as natural fits for such transferable ansatzes, and a transferability-native approach for extracting the necessary information from VMC data is devised. Finally, transferable training is employed to simultaneously model different chemical species, resulting in a foundation model predicting bond breaking at a cost-accuracy ratio competitive with mature multi-reference methods. The work presented here contributes significantly to the development of a practically useful deep-learning-based VMC method. The described approaches have the potential to become tools for a wide community of computational chemists, as a source of accurate data, describing strong correlation in both ground and excited states.
We present the first variational Monte Carlo study of nuclear and hypernuclear excited states within the neural-network quantum states (NQS) framework. We implement both the overlap penalty (OP) and natural excited state (NES) methods to compute low-lying excitation spectra. To address the spin contamination in hypernuclear calculations, we propose a quantum number targeting (QNT) technique for the OP method. Both the OP-QNT and NES methods can reproduce diagonal observables, such as energies and spatial structures, in excellent agreement with rigorous benchmarks. We further provide, to our knowledge, the first ab initio calculation of the M 1 transition strength for Λ 4 H . The calculated transition strength is consistent with the weak-coupling limit, exhibiting a ∼ 1.3% suppression. This work demonstrates that NQS can be elevated from ground-state solvers to practical tools for nuclear and hypernuclear spectroscopy.
We present an algorithm to estimate the excited states of a quantum system by variational Monte Carlo, which has no free parameters and requires no orthogonalization of the states, instead transforming the problem into that of finding the ground state of an expanded system. Arbitrary observables can be calculated, including off-diagonal expectations, such as the transition dipole moment. The method works particularly well with neural network ansätze, and by combining this method with the FermiNet and Psiformer ansätze, we can accurately recover excitation energies and oscillator strengths on a range of molecules. We achieve accurate vertical excitation energies on benzene-scale molecules, including challenging double excitations. Beyond the examples presented in this work, we expect that this technique will be of interest for atomic, nuclear, and condensed matter physics.
Diffusion Monte Carlo (DMC) based on fixed-node approximation has enjoyed significant developments in the past decades and become one of the go-to methods when accurate ground state energy of molecules and materials is needed. However, the inaccurate nodal structure hinders the application of DMC for more challenging electronic correlation problems. In this work, we apply the neural-network based trial wavefunction in fixed-node DMC, which allows accurate calculations of a broad range of atomic and molecular systems of different electronic characteristics. Our method is superior in both accuracy and efficiency compared to state-of-the-art neural network methods using variational Monte Carlo (VMC). We also introduce an extrapolation scheme based on the empirical linearity between VMC and DMC energies, and significantly improve our binding energy calculation. Overall, this computational framework provides a benchmark for accurate solutions of correlated electronic wavefunction and also sheds light on the chemical understanding of molecules.
Computing accurate yet efficient approximations to the solutions of the electronic Schrödinger equation has been a paramount challenge of computational chemistry for decades. Quantum Monte Carlo methods are a promising avenue of development as their core algorithm exhibits a number of favorable properties: it is highly parallel and scales favorably with the considered system size, with an accuracy that is limited only by the choice of the wave function Ansatz. The recently introduced machine-learned parametrizations of quantum Monte Carlo Ansätze rely on the efficiency of neural networks as universal function approximators to achieve state of the art accuracy on a variety of molecular systems. With interest in the field growing rapidly, there is a clear need for easy to use, modular, and extendable software libraries facilitating the development and adoption of this new class of methods. In this contribution, the DeepQMC program package is introduced, in an attempt to provide a common framework for future investigations by unifying many of the currently available deep-learning quantum Monte Carlo architectures. Furthermore, the manuscript provides a brief introduction to the methodology of variational quantum Monte Carlo in real space, highlights some technical challenges of optimizing neural network wave functions, and presents example black-box applications of the program package. We thereby intend to make this novel field accessible to a broader class of practitioners from both the quantum chemistry and the machine learning communities.
High Resolution Image Download MS PowerPoint Slide We introduce several improvements to the penalty-based variational quantum Monte Carlo (VMC) algorithm for computing electronic excited states of Entwistle et al. [Nat. Commun. 14, 274 (2023)] and demonstrate that the accuracy of the updated method is competitive with other available excited-state VMC approaches. A theoretical comparison of the computational aspects of these algorithms is presented, where several benefits of the penalty-based method are identified. Our main contributions include an automatic mechanism for tuning the scale of the penalty terms, an updated form of the overlap penalty with proven convergence properties, and a new term that penalizes the spin of the wave function, enabling the selective computation of states with a given spin. With these improvements, along with the use of the latest self-attention-based ansatz, the penalty-based method achieves a mean absolute error below 1 kcal/mol for the vertical excitation energies of a set of 26 atoms and molecules, without relying on variance matching schemes. Considering excited states along the dissociation of the carbon dimer, the accuracy of the penalty-based method is on par with that of natural-excited-state (NES) VMC, while also providing results for additional sections of the potential energy surface, which were inaccessible with the NES method. Additionally, the accuracy of the penalty-based method is improved for a conical intersection of ethylene, with the predicted angle of the intersection agreeing well with both NES-VMC and multireference configuration interaction.