Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2405.17089 · Journal of Chemical Theory and Computation

An Improved Penalty-Based Excited-State Variational Monte Carlo Approach with Deep-Learning Ansatzes

P. Bernát Szabó, Zeno Schätzle, Michael Entwistle, Frank Noé

Published Aug 30, 2024• 14 citations
arXivHTMLPDF

Abstract

High Resolution Image Download MS PowerPoint Slide We introduce several improvements to the penalty-based variational quantum Monte Carlo (VMC) algorithm for computing electronic excited states of Entwistle et al. [Nat. Commun. 14, 274 (2023)] and demonstrate that the accuracy of the updated method is competitive with other available excited-state VMC approaches. A theoretical comparison of the computational aspects of these algorithms is presented, where several benefits of the penalty-based method are identified. Our main contributions include an automatic mechanism for tuning the scale of the penalty terms, an updated form of the overlap penalty with proven convergence properties, and a new term that penalizes the spin of the wave function, enabling the selective computation of states with a given spin. With these improvements, along with the use of the latest self-attention-based ansatz, the penalty-based method achieves a mean absolute error below 1 kcal/mol for the vertical excitation energies of a set of 26 atoms and molecules, without relying on variance matching schemes. Considering excited states along the dissociation of the carbon dimer, the accuracy of the penalty-based method is on par with that of natural-excited-state (NES) VMC, while also providing results for additional sections of the potential energy surface, which were inaccessible with the NES method. Additionally, the accuracy of the penalty-based method is improved for a conical intersection of ethylene, with the predicted angle of the intersection agreeing well with both NES-VMC and multireference configuration interaction.

DOI
10.1021/acs.jctc.4c00678

Related papers

Development of a practical deep-learning quantum Monte Carlo method

Péter Bernát Szabó

Describing the electronic structure of molecules using computational methods is of central importance in many areas of chemical research and industry. To this day, the variational quantum Monte Carlo (VMC) algorithm, which utilizes the variational principle of quantum mechanics to optimize an ansatz towards the true electronic wave function, is one of the lesser employed of such computational methods. While it is generally applicable, and provides direct access to the wave function, its accuracy has been limited by insufficiently expressive ansatzes. This barrier was recently lifted with the introduction of deep-learning-based ansatzes, providing unprecedented flexibility and corresponding accuracy, at the cost of increased computational requirements. In this thesis, our implementation of the VMC algorithm with deep-learning ansatzes is described, along with a number of developments facilitating the computation of electronic excited states, extraction of various observables, and characterization of potential energy surfaces, at a reduced computational cost. The method is implemented as open-source software, employing a common framework to encompass most ansatzes present in the literature. Utilizing the direct wave function access granted by VMC, an approach is developed to extract one-electron reduced densities, that are free from Gaussian basis set effects. Significant advances in the methodology of computing electronic excited states via the ladder-of-states approach are made, including an improved form of the overlap penalty term with an automatically determined prefactor, and a new loss term with which the total spin of the solution can be selected. The efficiency of computing excited potential energy surfaces are enhanced by optimizing a single ansatz for a range of molecular configurations. To enable such transferable training in the presence of state crossings, a dynamic, geometry-wise ordering in the ladder of states is introduced. Geometry-optimization-based tasks are identified as natural fits for such transferable ansatzes, and a transferability-native approach for extracting the necessary information from VMC data is devised. Finally, transferable training is employed to simultaneously model different chemical species, resulting in a foundation model predicting bond breaking at a cost-accuracy ratio competitive with mature multi-reference methods. The work presented here contributes significantly to the development of a practically useful deep-learning-based VMC method. The described approaches have the potential to become tools for a wide community of computational chemists, as a source of accurate data, describing strong correlation in both ground and excited states.

•Jan 1, 2026•0 citations

Electronic excited states in deep variational Monte Carlo

Mike Entwistle, Zeno Schätzle, Paolo Andrea Erdman +2 more

Obtaining accurate ground and low-lying excited states of electronic systems is crucial in a multitude of important applications. One ab initio method for solving the Schrödinger equation that scales favorably for large systems is variational quantum Monte Carlo (QMC). The recently introduced deep QMC approach uses ansatzes represented by deep neural networks and generates nearly exact ground-state solutions for molecules containing up to a few dozen electrons, with the potential to scale to much larger systems where other highly accurate methods are not feasible. In this paper, we extend one such ansatz (PauliNet) to compute electronic excited states. We demonstrate our method on various small atoms and molecules and consistently achieve high accuracy for low-lying states. To highlight the method's potential, we compute the first excited state of the much larger benzene molecule, as well as the conical intersection of ethylene, with PauliNet matching results of more expensive high-level methods.

arXiv:2203.09472•Nature Communications•Jan 17, 2023•72 citations

Quantum Computing Approach to Fixed-Node Monte Carlo Using Classical Shadows

Nick S. Blunt, Laura Caune, Javiera Quiroz-Fernandez

High Resolution Image Download MS PowerPoint Slide Quantum Monte Carlo (QMC) methods are powerful approaches for solving electronic structure problems. Although they often provide high-accuracy solutions, the precision of most QMC methods is ultimately limited by the trial wave function that must be used. Recently, an approach has been demonstrated to allow the use of trial wave functions prepared on a quantum computer [Huggins et al., Unbiasing fermionic quantum Monte Carlo with a quantum computer. Nature 2022, 603, 416] in the auxiliary-field QMC (AFQMC) method using classical shadows to estimate the required overlaps. However, this approach has an exponential post-processing step to construct these overlaps when performing classical shadows obtained using random Clifford circuits. Here, we study an approach to avoid this exponential scaling step by using a fixed-node Monte Carlo method based on full configuration interaction quantum Monte Carlo. This method is applied to the local unitary cluster Jastrow ansatz. We consider H 4, ferrocene, and benzene molecules using up to 12 qubits as examples. Circuits are compiled to native gates for typical near-term architectures, and we assess the impact of circuit-level depolarizing noise on the method. We also provide a comparison of AFQMC and fixed-node approaches, demonstrating that AFQMC is more robust to errors, although extrapolations of the fixed-node energy reduce this discrepancy. Although the method can be used to reach chemical accuracy, the sampling cost to achieve this is high even for small active spaces, suggesting caution about the prospect of outperforming conventional QMC approaches.

arXiv:2410.18901•Journal of Chemical Theory and Computation•Feb 5, 2025•7 citations

Vandermonde Wave Function Ansatz for Improved Variational Monte Carlo

Alberto Acevedo, Michael J. Curry, Shantanu H. Joshi +2 more

Solutions to the Schrodinger equation can be used to predict the electronic structure of molecules and materials and therefore infer their complex physical and chemical properties. Variational Quantum Monte Carlo (VMC) is a technique that can be used to solve the weak form of the Schrodinger equation. Applying VMC to systems with N electrons involves evaluating the determinant of an N by N matrix. The evaluation of this determinant scales as O(N3) and is the main computational cost in the VMC process. In this work, we investigate an alternative VMC technique based on the Vandermonde determinant. The Vandermonde determinant is a product of pairwise differences and so evaluating it scales as O(N2). Therefore, this approach reduces the computational cost by a factor of N. The Vandermonde determinant was implemented in PyTorch and the performance was assessed in approximating the ground state energy of various quantum systems against existing techniques. The performance is evaluated in a variety of systems, starting with the one-dimensional particle in a box, and then considering more complicated atomic systems with multiple particles. The Vandermonde determinant was also implemented in PauliNet, a deep-learning architecture for VMC. The new method is shown to be computationally efficient, and results in a speed-up as large as 5X. In these cases, the new ansatz obtains a reasonable approximation for wavefunctions of atomic systems, but does not reach the accuracy of the Hartree-Fock method that relies on the Slater determinant. It is observed that while the use of neural networks in VMC can result in highly accurate solutions, further work is necessary to determine an appropriate balance between computational time and accuracy.

IEEE/ACM Workshop on Deep Learning on Supercomputers (DLS)•Nov 1, 2020•14 citations

Excited state calculations using variational quantum eigensolver with spin-restricted ansätze and automatically-adjusted constraints

Shigeki Gocho, Hajime Nakamura, Shu Kanno +4 more

Abstract The ground and excited state calculations at key geometries, such as the Frank–Condon (FC) and the conical intersection (CI) geometries, are essential for understanding photophysical properties. To compute these geometries on noisy intermediate-scale quantum devices, we proposed a strategy that combined a chemistry-inspired spin-restricted ansatz and a new excited state calculation method called the variational quantum eigensolver under automatically-adjusted constraints (VQE/AC). Unlike the conventional excited state calculation method, called the variational quantum deflation, the VQE/AC does not require the pre-determination of constraint weights and has the potential to describe smooth potential energy surfaces. To validate this strategy, we performed the excited state calculations at the FC and CI geometries of ethylene and phenol blue at the complete active space self-consistent field (CASSCF) level of theory, and found that the energy errors were at most 2 kcal mol −1 even on the ibm_kawasaki device.

arXiv:2110.14448•npj Computational Materials•Jan 21, 2023•42 citations

Penalty and auxiliary wave function methods for electronic Excitation in neural network variational Monte Carlo

Zixiang Lu, Fu, Weizhong

This study explores the application of neural network variational Monte Carlo (NN-VMC) for the computation of low-lying excited states in molecular systems. Our focus lies on the implementation and evaluation of two distinct methodologies, the penalty method and a novel modification of the auxiliary wave function (AW) method, within the framework of the FermiNet-based NN-VMC package. Importantly, this specific application has not been previously reported.Our investigation advocates for the efficacy of the modified AW method, emphasizing its superior robustness when compared to the penalty method. This methodological advancement introduces a valuable tool for the scientific community, offering a distinctive approach to target low-lying excited states. We anticipate that the modified AW method will garner interest within the research community, serving as a complementary and robust alternative to existing techniques. Moreover, this contribution enriches the ongoing development of various neural network ansatz, further expanding the toolkit available for the accurate exploration of excited states in molecular systems.

arXiv:2311.17595•Nov 29, 2023•6 citations
High Resolution Image Download MS PowerPoint Slide We introduce several improvements to the penalty-based variational quantum Monte Carlo (VMC) algorithm for computing electronic excited states of Entwistle et al. [Nat. Commun. 14, 274 (2023)] and demonstrate that the accuracy of the updated method is competitive with other available excited-state VMC approaches. A theoretical comparison of the computational aspects of these algorithms is presented, where several benefits of the penalty-based method are identified. Our main contributions include an automatic mechanism for tuning the scale of the penalty terms, an updated form of the overlap penalty with proven convergence properties, and a new term that penalizes the spin of the wave function, enabling the selective computation of states with a given spin. With these improvements, along with the use of the latest self-attention-based ansatz, the penalty-based method achieves a mean absolute error below 1 kcal/mol for the vertical excitation energies of a set of 26 atoms and molecules, without relying on variance matching schemes. Considering excited states along the dissociation of the carbon dimer, the accuracy of the penalty-based method is on par with that of natural-excited-state (NES) VMC, while also providing results for additional sections of the potential energy surface, which were inaccessible with the NES method. Additionally, the accuracy of the penalty-based method is improved for a conical intersection of ethylene, with the predicted angle of the intersection agreeing well with both NES-VMC and multireference configuration interaction.
Describing the electronic structure of molecules using computational methods is of central importance in many areas of chemical research and industry. To this day, the variational quantum Monte Carlo (VMC) algorithm, which utilizes the variational principle of quantum mechanics to optimize an ansatz towards the true electronic wave function, is one of the lesser employed of such computational methods. While it is generally applicable, and provides direct access to the wave function, its accuracy has been limited by insufficiently expressive ansatzes. This barrier was recently lifted with the introduction of deep-learning-based ansatzes, providing unprecedented flexibility and corresponding accuracy, at the cost of increased computational requirements. In this thesis, our implementation of the VMC algorithm with deep-learning ansatzes is described, along with a number of developments facilitating the computation of electronic excited states, extraction of various observables, and characterization of potential energy surfaces, at a reduced computational cost. The method is implemented as open-source software, employing a common framework to encompass most ansatzes present in the literature. Utilizing the direct wave function access granted by VMC, an approach is developed to extract one-electron reduced densities, that are free from Gaussian basis set effects. Significant advances in the methodology of computing electronic excited states via the ladder-of-states approach are made, including an improved form of the overlap penalty term with an automatically determined prefactor, and a new loss term with which the total spin of the solution can be selected. The efficiency of computing excited potential energy surfaces are enhanced by optimizing a single ansatz for a range of molecular configurations. To enable such transferable training in the presence of state crossings, a dynamic, geometry-wise ordering in the ladder of states is introduced. Geometry-optimization-based tasks are identified as natural fits for such transferable ansatzes, and a transferability-native approach for extracting the necessary information from VMC data is devised. Finally, transferable training is employed to simultaneously model different chemical species, resulting in a foundation model predicting bond breaking at a cost-accuracy ratio competitive with mature multi-reference methods. The work presented here contributes significantly to the development of a practically useful deep-learning-based VMC method. The described approaches have the potential to become tools for a wide community of computational chemists, as a source of accurate data, describing strong correlation in both ground and excited states.
Obtaining accurate ground and low-lying excited states of electronic systems is crucial in a multitude of important applications. One ab initio method for solving the Schrödinger equation that scales favorably for large systems is variational quantum Monte Carlo (QMC). The recently introduced deep QMC approach uses ansatzes represented by deep neural networks and generates nearly exact ground-state solutions for molecules containing up to a few dozen electrons, with the potential to scale to much larger systems where other highly accurate methods are not feasible. In this paper, we extend one such ansatz (PauliNet) to compute electronic excited states. We demonstrate our method on various small atoms and molecules and consistently achieve high accuracy for low-lying states. To highlight the method's potential, we compute the first excited state of the much larger benzene molecule, as well as the conical intersection of ethylene, with PauliNet matching results of more expensive high-level methods.
High Resolution Image Download MS PowerPoint Slide Quantum Monte Carlo (QMC) methods are powerful approaches for solving electronic structure problems. Although they often provide high-accuracy solutions, the precision of most QMC methods is ultimately limited by the trial wave function that must be used. Recently, an approach has been demonstrated to allow the use of trial wave functions prepared on a quantum computer [Huggins et al., Unbiasing fermionic quantum Monte Carlo with a quantum computer. Nature 2022, 603, 416] in the auxiliary-field QMC (AFQMC) method using classical shadows to estimate the required overlaps. However, this approach has an exponential post-processing step to construct these overlaps when performing classical shadows obtained using random Clifford circuits. Here, we study an approach to avoid this exponential scaling step by using a fixed-node Monte Carlo method based on full configuration interaction quantum Monte Carlo. This method is applied to the local unitary cluster Jastrow ansatz. We consider H 4, ferrocene, and benzene molecules using up to 12 qubits as examples. Circuits are compiled to native gates for typical near-term architectures, and we assess the impact of circuit-level depolarizing noise on the method. We also provide a comparison of AFQMC and fixed-node approaches, demonstrating that AFQMC is more robust to errors, although extrapolations of the fixed-node energy reduce this discrepancy. Although the method can be used to reach chemical accuracy, the sampling cost to achieve this is high even for small active spaces, suggesting caution about the prospect of outperforming conventional QMC approaches.
Solutions to the Schrodinger equation can be used to predict the electronic structure of molecules and materials and therefore infer their complex physical and chemical properties. Variational Quantum Monte Carlo (VMC) is a technique that can be used to solve the weak form of the Schrodinger equation. Applying VMC to systems with N electrons involves evaluating the determinant of an N by N matrix. The evaluation of this determinant scales as O(N3) and is the main computational cost in the VMC process. In this work, we investigate an alternative VMC technique based on the Vandermonde determinant. The Vandermonde determinant is a product of pairwise differences and so evaluating it scales as O(N2). Therefore, this approach reduces the computational cost by a factor of N. The Vandermonde determinant was implemented in PyTorch and the performance was assessed in approximating the ground state energy of various quantum systems against existing techniques. The performance is evaluated in a variety of systems, starting with the one-dimensional particle in a box, and then considering more complicated atomic systems with multiple particles. The Vandermonde determinant was also implemented in PauliNet, a deep-learning architecture for VMC. The new method is shown to be computationally efficient, and results in a speed-up as large as 5X. In these cases, the new ansatz obtains a reasonable approximation for wavefunctions of atomic systems, but does not reach the accuracy of the Hartree-Fock method that relies on the Slater determinant. It is observed that while the use of neural networks in VMC can result in highly accurate solutions, further work is necessary to determine an appropriate balance between computational time and accuracy.
Abstract The ground and excited state calculations at key geometries, such as the Frank–Condon (FC) and the conical intersection (CI) geometries, are essential for understanding photophysical properties. To compute these geometries on noisy intermediate-scale quantum devices, we proposed a strategy that combined a chemistry-inspired spin-restricted ansatz and a new excited state calculation method called the variational quantum eigensolver under automatically-adjusted constraints (VQE/AC). Unlike the conventional excited state calculation method, called the variational quantum deflation, the VQE/AC does not require the pre-determination of constraint weights and has the potential to describe smooth potential energy surfaces. To validate this strategy, we performed the excited state calculations at the FC and CI geometries of ethylene and phenol blue at the complete active space self-consistent field (CASSCF) level of theory, and found that the energy errors were at most 2 kcal mol −1 even on the ibm_kawasaki device.
This study explores the application of neural network variational Monte Carlo (NN-VMC) for the computation of low-lying excited states in molecular systems. Our focus lies on the implementation and evaluation of two distinct methodologies, the penalty method and a novel modification of the auxiliary wave function (AW) method, within the framework of the FermiNet-based NN-VMC package. Importantly, this specific application has not been previously reported.Our investigation advocates for the efficacy of the modified AW method, emphasizing its superior robustness when compared to the penalty method. This methodological advancement introduces a valuable tool for the scientific community, offering a distinctive approach to target low-lying excited states. We anticipate that the modified AW method will garner interest within the research community, serving as a complementary and robust alternative to existing techniques. Moreover, this contribution enriches the ongoing development of various neural network ansatz, further expanding the toolkit available for the accurate exploration of excited states in molecular systems.