Fock-space variational Monte Carlo (FS-VMC) evaluates variational quantities by sampling discrete many-body configurations. In molecular applications, concentrated Born distributions can hinder Markov-chain mixing, while Monte Carlo estimators can also exhibit large variance. We introduce importance-reweighted FS-VMC (IR-FS-VMC), which combines Metropolis--Hastings sampling, an evaluation kernel, and self-normalized importance sampling to estimate the Born-distribution energy, gradient, and stochastic reconfiguration (SR) matrix. Controlled comparisons on equilibrium H2O and Fe2S2 show that the acceptance rate and local-energy variance can respond differently to the sampling and estimation procedure. A single production protocol yields accurate variational energies for H2O dissociation, 36-site hydrogen lattices, and Fe2S2 and Fe4S4 active spaces without system-specific sampling parameters.
Fock-space variational Monte Carlo (FS-VMC) evaluates variational quantities by sampling discrete many-body configurations. In molecular applications, concentrated Born distributions can hinder Markov-chain mixing, while Monte Carlo estimators can also exhibit large variance. We introduce importance-reweighted FS-VMC (IR-FS-VMC), which combines Metropolis--Hastings sampling, an evaluation kernel, and self-normalized importance sampling to estimate the Born-distribution energy, gradient, and stochastic reconfiguration (SR) matrix. Controlled comparisons on equilibrium H2O and Fe2S2 show that the acceptance rate and local-energy variance can respond differently to the sampling and estimation procedure. A single production protocol yields accurate variational energies for H2O dissociation, 36-site hydrogen lattices, and Fe2S2 and Fe4S4 active spaces without system-specific sampling parameters.
When combined with highly expressive ansatz functions such as neural quantum states, variational Monte Carlo (VMC) constitutes a versatile numerical approach to tackle the quantum many-body problem in and out of equilibrium. However, its traditional formulation exhibits a subtle estimation bias leading to inaccuracies, which can be particularly detrimental when addressing real time dynamics. In this work, we investigate two avenues to circumvent said estimation bias. First, we propose an unbiased variant of time-dependent VMC using self-normalized importance sampling with respect to a cutoff-based deformation of the Born distribution. We demonstrate the feasibility and accuracy of the approach in pathological and generic cases of quench dynamics. Furthermore, we explore an alternative sampling strategy based on active learning via the tensor cross interpolation (TCI). While we find that our choice of tensor network architecture lacks the required low rank property, the proposed TCI-based algorithm complements the conventional importance sampling paradigm, providing an alternative perspective that may be further explored in future work.
Abstract Neural-network quantum states (NQSs) offer a powerful and expressive ansatz for representing quantum many-body wave functions. However, their training via Variational Monte Carlo (VMC) methods remains challenging. It is well known that some scenarios—such as sharply peaked wave functions emerging in quantum chemistry—lead to high-variance gradient estimators hindering the effectiveness of variational optimizations. In this work we investigate a systematic strategy to tackle those sampling issues by means of adaptively tuned importance sampling. Our approach is explicitly designed to target the gradient estimator instead of the loss function, and be computationally inexpensive. We benchmarked our approach across the ground-state search of a wide variety of hamiltonians, including frustrated spin systems and ab-initio quantum chemistry. Overall, our approach can reduce the computational cost of vanilla VMC considerably, up to a factor of 100× when targeting highly peaked quantum chemistry wavefunctions.
In this work, we introduce three algorithmic improvements to reduce the cost and improve the scaling of orbital space variational Monte Carlo (VMC). First, we show that, by appropriately screening the one- and two-electron integrals of the Hamiltonian, one can improve the efficiency of the algorithm by several orders of magnitude. This improved efficiency comes with the added benefit that the cost of obtaining a constant error per electron scales as the second power of the system size O ( N 2 ), down from the fourth power O ( N 4 ). Using numerical results, we demonstrate that the practical scaling obtained is, in fact, O ( N 1.5 ) for a chain of hydrogen atoms. Second, we show that, by using the adaptive stochastic gradient descent algorithm called AMSGrad, one can optimize the wave function energies robustly and efficiently. Remarkably, AMSGrad is almost as inexpensive as the simple stochastic gradient descent but delivers a convergence rate that is comparable to that of the Stochastic Reconfiguration algorithm, which is significantly more expensive and has a worse scaling with the system size. Third, we introduce the use of the rejection-free continuous time Monte Carlo (CTMC) to sample the determinants. Unlike the first two improvements, CTMC does come at an overhead that the local energy must be calculated at every Monte Carlo step. However, this overhead is mitigated to a large extent because of the reduced scaling algorithm, which ensures that the asymptotic cost of calculating the local energy is equal to that of updating the walker. The resulting algorithm allows us to calculate the ground state energy of a chain of 160 hydrogen atoms using a wave function containing ∼2 × 10 5 variational parameters with an accuracy of 1 mE h /particle at a cost of just 25 CPU h, which when split over 2 nodes of 24 processors each amounts to only about half hour of wall time. This low cost coupled with embarrassing parallelizability of the VMC algorithm and great freedom in the forms of usable wave functions, represents a highly effective method for calculating the electronic structure of model and ab initio systems.
Variational Monte Carlo (VMC) is a powerful and fast-growing method for optimizing and evolving parameterized many-body wave functions, especially with modern neural-network quantum states. In practice, however, the stochastic estimators that form the backbone of the method can become unstable or biased due to the presence of nodes, a ubiquitous feature of quantum wave functions. In the continuum, this results in heavy-tailed estimators with potentially divergent variances, while in discrete Hilbert spaces the sampling distribution can miss parts of the support needed to form unbiased estimators. These statistical pathologies lead to unreliable optimization trajectories in stochastic reconfiguration or incorrect variational dynamics in time-dependent Variational Monte Carlo (t-VMC), and severely limit the power of the numerical simulations. We introduce blurred sampling to address these difficulties. The method has a number of rigorous properties that make it well-behaved, effective and computationally efficient. Additionally, it is a post-processing approach that can be used without modifying the underlying sampler and incurs only minimal overhead. We demonstrate its effectiveness in a broad range of problems -- including ground state optimization in both continuum and discrete settings, as well as in time-dependent variational Monte Carlo, where it resolves previously identified failure modes -- and further apply it to large-scale problems in spin dynamics. This work establishes a broadly applicable framework for robust VMC and t-VMC calculations.
Solving the ground state of quantum many-body systems remains a fundamental challenge in physics and chemistry. Recent advancements in quantum hardware have opened new avenues for addressing this challenge. Inspired by the quantum-enhanced Markov chain Monte Carlo (QeMCMC) algorithm, which was originally designed for sampling the Boltzmann distribution of classical spin models using quantum computers, we introduce a quantum-assisted variational Monte Carlo (QA-VMC) algorithm for solving the ground state of quantum many-body systems by adapting QeMCMC to sample the distribution of a (neural-network) wave function in VMC. The central question is whether such a quantum-assisted proposal can potentially offer a computational advantage over classical methods. Through numerical investigations for the Fermi-Hubbard model and molecular systems, we demonstrate that the quantum-assisted proposal exhibits larger absolute spectral gaps and reduced autocorrelation times compared to conventional classical proposals, leading to more efficient sampling and faster convergence to the ground state in VMC as well as a more accurate and precise estimation of physical observables. This advantage is especially pronounced for specific parameter ranges, where the ground-state configurations are more concentrated in some configurations separated by large Hamming distances. Our results underscore the potential of quantum-assisted algorithms to enhance classical variational methods for solving the ground state of quantum many-body systems.
TitleVariational Monte Carlo for Ab Initio Electronic Structure with Neural Quantum States and Selective State-Space Models Overview This repository provides a research implementation of Variational Monte Carlo (VMC) for ab initio electronic-structure calculations using Neural Quantum States (NQS). The work focuses on stable natural-gradient optimization, physically motivated wavefunction constraints, and the exploration of alternative architectural inductive biases for modeling electronic correlation. The project is released as an exploratory research artifact. All results, limitations, and open questions are stated explicitly. The work is motivated by a central question in modern neural quantum chemistry:can alternative sequence-based architectures reduce the quadratic scaling bottleneck of electron–electron interaction modeling while preserving physical fidelity? Scientific Scope The framework targets: Atomic systems (H through Ne) Small molecules (e.g., H₂, LiH, H₂O) Exploratory extensions, including: Periodic boundary conditions Excited-state considerations Berry-phase estimation Entanglement diagnostics Time-dependent VMC via McLachlan’s variational principle At present, numerical validation is limited to a single-electron benchmark (Hydrogen) and is explicitly presented as a sanity check of the physics engine and optimization loop, not as evidence of improved expressivity for correlated fermions. Core Methodology The implementation follows the standard Variational Monte Carlo formalism, in which a parameterized wavefunctionψ is optimized by minimizing the energy expectation value Optimization is performed using Stochastic Reconfiguration (SR), a natural-gradient method that accounts for the geometry of the variational manifold and significantly improves stability compared to first-order optimizers. Key numerical features include: Log-domain arithmetic for wavefunction evaluation Stable determinant computation using slogdet Hutchinson trace estimation for Laplacian evaluation Explicit enforcement of Kato cusp conditions via analytic Jastrow factors Multi-determinant antisymmetric ansatz to satisfy fermionic exchange symmetry SSM-Backflow Hypothesis The primary research contribution explored in this repository is the SSM-Backflow hypothesis. Most contemporary NQS models (e.g., FermiNet, PauliNet) model electron–electron interactions using explicit quadratic aggregation, leading to O(Ne2)O(N_e^2)O(Ne2) computational complexity. This work investigates an alternative inductive bias: For each electron, neighboring electrons are sorted by inter-electron distance The resulting sequence is processed using a selective state-space model (SSM) inspired by Mamba architectures Correlation information is accumulated sequentially through a learned recurrence Aggregated messages are used to parameterize backflow transformations or orbital functions This approach yields a theoretical complexity of O(NelogNe)O(N_e \log N_e)O(NelogNe) per layer (dominated by sorting) and is motivated by the physical observation that electronic correlation typically decays approximately exponentially with distance. Importantly, this is treated strictly as a hypothesis. The manuscript explicitly notes that: SSMs are not permutation-invariant by construction Sequential ordering may introduce inductive biases misaligned with fermionic symmetry Empirical validation on multi-electron systems is required before drawing conclusions Results and Current Validation Status At present, the repository reports results for atomic hydrogen (Ne = 1): Exact energy: −0.500000 Ha Achieved energy: −0.5001 Ha Error: 0.12 mHa (well below chemical accuracy) Local-energy variance: 0.0454 Optimizer: Stochastic Reconfiguration Convergence: ~100 optimization steps Because hydrogen has no electron–electron correlation, this result is interpreted solely as a sanity check of: Hamiltonian implementation Local-energy estimator Natural-gradient optimization loop Numerical stability mechanisms The manuscript clearly states that multi-electron benchmarks (e.g., He, Li, or H₂) are required to meaningfully evaluate the SSM-Backflow hypothesis and are planned for future versions. Stability and Diagnostics The implementation includes multiple practical safeguards designed to stabilize VMC optimization: Dynamic energy-based divergence detection Variance-based walker reset mechanisms Controlled respawning of walkers near nuclear centers In addition, an exploratory commutator-based diagnostic (informally termed the “Noether Inverse”) is included as a monitoring signal during training. This quantity is explicitly not claimed to represent a new conserved symmetry and is treated purely as an empirical observation requiring further theoretical and numerical investigation. Intended Use and Limitations This repository is released as: A research implementation A transparent record of an ongoing investigation A foundation for future validation and benchmarking It is not presented as a production-ready electronic-structure solver, nor as evidence of state-of-the-art performance. All limitations are explicitly documented in the manuscript. Licensing and Reuse The work is shared to encourage: Reproducibility Methodological discussion Extension and validation by the community If you use or build upon this work, please cite the Zenodo DOI associated with this release.