Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Journal of Chemical Theory and Computation

Transformer-Based Neural-Network Quantum State Method for Electronic Band Structures of Real Solids

Lizhong Fu, Yangjun Wu, Honghui Shang, Jinlong Yang

Published Jul 8, 2024• 19 citations
Publisher

Abstract

Recent advancements in neural networks have led to significant progress in addressing many-body electron correlations in small molecules and various physical models. In this work, we propose QiankunNet-Solid, which incorporates periodic boundary conditions into the neural network quantum state (NNQS) framework based on generative Transformer architecture along with a batched autoregressive sampling (BAS) method, enabling the effective ab initio calculation of real solid materials. The accuracy of this method is demonstrated in one-, two-, and three-dimensional periodic systems, with results comparable to those of full configuration interaction and coupled-cluster method, even in the strongly correlated regime. Furthermore, we compute the band structures and density of states for silicon crystal. The successful incorporation of periodic boundary conditions into the NNQS framework through QiankunNet-Solid opens up new possibilities for the accurate and efficient study of electronic structure properties in solid-state physics.

DOI
10.1021/acs.jctc.4c00567

Related papers

Solving the many-electron Schrödinger equation with a transformer-based framework

Honghui Shang, Chu Guo, Yangjun Wu +2 more

Accurately solving the Schrödinger equation for intricate systems remains a prominent challenge in physical sciences. Here we present QiankunNet, a neural network quantum state (NNQS) framework that combines Transformer architectures with efficient autoregressive sampling to solve the many-electron Schrödinger equation. At its core is a Transformer-based wave function ansatz that captures complex quantum correlations through attention mechanisms, effectively learning the structure of many-body states. The quantum state sampling employs layer-wise Monte Carlo tree search (MCTS) that naturally enforces electron number conservation while exploring orbital configurations. The framework incorporates physics-informed initialization using truncated configuration interaction solutions, providing principled starting points for variational optimization. Our systematic benchmarks demonstrate QiankunNet's versatility across different chemical systems. For molecular systems up to 30 spin orbitals, we achieved correlation energies reaching 99.9% of the full configuration interaction (FCI) benchmark, setting a new standard for neural network quantum states. Most notably, in treating the Fenton reaction mechanism, a fundamental process in biological oxidative stress, QiankunNet successfully handled a large CAS(46e,26o) active space, enabling accurate description of the complex electronic structure evolution during Fe(II) to Fe(III) oxidation.

Nature Communications•Sep 29, 2025•25 citations

NNQS-Transformer: an Efficient and Scalable Neural Network Quantum States Approach for Ab initio Quantum Chemistry

Yangjun Wu, Chu Guo, Yi Fan +2 more

Neural network quantum state (NNQS) has emerged as a promising candidate for quantum many-body problems, but its practical applications are often hindered by the high cost of sampling and local energy calculation. We develop a high-performance NNQS method for ab initio electronic structure calculations. The major innovations include: (1) A transformer based architecture as the quantum wave function ansatz; (2) A data-centric parallelization scheme for the variational Monte Carlo (VMC) algorithm which preserves data locality and well adapts for different computing architectures; (3) A parallel batch sampling strategy which reduces the sampling cost and achieves good load balance; (4) A parallel local energy evaluation scheme which is both memory and computationally efficient; (5) Study of real chemical systems demonstrates both the superior accuracy of our method compared to state-of-the-art and the strong and weak scalability for large molecular systems with up to 120 spin orbitals.

arXiv:2306.16705•International Conference for High Performance Computing, Networking, Storage and Analysis (SC)•Oct 30, 2023•37 citations

Bridging the Gap between Transformer-Based Neural Networks and Tensor Networks for Quantum Chemistry

Bowen Kan, Yingqi Tian, Yangjun Wu +2 more

The neural network quantum state (NNQS) method has demonstrated promising results in ab initio quantum chemistry, achieving remarkable accuracy in molecular systems. However, efficient calculation of systems with large active spaces remains challenging. This study introduces a novel approach that bridges tensor network states with the transformer-based NNQS-Transformer (QiankunNet) to enhance accuracy and convergence for systems with relatively large active spaces. By transforming tensor network states into active space configuration interaction type wave functions, QiankunNet achieves accuracy surpassing both the pretraining density matrix renormalization group (DMRG) results and traditional coupled cluster methods, particularly in strongly correlated regimes. We investigate two configuration transformation methods: the sweep-based direct conversion (Conv.) method and the entanglement-driven genetic algorithm (EDGA) method, with Conv. showing superior efficiency. The effectiveness of this approach is validated on H 2 O with a large active space (10e, 24o) in the cc-pVDZ basis set, demonstrating an efficient routine between DMRG and QiankunNet and also offering a promising direction for advancing quantum state representation in complex molecular systems.

Journal of Chemical Theory and Computation•Mar 2, 2025•9 citations

Study of nanostructures coupled with a superconducting lead via the neural-network quantum states methods

Jana KODRLOVÁ, Martin Žonda, Martin Friák

The Neural-Network Quantum States (NNQS) method is rapidly emerging as a powerful tool for investigating quantum many-body physics.By combining variational Monte Carlo techniques with neural network-based variational functions, this approach leverages the remarkable advancements in deep learning achieved in recent years.While substantial progress has been made in simulating magnetic systems on lattices, simple molecules, and even continuous systems, the ab initio simulation of complex strongly correlated electron systems continues to pose significant challenges.With the help of the generalized atomic limit (GAL) -a recently developed model describing a system of quantum dots coupled to a superconducting lead -we attempt to show the efficiency and accuracy of NNQS, mainly the Restricted Boltzmann Machine, by comparing the acquired results to other available methods such as exact diagonalization.The simultaneous study of the system's properties such as the energy spectrum and quantum phase transitions could bring advancements in electronics, sensors or the design of high-quality qubits used in quantum computers.

Metal ...•Jan 1, 2025•0 citations

Transformer refined quantum sampling for strongly correlated electronic structure

Xiongzhi Zeng, Ming Gong, Bowen Kan +18 more

Although quantum computing offers a promising solution for strongly correlated system simulation, existing algorithms face significant bottlenecks on current noisy intermediate-scale quantum (NISQ) devices. Here, we introduce QiankunNet-QSCI, a hybrid quantum-classical framework that addresses this challenge by combining efficient quantum-sampling with a transformer neural network. An efficient unitary selected configuration Interaction (USCI) ansatz especially designed for quantum sampling is proposed to identify the most chemically significant electronic configurations on the Zuchongzhi 3.1 quantum processor. Subsequently, the transformer model QiankunNet learns from these sparse yet critical quantum data to infer and reconstruct the complete electronic wavefunction with high fidelity. Simulation of the challenging 40-qubit [2Fe-2S] ferredoxin active center achieves chemical accuracy. Simulation of the nitrogenase P-cluster in a 114-electron 73-orbital active space also reaches 12 milli-Hartree-level agreement with the best density matrix renormalization group (DMRG) result. QiankunNet-QSCI thus offers a practical route to accurate quantum-assisted electronic structure calculations on current devices.

quant-pharXiv:2605.24617•May 26, 2026•4 citations

Accurate Calculation of Interatomic Forces with Neural Networks Based on a Generative Transformer Architecture

Juntao Lai, Bowen Kan, Yangjun Wu +4 more

Using neural networks to express electronic wave functions represents a new paradigm for solving the Schrödinger equation in quantum chemistry. For practical quantum chemistry simulations, one needs to know not only energies of molecules, but also accurate forces acting on constituent atoms. In this work, we achieve the accurate calculation of interatomic forces on QiankunNet, a platform that combines transformer-based deep neural networks with efficient batched autoregressive sampling. Our approach permits the application of the Hellmann-Feynman theorem to force calculations without introducing corrective Pulay terms. The results show that the calculated interatomic forces are in close agreement with those derived from the full configuration interaction method, irrespective of whether the system is a simple molecule or a strongly correlated electron system like a linear hydrogen chain. Furthermore, the calculated interatomic forces are employed for atomic relaxation in the torsional rotation process of ethylene, and the energy barrier obtained from the scanned potential energy surface is in excellent agreement with the experiment. Our work contributes to the application of artificial intelligence to broader quantum chemistry simulations, such as modeling challenging chemical transformations where electron correlations are difficult to describe.

Journal of Chemical Theory and Computation•Oct 23, 2024•12 citations
Recent advancements in neural networks have led to significant progress in addressing many-body electron correlations in small molecules and various physical models. In this work, we propose QiankunNet-Solid, which incorporates periodic boundary conditions into the neural network quantum state (NNQS) framework based on generative Transformer architecture along with a batched autoregressive sampling (BAS) method, enabling the effective ab initio calculation of real solid materials. The accuracy of this method is demonstrated in one-, two-, and three-dimensional periodic systems, with results comparable to those of full configuration interaction and coupled-cluster method, even in the strongly correlated regime. Furthermore, we compute the band structures and density of states for silicon crystal. The successful incorporation of periodic boundary conditions into the NNQS framework through QiankunNet-Solid opens up new possibilities for the accurate and efficient study of electronic structure properties in solid-state physics.
Accurately solving the Schrödinger equation for intricate systems remains a prominent challenge in physical sciences. Here we present QiankunNet, a neural network quantum state (NNQS) framework that combines Transformer architectures with efficient autoregressive sampling to solve the many-electron Schrödinger equation. At its core is a Transformer-based wave function ansatz that captures complex quantum correlations through attention mechanisms, effectively learning the structure of many-body states. The quantum state sampling employs layer-wise Monte Carlo tree search (MCTS) that naturally enforces electron number conservation while exploring orbital configurations. The framework incorporates physics-informed initialization using truncated configuration interaction solutions, providing principled starting points for variational optimization. Our systematic benchmarks demonstrate QiankunNet's versatility across different chemical systems. For molecular systems up to 30 spin orbitals, we achieved correlation energies reaching 99.9% of the full configuration interaction (FCI) benchmark, setting a new standard for neural network quantum states. Most notably, in treating the Fenton reaction mechanism, a fundamental process in biological oxidative stress, QiankunNet successfully handled a large CAS(46e,26o) active space, enabling accurate description of the complex electronic structure evolution during Fe(II) to Fe(III) oxidation.
Neural network quantum state (NNQS) has emerged as a promising candidate for quantum many-body problems, but its practical applications are often hindered by the high cost of sampling and local energy calculation. We develop a high-performance NNQS method for ab initio electronic structure calculations. The major innovations include: (1) A transformer based architecture as the quantum wave function ansatz; (2) A data-centric parallelization scheme for the variational Monte Carlo (VMC) algorithm which preserves data locality and well adapts for different computing architectures; (3) A parallel batch sampling strategy which reduces the sampling cost and achieves good load balance; (4) A parallel local energy evaluation scheme which is both memory and computationally efficient; (5) Study of real chemical systems demonstrates both the superior accuracy of our method compared to state-of-the-art and the strong and weak scalability for large molecular systems with up to 120 spin orbitals.
The neural network quantum state (NNQS) method has demonstrated promising results in ab initio quantum chemistry, achieving remarkable accuracy in molecular systems. However, efficient calculation of systems with large active spaces remains challenging. This study introduces a novel approach that bridges tensor network states with the transformer-based NNQS-Transformer (QiankunNet) to enhance accuracy and convergence for systems with relatively large active spaces. By transforming tensor network states into active space configuration interaction type wave functions, QiankunNet achieves accuracy surpassing both the pretraining density matrix renormalization group (DMRG) results and traditional coupled cluster methods, particularly in strongly correlated regimes. We investigate two configuration transformation methods: the sweep-based direct conversion (Conv.) method and the entanglement-driven genetic algorithm (EDGA) method, with Conv. showing superior efficiency. The effectiveness of this approach is validated on H 2 O with a large active space (10e, 24o) in the cc-pVDZ basis set, demonstrating an efficient routine between DMRG and QiankunNet and also offering a promising direction for advancing quantum state representation in complex molecular systems.
The Neural-Network Quantum States (NNQS) method is rapidly emerging as a powerful tool for investigating quantum many-body physics.By combining variational Monte Carlo techniques with neural network-based variational functions, this approach leverages the remarkable advancements in deep learning achieved in recent years.While substantial progress has been made in simulating magnetic systems on lattices, simple molecules, and even continuous systems, the ab initio simulation of complex strongly correlated electron systems continues to pose significant challenges.With the help of the generalized atomic limit (GAL) -a recently developed model describing a system of quantum dots coupled to a superconducting lead -we attempt to show the efficiency and accuracy of NNQS, mainly the Restricted Boltzmann Machine, by comparing the acquired results to other available methods such as exact diagonalization.The simultaneous study of the system's properties such as the energy spectrum and quantum phase transitions could bring advancements in electronics, sensors or the design of high-quality qubits used in quantum computers.
Although quantum computing offers a promising solution for strongly correlated system simulation, existing algorithms face significant bottlenecks on current noisy intermediate-scale quantum (NISQ) devices. Here, we introduce QiankunNet-QSCI, a hybrid quantum-classical framework that addresses this challenge by combining efficient quantum-sampling with a transformer neural network. An efficient unitary selected configuration Interaction (USCI) ansatz especially designed for quantum sampling is proposed to identify the most chemically significant electronic configurations on the Zuchongzhi 3.1 quantum processor. Subsequently, the transformer model QiankunNet learns from these sparse yet critical quantum data to infer and reconstruct the complete electronic wavefunction with high fidelity. Simulation of the challenging 40-qubit [2Fe-2S] ferredoxin active center achieves chemical accuracy. Simulation of the nitrogenase P-cluster in a 114-electron 73-orbital active space also reaches 12 milli-Hartree-level agreement with the best density matrix renormalization group (DMRG) result. QiankunNet-QSCI thus offers a practical route to accurate quantum-assisted electronic structure calculations on current devices.
Using neural networks to express electronic wave functions represents a new paradigm for solving the Schrödinger equation in quantum chemistry. For practical quantum chemistry simulations, one needs to know not only energies of molecules, but also accurate forces acting on constituent atoms. In this work, we achieve the accurate calculation of interatomic forces on QiankunNet, a platform that combines transformer-based deep neural networks with efficient batched autoregressive sampling. Our approach permits the application of the Hellmann-Feynman theorem to force calculations without introducing corrective Pulay terms. The results show that the calculated interatomic forces are in close agreement with those derived from the full configuration interaction method, irrespective of whether the system is a simple molecule or a strongly correlated electron system like a linear hydrogen chain. Furthermore, the calculated interatomic forces are employed for atomic relaxation in the torsional rotation process of ethylene, and the energy barrier obtained from the scanned potential energy surface is in excellent agreement with the experiment. Our work contributes to the application of artificial intelligence to broader quantum chemistry simulations, such as modeling challenging chemical transformations where electron correlations are difficult to describe.