Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Neurocomputing

A quantum neural network with built-in self-attention mechanism

Shangshang Shi, Zhimin Wang, J. X. Li, Y. N. Li, Ruimin Shang, Haiyong Zheng, Guoqiang Zhong, Yu Gu, Xin Huang

Published Jan 26, 2026• 0 citations
Publisher
DOI
10.1016/j.neucom.2026.132862

Related papers

Structured Quantum Neural Networks Inspired by Multi-Head Attention Mechanisms

Chufan Lyu

International Conference on Electronic Information Engineering and Computer Technology (EIECT)•Oct 24, 2025•0 citations

Quantum self-attention neural networks for text classification

Guangxi Li, Xuanqiang Zhao, Xin Wang

arXiv:2205.05625•Science China Information Sciences•Mar 27, 2024•147 citations

Povm-Based Quantum Self-Attention Neural Network

Jiachun Wei, Zhimin He, Chuangtao Chen +2 more

Quantum Self-Attention Neural Network (QSANN) has demonstrated remarkable potential. However, it is limited to measuring only partial information from qubits, thereby restricting its information extraction capability. Moreover, the measurement process requires multiple measurements for each qubit, leading to inefficiency in utilizing the feature space. To address these challenges, this paper introduces a novel approach called Positive Operator-Valued Measure based Quantum Self-Attention Neural Network (POVM-QSANN). It leverages POVM operators as observables, enabling the extraction of comprehensive QKV (Query-Key-Value) feature vectors from each qubit. This innovative mechanism significantly enhances information extraction capability and efficiently utilizes the feature space. The experimental results underscore the considerable advancements of POVM-QSANN on MC and RP datasets. Particularly noteworthy is its remarkable accuracy increase of 9.68% compared to QSANN on the RP dataset.

International Conference on Wavelet Analysis and Pattern Recognition•Jul 9, 2023•6 citations

A Novel Neural Network Based on Quantum Computing

Bu-Qing Chen, Xu-Feng Niu

International Journal of Theoretical Physics•May 13, 2020•16 citations

Self-attention neural network for solving correlated electron problems in solids

Max Geier, Khachatur Nazaryan, Timothy Zaklama +1 more

The attention mechanism has transformed artificial intelligence research by its ability to learn relations between objects. In this work, we explore how a many-body wavefunction ansatz constructed from a large-parameter self-attention neural network can be used to solve the interacting electron problem in solids. By a systematic neural-network variational Monte Carlo study on a moiré quantum material, we demonstrate that the self-attention ansatz provides an accurate and efficient solution without human bias. Moreover, our numerical study finds that the required number of variational parameters scales roughly as $N^2$ with the number of electrons, which opens a path towards efficient large-scale simulations.

arXiv:2502.05383•Physical review. B./Physical review. B•Jun 16, 2025•36 citations

A Self-Attention Ansatz for Ab-initio Quantum Chemistry

Ingrid von Glehn, James S. Spencer, David Pfau

We present a novel neural network architecture using self-attention, the Wavefunction Transformer (Psiformer), which can be used as an approximation (or Ansatz) for solving the many-electron Schrödinger equation, the fundamental equation for quantum chemistry and material science. This equation can be solved from first principles, requiring no external training data. In recent years, deep neural networks like the FermiNet and PauliNet have been used to significantly improve the accuracy of these first-principle calculations, but they lack an attention-like mechanism for gating interactions between electrons. Here we show that the Psiformer can be used as a drop-in replacement for these other neural networks, often dramatically improving the accuracy of the calculations. On larger molecules especially, the ground state energy can be improved by dozens of kcal/mol, a qualitative leap over previous methods. This demonstrates that self-attention networks can learn complex quantum mechanical correlations between electrons, and are a promising route to reaching unprecedented accuracy in chemical calculations on larger systems.

arXiv:2211.13672•Nov 24, 2022•134 citations
Quantum Self-Attention Neural Network (QSANN) has demonstrated remarkable potential. However, it is limited to measuring only partial information from qubits, thereby restricting its information extraction capability. Moreover, the measurement process requires multiple measurements for each qubit, leading to inefficiency in utilizing the feature space. To address these challenges, this paper introduces a novel approach called Positive Operator-Valued Measure based Quantum Self-Attention Neural Network (POVM-QSANN). It leverages POVM operators as observables, enabling the extraction of comprehensive QKV (Query-Key-Value) feature vectors from each qubit. This innovative mechanism significantly enhances information extraction capability and efficiently utilizes the feature space. The experimental results underscore the considerable advancements of POVM-QSANN on MC and RP datasets. Particularly noteworthy is its remarkable accuracy increase of 9.68% compared to QSANN on the RP dataset.
The attention mechanism has transformed artificial intelligence research by its ability to learn relations between objects. In this work, we explore how a many-body wavefunction ansatz constructed from a large-parameter self-attention neural network can be used to solve the interacting electron problem in solids. By a systematic neural-network variational Monte Carlo study on a moiré quantum material, we demonstrate that the self-attention ansatz provides an accurate and efficient solution without human bias. Moreover, our numerical study finds that the required number of variational parameters scales roughly as N2N^2N2 with the number of electrons, which opens a path towards efficient large-scale simulations.
We present a novel neural network architecture using self-attention, the Wavefunction Transformer (Psiformer), which can be used as an approximation (or Ansatz) for solving the many-electron Schrödinger equation, the fundamental equation for quantum chemistry and material science. This equation can be solved from first principles, requiring no external training data. In recent years, deep neural networks like the FermiNet and PauliNet have been used to significantly improve the accuracy of these first-principle calculations, but they lack an attention-like mechanism for gating interactions between electrons. Here we show that the Psiformer can be used as a drop-in replacement for these other neural networks, often dramatically improving the accuracy of the calculations. On larger molecules especially, the ground state energy can be improved by dozens of kcal/mol, a qualitative leap over previous methods. This demonstrates that self-attention networks can learn complex quantum mechanical correlations between electrons, and are a promising route to reaching unprecedented accuracy in chemical calculations on larger systems.