Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2403.14753

Learning with SASQuaTCh: a Novel Variational Quantum Transformer Architecture with Kernel-Based Self-Attention

Ethan N. Evans, Cook, Matthew, Zachary P. Bradshaw, Margarite L. LaBorde

Published Mar 21, 2024• 24 citations
arXivHTMLPDF

Abstract

The recent exploding growth in size of state-of-the-art machine learning models highlights a well-known issue where exponential parameter growth, which has grown to trillions as in the case of the Generative Pre-trained Transformer (GPT), leads to training time and memory requirements which limit their advancement in the near term. The predominant models use the so-called transformer network and have a large field of applicability, including predicting text and images, classification, and even predicting solutions to the dynamics of physical systems. Here we present a variational quantum circuit architecture named Self-Attention Sequential Quantum Transformer Channel (SASQuaTCh), which builds networks of qubits that perform analogous operations of the transformer network, namely the keystone self-attention operation, and leads to an exponential improvement in parameter complexity and run-time complexity over its classical counterpart. Our approach leverages recent insights from kernel-based operator learning in the context of predicting spatiotemporal systems to represent deep layers of a vision transformer network using simple gate operations and a set of multi-dimensional quantum Fourier transforms. To validate our approach, we consider image classification tasks in simulation and with hardware, where with only 9 qubits and a handful of parameters we are able to simultaneously embed and classify a grayscale image of handwritten digits with high accuracy.

DOI
10.48550/arxiv.2403.14753

Related papers

QiT: Quantum-Inspired Transformer for Visual Recognition Task

Badri N. Patro, Vijay Agneeswaran

Quantum machine learning offers a compelling representational perspective: angle-encoded states inhabit Hilbert spaces in which periodic similarities and interactions can be expressed naturally. Realizing this perspective for visual recognition remains difficult, however, because present quantum neural networks are constrained by limited qubit counts, costly circuit simulation and measurement, noise, and unstable optimization on noisy intermediate-scale quantum devices. We investigate whether useful structural ideas from quantum models can instead be realized as scalable classical Transformer operations. We introduce QiT, a Quantum-inspired Transformer for vision tasks with three components: (i) angle-inspired encoding that maps image tokens to learned trigonometric Hilbert-space features analogous to quantum rotation-based state encoding; (ii) self-attention over these periodic features, inducing a classical cosine kernel approximated to quantum fidelity kernels; and (iii) gated multiplicative emulation, a trainable classical surrogate for interaction terms found in variational circuits. All components are differentiable tensor operations, so QiT claims neither quantum computation nor quantum speedup and retains the $\mathcal{O}(N^2D)$ attention complexity of a standard Vision Transformer. Across image-classification benchmarks, QiT is competitive with a matched classical Transformer while avoiding the severe runtime cost observed for a small simulated quantum Transformer. QiT-B reaches 78.3\% ImageNet-1K top-1 accuracy with 45.7M parameters and 11.5 GFLOPs. These results position QiT as a scalable baseline for isolating and evaluating quantum-motivated inductive biases in visual recognition.

quant-pharXiv:2609.17789•Sep 17, 2026•0 citations

Efficient Circuit Classifier Design for Enhancing Quantum Self-Attention in Vision Transformers

Huyen Quang Tran, Yu-Han Lin, Hanh Thi Minh Tran +2 more

Quantum self-attention is a promising approach to replace traditional self-attention mechanisms in classical deep learning, which often require a massive number of GPUs for training. Although several early studies have proposed quantum self-attention architectures, these models often struggle with classification tasks in vision transformers. In this study, we address this limitation by enhancing quantum self-attention through integration with circuit classifier design and, crucially, by optimizing the number of strong entangling layers. Evaluation results show that incorporating an optimal number of entangling layers substantially improves classification performance, outperforming models that rely solely on directly measured quantum self-attention. We further analyze how varying the number of quantum classifier layers affects classification accuracy during training. Experiments on downscaled MNIST and MC datasets reveal that the nature of the input data has minimal impact on the final outcomes. Notably, testing accuracy reaches 56% when using 10–16 strong entangling layers, highlighting the critical role of entanglement in model performance. For SOTA comparison, we replicate existing quantum self-attention methods and demonstrate that our model consistently achieves 10-23% better performance results. Additionally, we compare different optimizers and find that Nesterov Momentum delivers the most effective convergence for our architecture.

IEEE Globecom Workshops (GC Wkshps)•Dec 8, 2025•0 citations

Enhancing Text Classification Through Quantum Transfer Learning: A Hybrid Quantum-Classical Approach With Complex Kernel Self-Attention Networks

Xiaoxiao Chen, Xiaoping Lou

Quantum computing, with its unique principles such as superposition and entanglement, promises to transform various domains, including artificial intelligence. This study investigates the fusion of quantum computing with contemporary AI technologies through quantum transfer learning. We introduce the Complex Quantum Kernel Self-Attention Network (CQKSAN), a novel model that leverages quantum circuits and self-attention mechanisms to boost text classification performance. By applying quantum transfer learning, CQKSAN harnesses the strengths of pre-trained classical models and enhances them with quantum capabilities. Experimental results on multiple binary classification datasets demonstrate that CQKSAN achieves a more efficient learning process. Specifically, it improves training accuracy and validation accuracy by up to 24.31% and 28.35%, respectively, and increases the Matthews Correlation Coefficient by 113.10%. Moreover, CQKSAN consistently outperforms the BERT baseline in both training and validation accuracy across various datasets, showcasing its strong learning capability and generalization performance in handling tasks with diverse linguistic structures and complex semantics. Our findings underscore the potential of hybrid quantum-classical approaches, while also identifying the current limitations and paving the way for future research in fully quantum-based learning systems.

IEEE Access•Jan 1, 2025•5 citations

Quantum Vision Transformers

El Amine Cherrat, Iordanis Kerenidis, Natansh Mathur +3 more

In this work, quantum transformers are designed and analysed in detail by extending the state-of-the-art classical transformer neural network architectures known to be very performant in natural language processing and image analysis. Building upon the previous work, which uses parametrised quantum circuits for data loading and orthogonal neural layers, we introduce three types of quantum transformers for training and inference, including a quantum transformer based on compound matrices, which guarantees a theoretical advantage of the quantum attention mechanism compared to their classical counterpart both in terms of asymptotic run time and the number of model parameters. These quantum architectures can be built using shallow quantum circuits and produce qualitatively different classification models. The three proposed quantum attention layers vary on the spectrum between closely following the classical transformers and exhibiting more quantum characteristics. As building blocks of the quantum transformer, we propose a novel method for loading a matrix as quantum states as well as two new trainable quantum orthogonal layers adaptable to different levels of connectivity and quality of quantum computers. We performed extensive simulations of the quantum transformers on standard medical image datasets that showed competitively, and at times better performance compared to the classical benchmarks, including the best-in-class classical vision transformers. The quantum transformers we trained on these small-scale datasets require fewer parameters compared to standard classical benchmarks. Finally, we implemented our quantum transformers on superconducting quantum computers and obtained encouraging results for up to six qubit experiments.

arXiv:2209.08167•Quantum•Feb 22, 2024•162 citations

MedQViT: A Lightweight Hybrid Quantum Vision Transformer for Medical Image Analysis

Amandeep Singh Bhatia, Mandeep Kaur Saggi

Classical Vision Transformers (CViTs) have demonstrated strong performance in medical image analysis, supporting a wide range of digital health applications. However, their self-attention mechanisms can require substantial computational resources and model parameters. In parallel, quantum machine learning (QML) has attracted increasing interest in healthcare and other scientific domains, particularly because quantum-enhanced models may provide expressive representations for small datasets. In this paper, we propose MedQViT, a robust and parameter-efficient Quantum Vision Transformer for medical image classification. To reduce the computational cost of global self-attention, MedQViT combines a shared four-qubit parameterized quantum circuit with a quantum-feature state memory and trainable landmark tokens. This hybrid architecture encodes image patches into compact quantum-enhanced representations while using classical layers for feature aggregation and classification. Experiments on established medical image datasets evaluate the effectiveness and feasibility of MedQViT against classical and quantum baselines. MedQViT achieves competitive performance with substantially fewer parameters than conventional vision models and outperforms several classical and quantum methods in terms of test accuracy (ACC) and area under the receiver operating characteristic curve (AUC).

Proceedings of the AAAI Symposium Series•Nov 6, 2026•0 citations

Hybrid Quantum Vision Transformers for Event Classification in High Energy Physics

Eyup B. Unlu, Marçal Comajoan Cara, Gopal Ramesh Dahale +8 more

Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The problem is exacerbated as the amount and complexity of the data increases. Quantum-based vision transformer models could potentially alleviate this issue by reducing the training and operating time while maintaining the same predictive power. Although current quantum computers are not yet able to perform high-dimensional tasks, they do offer one of the most efficient solutions for the future. In this work, we construct several variations of a quantum hybrid vision transformer for a classification problem in high-energy physics (distinguishing photons and electrons in the electromagnetic calorimeter). We test them against classical vision transformer architectures. Our findings indicate that the hybrid models can achieve comparable performance to their classical analogs with a similar number of parameters.

arXiv:2402.00776•Axioms•Mar 13, 2024•21 citations
The recent exploding growth in size of state-of-the-art machine learning models highlights a well-known issue where exponential parameter growth, which has grown to trillions as in the case of the Generative Pre-trained Transformer (GPT), leads to training time and memory requirements which limit their advancement in the near term. The predominant models use the so-called transformer network and have a large field of applicability, including predicting text and images, classification, and even predicting solutions to the dynamics of physical systems. Here we present a variational quantum circuit architecture named Self-Attention Sequential Quantum Transformer Channel (SASQuaTCh), which builds networks of qubits that perform analogous operations of the transformer network, namely the keystone self-attention operation, and leads to an exponential improvement in parameter complexity and run-time complexity over its classical counterpart. Our approach leverages recent insights from kernel-based operator learning in the context of predicting spatiotemporal systems to represent deep layers of a vision transformer network using simple gate operations and a set of multi-dimensional quantum Fourier transforms. To validate our approach, we consider image classification tasks in simulation and with hardware, where with only 9 qubits and a handful of parameters we are able to simultaneously embed and classify a grayscale image of handwritten digits with high accuracy.
Quantum machine learning offers a compelling representational perspective: angle-encoded states inhabit Hilbert spaces in which periodic similarities and interactions can be expressed naturally. Realizing this perspective for visual recognition remains difficult, however, because present quantum neural networks are constrained by limited qubit counts, costly circuit simulation and measurement, noise, and unstable optimization on noisy intermediate-scale quantum devices. We investigate whether useful structural ideas from quantum models can instead be realized as scalable classical Transformer operations. We introduce QiT, a Quantum-inspired Transformer for vision tasks with three components: (i) angle-inspired encoding that maps image tokens to learned trigonometric Hilbert-space features analogous to quantum rotation-based state encoding; (ii) self-attention over these periodic features, inducing a classical cosine kernel approximated to quantum fidelity kernels; and (iii) gated multiplicative emulation, a trainable classical surrogate for interaction terms found in variational circuits. All components are differentiable tensor operations, so QiT claims neither quantum computation nor quantum speedup and retains the O(N2D)\mathcal{O}(N^2D)O(N2D) attention complexity of a standard Vision Transformer. Across image-classification benchmarks, QiT is competitive with a matched classical Transformer while avoiding the severe runtime cost observed for a small simulated quantum Transformer. QiT-B reaches 78.3\% ImageNet-1K top-1 accuracy with 45.7M parameters and 11.5 GFLOPs. These results position QiT as a scalable baseline for isolating and evaluating quantum-motivated inductive biases in visual recognition.
Quantum self-attention is a promising approach to replace traditional self-attention mechanisms in classical deep learning, which often require a massive number of GPUs for training. Although several early studies have proposed quantum self-attention architectures, these models often struggle with classification tasks in vision transformers. In this study, we address this limitation by enhancing quantum self-attention through integration with circuit classifier design and, crucially, by optimizing the number of strong entangling layers. Evaluation results show that incorporating an optimal number of entangling layers substantially improves classification performance, outperforming models that rely solely on directly measured quantum self-attention. We further analyze how varying the number of quantum classifier layers affects classification accuracy during training. Experiments on downscaled MNIST and MC datasets reveal that the nature of the input data has minimal impact on the final outcomes. Notably, testing accuracy reaches 56% when using 10–16 strong entangling layers, highlighting the critical role of entanglement in model performance. For SOTA comparison, we replicate existing quantum self-attention methods and demonstrate that our model consistently achieves 10-23% better performance results. Additionally, we compare different optimizers and find that Nesterov Momentum delivers the most effective convergence for our architecture.
Quantum computing, with its unique principles such as superposition and entanglement, promises to transform various domains, including artificial intelligence. This study investigates the fusion of quantum computing with contemporary AI technologies through quantum transfer learning. We introduce the Complex Quantum Kernel Self-Attention Network (CQKSAN), a novel model that leverages quantum circuits and self-attention mechanisms to boost text classification performance. By applying quantum transfer learning, CQKSAN harnesses the strengths of pre-trained classical models and enhances them with quantum capabilities. Experimental results on multiple binary classification datasets demonstrate that CQKSAN achieves a more efficient learning process. Specifically, it improves training accuracy and validation accuracy by up to 24.31% and 28.35%, respectively, and increases the Matthews Correlation Coefficient by 113.10%. Moreover, CQKSAN consistently outperforms the BERT baseline in both training and validation accuracy across various datasets, showcasing its strong learning capability and generalization performance in handling tasks with diverse linguistic structures and complex semantics. Our findings underscore the potential of hybrid quantum-classical approaches, while also identifying the current limitations and paving the way for future research in fully quantum-based learning systems.
In this work, quantum transformers are designed and analysed in detail by extending the state-of-the-art classical transformer neural network architectures known to be very performant in natural language processing and image analysis. Building upon the previous work, which uses parametrised quantum circuits for data loading and orthogonal neural layers, we introduce three types of quantum transformers for training and inference, including a quantum transformer based on compound matrices, which guarantees a theoretical advantage of the quantum attention mechanism compared to their classical counterpart both in terms of asymptotic run time and the number of model parameters. These quantum architectures can be built using shallow quantum circuits and produce qualitatively different classification models. The three proposed quantum attention layers vary on the spectrum between closely following the classical transformers and exhibiting more quantum characteristics. As building blocks of the quantum transformer, we propose a novel method for loading a matrix as quantum states as well as two new trainable quantum orthogonal layers adaptable to different levels of connectivity and quality of quantum computers. We performed extensive simulations of the quantum transformers on standard medical image datasets that showed competitively, and at times better performance compared to the classical benchmarks, including the best-in-class classical vision transformers. The quantum transformers we trained on these small-scale datasets require fewer parameters compared to standard classical benchmarks. Finally, we implemented our quantum transformers on superconducting quantum computers and obtained encouraging results for up to six qubit experiments.
Classical Vision Transformers (CViTs) have demonstrated strong performance in medical image analysis, supporting a wide range of digital health applications. However, their self-attention mechanisms can require substantial computational resources and model parameters. In parallel, quantum machine learning (QML) has attracted increasing interest in healthcare and other scientific domains, particularly because quantum-enhanced models may provide expressive representations for small datasets. In this paper, we propose MedQViT, a robust and parameter-efficient Quantum Vision Transformer for medical image classification. To reduce the computational cost of global self-attention, MedQViT combines a shared four-qubit parameterized quantum circuit with a quantum-feature state memory and trainable landmark tokens. This hybrid architecture encodes image patches into compact quantum-enhanced representations while using classical layers for feature aggregation and classification. Experiments on established medical image datasets evaluate the effectiveness and feasibility of MedQViT against classical and quantum baselines. MedQViT achieves competitive performance with substantially fewer parameters than conventional vision models and outperforms several classical and quantum methods in terms of test accuracy (ACC) and area under the receiver operating characteristic curve (AUC).
Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The problem is exacerbated as the amount and complexity of the data increases. Quantum-based vision transformer models could potentially alleviate this issue by reducing the training and operating time while maintaining the same predictive power. Although current quantum computers are not yet able to perform high-dimensional tasks, they do offer one of the most efficient solutions for the future. In this work, we construct several variations of a quantum hybrid vision transformer for a classification problem in high-energy physics (distinguishing photons and electrons in the electromagnetic calorimeter). We test them against classical vision transformer architectures. Our findings indicate that the hybrid models can achieve comparable performance to their classical analogs with a similar number of parameters.