Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2402.00776 · Axioms

Hybrid Quantum Vision Transformers for Event Classification in High Energy Physics

Eyup B. Unlu, Marçal Comajoan Cara, Gopal Ramesh Dahale, Zhongtian Dong, Roy T. Forestano, S. V. Gleyzer, Daniel Justice, Kyoungchul Kong, Tom Magorsch, Konstantin Tzvetanov Matchev, Katia Matcheva

Published Mar 13, 2024• 21 citations
arXivHTMLPDF

Abstract

Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The problem is exacerbated as the amount and complexity of the data increases. Quantum-based vision transformer models could potentially alleviate this issue by reducing the training and operating time while maintaining the same predictive power. Although current quantum computers are not yet able to perform high-dimensional tasks, they do offer one of the most efficient solutions for the future. In this work, we construct several variations of a quantum hybrid vision transformer for a classification problem in high-energy physics (distinguishing photons and electrons in the electromagnetic calorimeter). We test them against classical vision transformer architectures. Our findings indicate that the hybrid models can achieve comparable performance to their classical analogs with a similar number of parameters.

DOI
10.3390/axioms13030187

Related papers

Quantum Vision Transformers for Quark–Gluon Classification

Marçal Comajoan Cara, Gopal Ramesh Dahale, Zhongtian Dong +8 more

We introduce a hybrid quantum-classical vision transformer architecture, notable for its integration of variational quantum circuits within both the attention mechanism and the multi-layer perceptrons. The research addresses the critical challenge of computational efficiency and resource constraints in analyzing data from the upcoming High Luminosity Large Hadron Collider, presenting the architecture as a potential solution. In particular, we evaluate our method by applying the model to multi-detector jet images from CMS Open Data. The goal is to distinguish quark-initiated from gluon-initiated jets. We successfully train the quantum model and evaluate it via numerical simulations. Using this approach, we achieve classification performance almost on par with the one obtained with the completely classical architecture, considering a similar number of parameters.

arXiv:2405.10284•Axioms•May 13, 2024•23 citations

Quantum Machine Learning: Towards Hybrid Quantum-Classical Vision Models

Syed Muhammad Abuzar Rizvi, Usama Inam Paracha, Uman Khalid +2 more

The emergence of deep vision models such as convolutional neural networks and vision transformers has revolutionized computer vision, enabling significant advancements in image classification, object detection, and segmentation. In parallel, the rapid development of quantum computing has spurred interest in quantum machine learning (QML), which integrates the strengths of quantum computation with the representational power of deep learning. In QML, parameterized quantum circuits offer the potential to capture complex image features, define complex decision boundaries, and provide other computational advantages. This paper investigates hybrid quantum-classical vision architectures, with a focus on hybrid quantum-classical convolutional neural networks and hybrid quantum-classical vision transformers. These hybrid models explore both quantum pre-processing and post-processing of data, respectively, where quantum circuits are strategically integrated into the data pipeline to enhance model performance. Our results suggest that these hybrid models can enhance accuracy and computational efficiency in vision-related tasks, even with the constraints of current noisy intermediate-scale quantum devices.

Mathematics•Aug 18, 2025•30 citations

Measurements With A Quantum Vision Transformer: A Naive Approach

Dominic Pasquali, Michele Grossi, Sofia Vallecorsa

In mainstream machine learning, transformers are gaining widespread usage. As Vision Transformers rise in popularity in computer vision, they now aim to tackle a wide variety of machine learning applications. In particular, transformers for High Energy Physics (HEP) experiments continue to be investigated for tasks including jet tagging, particle reconstruction, and pile-up mitigation. An improved Quantum Vision Transformer (QViT) with a quantum-enhanced self-attention mechanism is introduced and discussed. A shallow circuit is proposed for each component of self-attention to leverage current Noisy Intermediate Scale Quantum (NISQ) devices. Variations of the hybrid architecture/model are explored and analyzed. The results demonstrate a successful proof of concept for the QViT, and establish a competitive performance benchmark for the proposed design and implementation. The findings also provide strong motivation to experiment with different architectures, hyperparameters, and datasets, setting the stage for implementation in HEP environments where transformers are increasingly used in state of the art machine learning solutions.

EPJ Web of Conferences•Jan 1, 2024•5 citations

MedQViT: A Lightweight Hybrid Quantum Vision Transformer for Medical Image Analysis

Amandeep Singh Bhatia, Mandeep Kaur Saggi

Classical Vision Transformers (CViTs) have demonstrated strong performance in medical image analysis, supporting a wide range of digital health applications. However, their self-attention mechanisms can require substantial computational resources and model parameters. In parallel, quantum machine learning (QML) has attracted increasing interest in healthcare and other scientific domains, particularly because quantum-enhanced models may provide expressive representations for small datasets. In this paper, we propose MedQViT, a robust and parameter-efficient Quantum Vision Transformer for medical image classification. To reduce the computational cost of global self-attention, MedQViT combines a shared four-qubit parameterized quantum circuit with a quantum-feature state memory and trainable landmark tokens. This hybrid architecture encodes image patches into compact quantum-enhanced representations while using classical layers for feature aggregation and classification. Experiments on established medical image datasets evaluate the effectiveness and feasibility of MedQViT against classical and quantum baselines. MedQViT achieves competitive performance with substantially fewer parameters than conventional vision models and outperforms several classical and quantum methods in terms of test accuracy (ACC) and area under the receiver operating characteristic curve (AUC).

Proceedings of the AAAI Symposium Series•Nov 6, 2026•0 citations

Image Classification using Quantum Convolutional Neural Network (QCNN)

R. Sivaranjani, Bandaru Shanmukha Priya, Omprakash Gurrapu +3 more

Convolutional Neural Networks (CNNs) are extensively utilized for image classification due to their ability to exploit data correlations effectively. However, traditional CNNs encounter several challenges, including limitations in accuracy improvement, computational efficiency, explain ability, and generalization. As data dimensionality or model complexity increases, CNNs often become more difficult to train efficiently, leading to slower processing times. To overcome these challenges, Quantum Convolutional Neural Networks (QCNNs) offer a promising quantum-based approach to enhance existing models, particularly by improving training efficiency and reducing processing times. This paper provides a comparative analysis of classical CNNs and a novel quantum circuit architecture tailored for image-based tasks. The analysis emphasizes the adaptability and potential of quantum circuits to enhance feature extraction, recognition accuracy, and processing efficiency.We applied various QCNN architectures to the Chinese-MNIST dataset and compared their performance with traditional CNN models. Although QCNNs achieved slightly lower accuracy, they demonstrated significantly greater stability. These findings high- light QCNNs’ potential to overcome the computational limitations of conventional deep learning, offering a promising pathway for quantum-enhanced solutions in computer vision. Future work will focus on refining quantum circuit designs, developing hybrid quantum-classical models, and extending QCNN applications to larger and more diverse datasets.

International Conference on Metaverse and Current Trends in Computing (ICMCTC)•Apr 10, 2025•2 citations

Quantum Vision Transformers

El Amine Cherrat, Iordanis Kerenidis, Natansh Mathur +3 more

In this work, quantum transformers are designed and analysed in detail by extending the state-of-the-art classical transformer neural network architectures known to be very performant in natural language processing and image analysis. Building upon the previous work, which uses parametrised quantum circuits for data loading and orthogonal neural layers, we introduce three types of quantum transformers for training and inference, including a quantum transformer based on compound matrices, which guarantees a theoretical advantage of the quantum attention mechanism compared to their classical counterpart both in terms of asymptotic run time and the number of model parameters. These quantum architectures can be built using shallow quantum circuits and produce qualitatively different classification models. The three proposed quantum attention layers vary on the spectrum between closely following the classical transformers and exhibiting more quantum characteristics. As building blocks of the quantum transformer, we propose a novel method for loading a matrix as quantum states as well as two new trainable quantum orthogonal layers adaptable to different levels of connectivity and quality of quantum computers. We performed extensive simulations of the quantum transformers on standard medical image datasets that showed competitively, and at times better performance compared to the classical benchmarks, including the best-in-class classical vision transformers. The quantum transformers we trained on these small-scale datasets require fewer parameters compared to standard classical benchmarks. Finally, we implemented our quantum transformers on superconducting quantum computers and obtained encouraging results for up to six qubit experiments.

arXiv:2209.08167•Quantum•Feb 22, 2024•162 citations
Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The problem is exacerbated as the amount and complexity of the data increases. Quantum-based vision transformer models could potentially alleviate this issue by reducing the training and operating time while maintaining the same predictive power. Although current quantum computers are not yet able to perform high-dimensional tasks, they do offer one of the most efficient solutions for the future. In this work, we construct several variations of a quantum hybrid vision transformer for a classification problem in high-energy physics (distinguishing photons and electrons in the electromagnetic calorimeter). We test them against classical vision transformer architectures. Our findings indicate that the hybrid models can achieve comparable performance to their classical analogs with a similar number of parameters.
We introduce a hybrid quantum-classical vision transformer architecture, notable for its integration of variational quantum circuits within both the attention mechanism and the multi-layer perceptrons. The research addresses the critical challenge of computational efficiency and resource constraints in analyzing data from the upcoming High Luminosity Large Hadron Collider, presenting the architecture as a potential solution. In particular, we evaluate our method by applying the model to multi-detector jet images from CMS Open Data. The goal is to distinguish quark-initiated from gluon-initiated jets. We successfully train the quantum model and evaluate it via numerical simulations. Using this approach, we achieve classification performance almost on par with the one obtained with the completely classical architecture, considering a similar number of parameters.
The emergence of deep vision models such as convolutional neural networks and vision transformers has revolutionized computer vision, enabling significant advancements in image classification, object detection, and segmentation. In parallel, the rapid development of quantum computing has spurred interest in quantum machine learning (QML), which integrates the strengths of quantum computation with the representational power of deep learning. In QML, parameterized quantum circuits offer the potential to capture complex image features, define complex decision boundaries, and provide other computational advantages. This paper investigates hybrid quantum-classical vision architectures, with a focus on hybrid quantum-classical convolutional neural networks and hybrid quantum-classical vision transformers. These hybrid models explore both quantum pre-processing and post-processing of data, respectively, where quantum circuits are strategically integrated into the data pipeline to enhance model performance. Our results suggest that these hybrid models can enhance accuracy and computational efficiency in vision-related tasks, even with the constraints of current noisy intermediate-scale quantum devices.
In mainstream machine learning, transformers are gaining widespread usage. As Vision Transformers rise in popularity in computer vision, they now aim to tackle a wide variety of machine learning applications. In particular, transformers for High Energy Physics (HEP) experiments continue to be investigated for tasks including jet tagging, particle reconstruction, and pile-up mitigation. An improved Quantum Vision Transformer (QViT) with a quantum-enhanced self-attention mechanism is introduced and discussed. A shallow circuit is proposed for each component of self-attention to leverage current Noisy Intermediate Scale Quantum (NISQ) devices. Variations of the hybrid architecture/model are explored and analyzed. The results demonstrate a successful proof of concept for the QViT, and establish a competitive performance benchmark for the proposed design and implementation. The findings also provide strong motivation to experiment with different architectures, hyperparameters, and datasets, setting the stage for implementation in HEP environments where transformers are increasingly used in state of the art machine learning solutions.
Classical Vision Transformers (CViTs) have demonstrated strong performance in medical image analysis, supporting a wide range of digital health applications. However, their self-attention mechanisms can require substantial computational resources and model parameters. In parallel, quantum machine learning (QML) has attracted increasing interest in healthcare and other scientific domains, particularly because quantum-enhanced models may provide expressive representations for small datasets. In this paper, we propose MedQViT, a robust and parameter-efficient Quantum Vision Transformer for medical image classification. To reduce the computational cost of global self-attention, MedQViT combines a shared four-qubit parameterized quantum circuit with a quantum-feature state memory and trainable landmark tokens. This hybrid architecture encodes image patches into compact quantum-enhanced representations while using classical layers for feature aggregation and classification. Experiments on established medical image datasets evaluate the effectiveness and feasibility of MedQViT against classical and quantum baselines. MedQViT achieves competitive performance with substantially fewer parameters than conventional vision models and outperforms several classical and quantum methods in terms of test accuracy (ACC) and area under the receiver operating characteristic curve (AUC).
Convolutional Neural Networks (CNNs) are extensively utilized for image classification due to their ability to exploit data correlations effectively. However, traditional CNNs encounter several challenges, including limitations in accuracy improvement, computational efficiency, explain ability, and generalization. As data dimensionality or model complexity increases, CNNs often become more difficult to train efficiently, leading to slower processing times. To overcome these challenges, Quantum Convolutional Neural Networks (QCNNs) offer a promising quantum-based approach to enhance existing models, particularly by improving training efficiency and reducing processing times. This paper provides a comparative analysis of classical CNNs and a novel quantum circuit architecture tailored for image-based tasks. The analysis emphasizes the adaptability and potential of quantum circuits to enhance feature extraction, recognition accuracy, and processing efficiency.We applied various QCNN architectures to the Chinese-MNIST dataset and compared their performance with traditional CNN models. Although QCNNs achieved slightly lower accuracy, they demonstrated significantly greater stability. These findings high- light QCNNs’ potential to overcome the computational limitations of conventional deep learning, offering a promising pathway for quantum-enhanced solutions in computer vision. Future work will focus on refining quantum circuit designs, developing hybrid quantum-classical models, and extending QCNN applications to larger and more diverse datasets.
In this work, quantum transformers are designed and analysed in detail by extending the state-of-the-art classical transformer neural network architectures known to be very performant in natural language processing and image analysis. Building upon the previous work, which uses parametrised quantum circuits for data loading and orthogonal neural layers, we introduce three types of quantum transformers for training and inference, including a quantum transformer based on compound matrices, which guarantees a theoretical advantage of the quantum attention mechanism compared to their classical counterpart both in terms of asymptotic run time and the number of model parameters. These quantum architectures can be built using shallow quantum circuits and produce qualitatively different classification models. The three proposed quantum attention layers vary on the spectrum between closely following the classical transformers and exhibiting more quantum characteristics. As building blocks of the quantum transformer, we propose a novel method for loading a matrix as quantum states as well as two new trainable quantum orthogonal layers adaptable to different levels of connectivity and quality of quantum computers. We performed extensive simulations of the quantum transformers on standard medical image datasets that showed competitively, and at times better performance compared to the classical benchmarks, including the best-in-class classical vision transformers. The quantum transformers we trained on these small-scale datasets require fewer parameters compared to standard classical benchmarks. Finally, we implemented our quantum transformers on superconducting quantum computers and obtained encouraging results for up to six qubit experiments.