Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2203.03550

When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computing

Chao-Han Huck Yang, Qi, Jun, Samuel Yen-Chi Chen, Yu Tsao, Pin‐Yu Chen

Published Feb 17, 2022• 1 citation
arXivHTMLPDF

Abstract

The rapid development of quantum computing has demonstrated many unique characteristics of quantum advantages, such as richer feature representation and more secured protection on model parameters. This work proposes a vertical federated learning architecture based on variational quantum circuits to demonstrate the competitive performance of a quantum-enhanced pre-trained BERT model for text classification. In particular, our proposed hybrid classical-quantum model consists of a novel random quantum temporal convolution (QTC) learning framework replacing some layers in the BERT-based decoder. Our experiments on intent classification show that our proposed BERT-QTC model attains competitive experimental results in the Snips and ATIS spoken language datasets. Particularly, the BERT-QTC boosts the performance of the existing quantum circuit-based language model in two text classification datasets by 1.57% and 1.52% relative improvements. Furthermore, BERT-QTC can be feasibly deployed on both existing commercial-accessible quantum computation hardware and CPU-based interface for ensuring data isolation.

DOI
10.48550/arxiv.2203.03550

Related papers

When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computing

Chao-Han Huck Yang, Jun Qi, Samuel Yen-Chi Chen +2 more

The rapid development of quantum computing has demonstrated many unique characteristics of quantum advantages, such as richer feature representation and more secured protection on model parameters. This work proposes a vertical federated learning architecture based on variational quantum circuits to demonstrate the competitive performance of a quantum-enhanced pre-trained BERT model for text classification. In particular, our proposed hybrid classical-quantum model consists of a novel random quantum temporal convolution (QTC) learning framework replacing some layers in the BERT-based decoder. Our experiments on intent classification show that our proposed BERT-QTC model attains competitive experimental results in the Snips and ATIS spoken language datasets. Particularly, the BERT-QTC boosts the performance of the existing quantum circuit-based language model in two text classification datasets by 1.57% and 1.52% relative improvements. Furthermore, BERT-QTC can be feasibly deployed on both existing commercial-accessible quantum computation hardware and CPU-based interface for ensuring data isolation.

IEEE International Conference on Acoustics Speech and Signal Processing•Apr 27, 2022•68 citations

A Hybrid Classical-Quantum Fined Tuned BERT for Text Classification

Abu Kaisar Mohammad Masum, Naveed Mahmud, M. Hassan Najafi +1 more

Fine-tuning BERT for text classification can be computationally challenging and requires careful hyper-parameter tuning. Recent studies have highlighted the potential of quantum algorithms to outperform conventional methods in machine learning and text classification tasks. In this work, we propose a hybrid approach that integrates an n-qubit quantum circuit with a classical BERT model for text classification. We evaluate the performance of the fine-tuned classical-quantum BERT and demonstrate its feasibility as well as its potential in advancing this research area. Our experimental results show that the proposed hybrid model achieves performance that is competitive with, and in some cases better than, the classical baselines on standard benchmark datasets. Furthermore, our approach demonstrates the adaptability of classical–quantum models for fine-tuning pre-trained models across diverse datasets. Overall, the hybrid model highlights the promise of quantum computing in achieving improved performance for text classification tasks.

Proceedings of the AAAI Symposium Series•Nov 23, 2025•2 citations

A Hybrid Classical-Quantum Fine Tuned BERT for Text Classification

Abu Kaisar Mohammad Masum, Naveed Mahmud, M. Hassan Najafi +1 more

Fine-tuning BERT for text classification can be computationally challenging and requires careful hyper-parameter tuning. Recent studies have highlighted the potential of quantum algorithms to outperform conventional methods in machine learning and text classification tasks. In this work, we propose a hybrid approach that integrates an n-qubit quantum circuit with a classical BERT model for text classification. We evaluate the performance of the fine-tuned classical-quantum BERT and demonstrate its feasibility as well as its potential in advancing this research area. Our experimental results show that the proposed hybrid model achieves performance that is competitive with, and in some cases better than, the classical baselines on standard benchmark datasets. Furthermore, our approach demonstrates the adaptability of classical-quantum models for fine-tuning pre-trained models across diverse datasets. Overall, the hybrid model highlights the promise of quantum computing in achieving improved performance for text classification tasks.

cs.LGCross-listedarXiv:2511.17677•Nov 24, 2025•0 citations

Hybrid Quantum-Classical Layers for Sentiment Analysis in Natural Language Processing

Medisetti Esther Rani, Tupakula Sai Sarnya

NLP models have shown remarkable performance for sentiment analysis and text classification tasks due to the deep neural networks and transformer architectures. However, these models typically necessitate considerable computational resources, high parameter complexity and large scale training datasets. Recently, quantum computing has emerged as a promising paradigm that can enhance machine learning systems using quantum parallelism, superposition, and entanglement. In this paper, we propose a new Hybrid Quantum-Classical NLP architecture that combines variational quantum circuit (VQC) layers with classical neural network layers for effective sentiment analysis. The proposed framework combines classical embedding and LSTM layers with a quantum-enhanced variational layer to improve feature representation and classification performance. The proposed framework combines classical embedding and LSTM layers with a quantum-enhanced variational layer to enhance the feature representation and classification performance. The quantum layer is realized via parameterized quantum circuits and optimized using hybrid gradient-based learning techniques. The effectiveness of The proposed framework combines classical embedding and LSTM layers with a quantum-enhanced variational layer to enhance the feature representation and classification performance. The quantum layer is realized via parameterized quantum circuits and optimized using hybrid gradient-based learning techniques. The effectiveness of the proposed model is evaluated on the benchmark sentiment analysis datasets such as IMDb and SST-2 experiments. The hybrid architecture is compared with standard deep learning models in terms of accuracy, training complexity and parameter efficiency. The experimental results show that the proposed quantum-enhanced model can achieve competitive classification accuracy while reducing model complexity and improving contextual semantic learning.

International Conference on Natural Language Processing and Computer Vision (ICNPCV)•Jul 1, 2026•0 citations

An effective quantum federated learning approach for dynamic classification using realistic case studies and IBMQ implementation

Níyazí Furkan Bar, Mehmet Karaköse

Abstract Currently, data privacy and security are critical in deep learning, especially with biometric data. Federated learning (FL) addresses these concerns, but struggles with security, complexity, and high-dimensional data. Quantum Federated Learning (QFL) overcomes these issues by combining FL with quantum computing, thereby offering greater power and parallelism. In this paper, we propose an innovative QFL approach with a quantum–classical hybrid architecture to address the limitations of classical FL and achieve superior performance in video and image classification. The proposed architecture consists of a classical server and quantum–classical clients. On the client side, after preprocessing the videos and images, a pre-trained model extracts high-level features, which are then classified by a client-specific quantum circuit using a Variational Quantum Circuit (VQC). To maximize the performance of this hybrid system, we jointly optimize the VQC parameters and the weights of the pre-trained model’s final feature-extraction layers. The proposed approach has been extensively evaluated in a simulation environment with random client selection to account for the heterogeneity of real-world systems. Furthermore, we present results obtained from quantum computers using globally optimized VQC parameters. This successful validation on actual quantum hardware underscores the practical applicability of our approach, extending its significance beyond theoretical contributions to next-generation applications such as smart campus security.

Journal of King Saud University - Computer and Information Sciences•May 13, 2026•0 citations

Hybrid classical-quantum transfer learning for text classification

Ebrahim Ardeshir-Larijani, Mohammad Mahdi Nasiri Fatmehsari

Abstract Quantum Machine Learning (QML) is a promising field that combines the power of quantum computing with machine learning. Variational quantum circuits, where parameters of circuits are learned classically, have been widely used in many recent applications of QML. This is an instance of a hybrid quantum-classical framework, where both classical and quantum components are present. However, applying these techniques to applications involving massive data is a challenging task. One way to overcome this, is using the concept of classical-quantum transfer learning with the help of dressed quantum circuit, introduced recently, where the underlying neural architecture is pre-trained classically, but at the final steps (decision layer), a quantum circuit is used, followed by quantum measurements and post-processing to classify images with high precision. In this paper, we applied hybrid classical-quantum transfer learning to another task of massive data processing, i.e. Natural Language Processing (NLP). We show how to (binary) classify short texts (e.g., SMS) with classical-quantum transfer learning, which was originally applied to image processing only. Our quantum network was pre-trained by Bidirectional Encoder Representations from the Transformers (BERT) model, and its variational quantum circuit is fine-tuned for text processing. We evaluated the performance of our hybrid neural architecture using the Receiver Operating Characteristic (ROC) curve, which is typically used in the evaluation of classification problems. The results indicate high precision as well as lower loss function. To our knowledge, our work is the first application of quantum transfer learning to the area of NLP. Finally a comparison with a tool that uses learning but in a different way than transfer learning is presented

Quantum Machine Intelligence•Mar 17, 2024•25 citations
The rapid development of quantum computing has demonstrated many unique characteristics of quantum advantages, such as richer feature representation and more secured protection on model parameters. This work proposes a vertical federated learning architecture based on variational quantum circuits to demonstrate the competitive performance of a quantum-enhanced pre-trained BERT model for text classification. In particular, our proposed hybrid classical-quantum model consists of a novel random quantum temporal convolution (QTC) learning framework replacing some layers in the BERT-based decoder. Our experiments on intent classification show that our proposed BERT-QTC model attains competitive experimental results in the Snips and ATIS spoken language datasets. Particularly, the BERT-QTC boosts the performance of the existing quantum circuit-based language model in two text classification datasets by 1.57% and 1.52% relative improvements. Furthermore, BERT-QTC can be feasibly deployed on both existing commercial-accessible quantum computation hardware and CPU-based interface for ensuring data isolation.
The rapid development of quantum computing has demonstrated many unique characteristics of quantum advantages, such as richer feature representation and more secured protection on model parameters. This work proposes a vertical federated learning architecture based on variational quantum circuits to demonstrate the competitive performance of a quantum-enhanced pre-trained BERT model for text classification. In particular, our proposed hybrid classical-quantum model consists of a novel random quantum temporal convolution (QTC) learning framework replacing some layers in the BERT-based decoder. Our experiments on intent classification show that our proposed BERT-QTC model attains competitive experimental results in the Snips and ATIS spoken language datasets. Particularly, the BERT-QTC boosts the performance of the existing quantum circuit-based language model in two text classification datasets by 1.57% and 1.52% relative improvements. Furthermore, BERT-QTC can be feasibly deployed on both existing commercial-accessible quantum computation hardware and CPU-based interface for ensuring data isolation.
Fine-tuning BERT for text classification can be computationally challenging and requires careful hyper-parameter tuning. Recent studies have highlighted the potential of quantum algorithms to outperform conventional methods in machine learning and text classification tasks. In this work, we propose a hybrid approach that integrates an n-qubit quantum circuit with a classical BERT model for text classification. We evaluate the performance of the fine-tuned classical-quantum BERT and demonstrate its feasibility as well as its potential in advancing this research area. Our experimental results show that the proposed hybrid model achieves performance that is competitive with, and in some cases better than, the classical baselines on standard benchmark datasets. Furthermore, our approach demonstrates the adaptability of classical–quantum models for fine-tuning pre-trained models across diverse datasets. Overall, the hybrid model highlights the promise of quantum computing in achieving improved performance for text classification tasks.
Fine-tuning BERT for text classification can be computationally challenging and requires careful hyper-parameter tuning. Recent studies have highlighted the potential of quantum algorithms to outperform conventional methods in machine learning and text classification tasks. In this work, we propose a hybrid approach that integrates an n-qubit quantum circuit with a classical BERT model for text classification. We evaluate the performance of the fine-tuned classical-quantum BERT and demonstrate its feasibility as well as its potential in advancing this research area. Our experimental results show that the proposed hybrid model achieves performance that is competitive with, and in some cases better than, the classical baselines on standard benchmark datasets. Furthermore, our approach demonstrates the adaptability of classical-quantum models for fine-tuning pre-trained models across diverse datasets. Overall, the hybrid model highlights the promise of quantum computing in achieving improved performance for text classification tasks.
NLP models have shown remarkable performance for sentiment analysis and text classification tasks due to the deep neural networks and transformer architectures. However, these models typically necessitate considerable computational resources, high parameter complexity and large scale training datasets. Recently, quantum computing has emerged as a promising paradigm that can enhance machine learning systems using quantum parallelism, superposition, and entanglement. In this paper, we propose a new Hybrid Quantum-Classical NLP architecture that combines variational quantum circuit (VQC) layers with classical neural network layers for effective sentiment analysis. The proposed framework combines classical embedding and LSTM layers with a quantum-enhanced variational layer to improve feature representation and classification performance. The proposed framework combines classical embedding and LSTM layers with a quantum-enhanced variational layer to enhance the feature representation and classification performance. The quantum layer is realized via parameterized quantum circuits and optimized using hybrid gradient-based learning techniques. The effectiveness of The proposed framework combines classical embedding and LSTM layers with a quantum-enhanced variational layer to enhance the feature representation and classification performance. The quantum layer is realized via parameterized quantum circuits and optimized using hybrid gradient-based learning techniques. The effectiveness of the proposed model is evaluated on the benchmark sentiment analysis datasets such as IMDb and SST-2 experiments. The hybrid architecture is compared with standard deep learning models in terms of accuracy, training complexity and parameter efficiency. The experimental results show that the proposed quantum-enhanced model can achieve competitive classification accuracy while reducing model complexity and improving contextual semantic learning.
Abstract Currently, data privacy and security are critical in deep learning, especially with biometric data. Federated learning (FL) addresses these concerns, but struggles with security, complexity, and high-dimensional data. Quantum Federated Learning (QFL) overcomes these issues by combining FL with quantum computing, thereby offering greater power and parallelism. In this paper, we propose an innovative QFL approach with a quantum–classical hybrid architecture to address the limitations of classical FL and achieve superior performance in video and image classification. The proposed architecture consists of a classical server and quantum–classical clients. On the client side, after preprocessing the videos and images, a pre-trained model extracts high-level features, which are then classified by a client-specific quantum circuit using a Variational Quantum Circuit (VQC). To maximize the performance of this hybrid system, we jointly optimize the VQC parameters and the weights of the pre-trained model’s final feature-extraction layers. The proposed approach has been extensively evaluated in a simulation environment with random client selection to account for the heterogeneity of real-world systems. Furthermore, we present results obtained from quantum computers using globally optimized VQC parameters. This successful validation on actual quantum hardware underscores the practical applicability of our approach, extending its significance beyond theoretical contributions to next-generation applications such as smart campus security.
Abstract Quantum Machine Learning (QML) is a promising field that combines the power of quantum computing with machine learning. Variational quantum circuits, where parameters of circuits are learned classically, have been widely used in many recent applications of QML. This is an instance of a hybrid quantum-classical framework, where both classical and quantum components are present. However, applying these techniques to applications involving massive data is a challenging task. One way to overcome this, is using the concept of classical-quantum transfer learning with the help of dressed quantum circuit, introduced recently, where the underlying neural architecture is pre-trained classically, but at the final steps (decision layer), a quantum circuit is used, followed by quantum measurements and post-processing to classify images with high precision. In this paper, we applied hybrid classical-quantum transfer learning to another task of massive data processing, i.e. Natural Language Processing (NLP). We show how to (binary) classify short texts (e.g., SMS) with classical-quantum transfer learning, which was originally applied to image processing only. Our quantum network was pre-trained by Bidirectional Encoder Representations from the Transformers (BERT) model, and its variational quantum circuit is fine-tuned for text processing. We evaluated the performance of our hybrid neural architecture using the Receiver Operating Characteristic (ROC) curve, which is typically used in the evaluation of classification problems. The results indicate high precision as well as lower loss function. To our knowledge, our work is the first application of quantum transfer learning to the area of NLP. Finally a comparison with a tool that uses learning but in a different way than transfer learning is presented