Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2302.13812

Adapting Pre-trained Language Models for Quantum Natural Language Processing

Qiuchi Li, Benyou Wang, Yudong Zhu, Christina Lioma, Liu, Qun

Published Feb 24, 2023• 12 citations
arXivHTMLPDF

Abstract

The emerging classical-quantum transfer learning paradigm has brought a decent performance to quantum computational models in many tasks, such as computer vision, by enabling a combination of quantum models and classical pre-trained neural networks. However, using quantum computing with pre-trained models has yet to be explored in natural language processing (NLP). Due to the high linearity constraints of the underlying quantum computing infrastructures, existing Quantum NLP models are limited in performance on real tasks. We fill this gap by pre-training a sentence state with complex-valued BERT-like architecture, and adapting it to the classical-quantum transfer learning scheme for sentence classification. On quantum simulation experiments, the pre-trained representation can bring 50\% to 60\% increases to the capacity of end-to-end quantum models.

DOI
10.48550/arxiv.2302.13812

Related papers

Self-supervised pre-trained neural network for quantum natural language processing

Ben Yao, Prayag Tiwari, Qiuchi Li

Quantum computing models have propelled advances in many application domains. However, in the field of natural language processing (NLP), quantum computing models are limited in representation capacity due to the high linearity of the underlying quantum computing architecture. This work attempts to address this limitation by leveraging the concept of self-supervised pre-training, a paradigm that has been propelling the rocketing development of NLP, to increase the power of quantum NLP models on the representation level. Specifically, we present a self-supervised pre-training approach to train quantum encodings of sentences, and fine-tune quantum circuits for downstream tasks on its basis. Experiments show that pre-trained mechanism brings remarkable improvement over end-to-end pure quantum models, yielding meaningful prediction results on a variety of downstream text classification datasets.

Neural Networks•Dec 6, 2024•23 citations

Hybrid classical-quantum transfer learning for text classification

Ebrahim Ardeshir-Larijani, Mohammad Mahdi Nasiri Fatmehsari

Abstract Quantum Machine Learning (QML) is a promising field that combines the power of quantum computing with machine learning. Variational quantum circuits, where parameters of circuits are learned classically, have been widely used in many recent applications of QML. This is an instance of a hybrid quantum-classical framework, where both classical and quantum components are present. However, applying these techniques to applications involving massive data is a challenging task. One way to overcome this, is using the concept of classical-quantum transfer learning with the help of dressed quantum circuit, introduced recently, where the underlying neural architecture is pre-trained classically, but at the final steps (decision layer), a quantum circuit is used, followed by quantum measurements and post-processing to classify images with high precision. In this paper, we applied hybrid classical-quantum transfer learning to another task of massive data processing, i.e. Natural Language Processing (NLP). We show how to (binary) classify short texts (e.g., SMS) with classical-quantum transfer learning, which was originally applied to image processing only. Our quantum network was pre-trained by Bidirectional Encoder Representations from the Transformers (BERT) model, and its variational quantum circuit is fine-tuned for text processing. We evaluated the performance of our hybrid neural architecture using the Receiver Operating Characteristic (ROC) curve, which is typically used in the evaluation of classification problems. The results indicate high precision as well as lower loss function. To our knowledge, our work is the first application of quantum transfer learning to the area of NLP. Finally a comparison with a tool that uses learning but in a different way than transfer learning is presented

Quantum Machine Intelligence•Mar 17, 2024•25 citations

Quantum Natural Language Processing: A Comprehensive Review of Models, Methods, and Applications

Farha Nausheen, Khandakar Entenam Unayes Ahmed, Mumit Khan +1 more

In recent developments, deep learning methodologies applied to Natural Language Processing (NLP) have revealed a paradox: They improve performance but demand considerable data and resources for their training. Alternatively, quantum computing exploits the principles of quantum mechanics to overcome the computational limitations of current methodologies, thereby establishing an emerging field known as quantum natural language processing (QNLP). This domain holds the potential to attain a quantum advantage in the processing of linguistic structures, surpassing classical models in both efficiency and accuracy. In this paper, it is proposed to categorise QNLP models based on quantum computing principles, architecture, and computational approaches. This paper attempts to provide a survey on how quantum meets language by mapping state-of-the-art in this area, embracing quantum encoding techniques for classical data, QNLP models for prevalent NLP tasks, and quantum optimisation techniques for hyper parameter tuning. The landscape of quantum computing approaches applied to various NLP tasks is summarised by showcasing the specific QNLP methods used, and the popularity of these methods is indicated by their count. From the findings, it is observed that QNLP approaches are still limited to small data sets, with only a few models explored extensively, and there is increasing interest in the application of quantum computing to natural language processing tasks.

arXiv:2504.09909•Apr 14, 2025•15 citations

Integrating Quantum Computing with Deep Learning for Enhanced Natural Language Processing

Anand Singh Rajawat, Hussein Mohammed Breesam, Shruti Goyal

Quantum computing with its capacity to compute multiple possibilities at once, and perform some kinds of calculations almost instantly is one leading edge. The integration of QCs and DL undoubtedly represent one such transformative means for improving Natural Language Processing (NLP). By combining the two, this uses quantum principles of superposition and entanglement to make computation faster regarding human language comprehension limitations in classical computing. Deep learning models, specifically neural networks have already made significant improvements over NLP tasks like language translations, sentiment analysis and text generation. Nevertheless, these models also face scalability and computational efficiency issues with huge volumes of data. Quantum computing offers a solution to all this by reducing the time exponentially that it takes to fetch large amounts of language data and running deep learning algorithms. This paper investigates the opportunities that integrating quantum computing and deep learning into NLP practices might unlock. We drafted the fundamentals of quantum computing and why it is a need over classical computing, where we discussed on how quantum beneficial for data processing & optimization of an algorithm. We then explore applications of quantum enhanced deep learning for NLP, with a focus on the impact that training and inference can have on model performance. We demonstrate the utility of this integration by integrating our four SQDs to showcase improvements on diverse NLP tasks through a series of experiments and case studies. We also demonstrate that hybrid quantum-classical approaches allow the combination of traditional ML and quantum-enhanced models, achieving state-of-the-art performance with respect to effectiveness, scalability and precision

International Conference on Augmented Reality, Intelligent Systems, and Industrial Automation (ARIIA)•Dec 20, 2024•0 citations

Natural Language Processing With Hybrid Quantum Neural Networks: Models, Methods, and Future Directions

Manju Lata Joshi

The recent developments in the field of deep learning have made Natural Language Processing (NLP) quite useful, but there are still issues of the complexity of computation, energy consumption, and modeling of complex semantics. Representations and optimization techniques that are quantum enhanced are available in quantum computing and provide new possibilities. Hybrid Quantum Neural Networks (HQNNs) combine quantum computational concepts and classical neural networks, allowing the introduction of a new era in intelligent language processing. The chapter provides the basics of quantum computing and neural NLP models and looks at the hybrid methods of semantic representation and learning. The text classification, sentiment analysis, named entity recognition, and machine translation tasks that are fundamental to NLP are examined through a hybrid quantum-neural approach. Such methods as quantum data encoding, quantum feature extraction and hybrid training approaches are described and the issues associated with scalability, noise, and hardware limitations are discussed.

Advances in computational intelligence and robotics book series•Apr 1, 2026•1 citation

Characterizing Quantum Classifier Utility in Natural Language Processing Workflows

Kathleen E. Hamilton, Mayanka Chandrashekar, John P. Gounley +5 more

Quantum Natural Language Processing (QNLP) develops natural language processing (NLP) models for deployment on quantum computers. We explore feature and data prototype selection techniques to address challenges posed by encoding high dimensional features. Our study builds quantum circuit classifiers that includes classical feature pre-processing, quantum embedding and quantum model training. The quantum models are built on 4 or 6 qubits and the quantum neural network (QNN) uses the established bricklayer design. We compare the dependence of model performance (in terms of accuracy and F1 scores) on feature length, embedding gates and parameterized unitary design. We compare the performance of quantum machine learning models to classical convolution neural network model (CNN) on binary and multi-class classification tasks using two datasets of synthetic features and labels. The first is the ECP-CANDLE P3B3 dataset a corpus of synthetically generated cancer pathology reports. The second dataset is extracted from well-known benchmark dataset (MADELON) - features are generated with a combination of informative, repeated and uninformative features. Both datasets are used for binary classification and multi-class classification with 3 classes. We observe robust, accurate performance from all models on the binary classification tasks, but multiclass classification is a challenge for the quantum models-there is a notable decrease in accuracy when using 3 classes. Overall the performance is comparable in terms of recall and accuracy between QNNs and CNNs, even with large datasets. These results provide a point of comparison between quantum and classical models on real-world datasets.

IEEE International Conference on Quantum Computing and Engineering (QCE)•Sep 17, 2023•1 citation
The emerging classical-quantum transfer learning paradigm has brought a decent performance to quantum computational models in many tasks, such as computer vision, by enabling a combination of quantum models and classical pre-trained neural networks. However, using quantum computing with pre-trained models has yet to be explored in natural language processing (NLP). Due to the high linearity constraints of the underlying quantum computing infrastructures, existing Quantum NLP models are limited in performance on real tasks. We fill this gap by pre-training a sentence state with complex-valued BERT-like architecture, and adapting it to the classical-quantum transfer learning scheme for sentence classification. On quantum simulation experiments, the pre-trained representation can bring 50% to 60% increases to the capacity of end-to-end quantum models.
Quantum computing models have propelled advances in many application domains. However, in the field of natural language processing (NLP), quantum computing models are limited in representation capacity due to the high linearity of the underlying quantum computing architecture. This work attempts to address this limitation by leveraging the concept of self-supervised pre-training, a paradigm that has been propelling the rocketing development of NLP, to increase the power of quantum NLP models on the representation level. Specifically, we present a self-supervised pre-training approach to train quantum encodings of sentences, and fine-tune quantum circuits for downstream tasks on its basis. Experiments show that pre-trained mechanism brings remarkable improvement over end-to-end pure quantum models, yielding meaningful prediction results on a variety of downstream text classification datasets.
Abstract Quantum Machine Learning (QML) is a promising field that combines the power of quantum computing with machine learning. Variational quantum circuits, where parameters of circuits are learned classically, have been widely used in many recent applications of QML. This is an instance of a hybrid quantum-classical framework, where both classical and quantum components are present. However, applying these techniques to applications involving massive data is a challenging task. One way to overcome this, is using the concept of classical-quantum transfer learning with the help of dressed quantum circuit, introduced recently, where the underlying neural architecture is pre-trained classically, but at the final steps (decision layer), a quantum circuit is used, followed by quantum measurements and post-processing to classify images with high precision. In this paper, we applied hybrid classical-quantum transfer learning to another task of massive data processing, i.e. Natural Language Processing (NLP). We show how to (binary) classify short texts (e.g., SMS) with classical-quantum transfer learning, which was originally applied to image processing only. Our quantum network was pre-trained by Bidirectional Encoder Representations from the Transformers (BERT) model, and its variational quantum circuit is fine-tuned for text processing. We evaluated the performance of our hybrid neural architecture using the Receiver Operating Characteristic (ROC) curve, which is typically used in the evaluation of classification problems. The results indicate high precision as well as lower loss function. To our knowledge, our work is the first application of quantum transfer learning to the area of NLP. Finally a comparison with a tool that uses learning but in a different way than transfer learning is presented
In recent developments, deep learning methodologies applied to Natural Language Processing (NLP) have revealed a paradox: They improve performance but demand considerable data and resources for their training. Alternatively, quantum computing exploits the principles of quantum mechanics to overcome the computational limitations of current methodologies, thereby establishing an emerging field known as quantum natural language processing (QNLP). This domain holds the potential to attain a quantum advantage in the processing of linguistic structures, surpassing classical models in both efficiency and accuracy. In this paper, it is proposed to categorise QNLP models based on quantum computing principles, architecture, and computational approaches. This paper attempts to provide a survey on how quantum meets language by mapping state-of-the-art in this area, embracing quantum encoding techniques for classical data, QNLP models for prevalent NLP tasks, and quantum optimisation techniques for hyper parameter tuning. The landscape of quantum computing approaches applied to various NLP tasks is summarised by showcasing the specific QNLP methods used, and the popularity of these methods is indicated by their count. From the findings, it is observed that QNLP approaches are still limited to small data sets, with only a few models explored extensively, and there is increasing interest in the application of quantum computing to natural language processing tasks.
Quantum computing with its capacity to compute multiple possibilities at once, and perform some kinds of calculations almost instantly is one leading edge. The integration of QCs and DL undoubtedly represent one such transformative means for improving Natural Language Processing (NLP). By combining the two, this uses quantum principles of superposition and entanglement to make computation faster regarding human language comprehension limitations in classical computing. Deep learning models, specifically neural networks have already made significant improvements over NLP tasks like language translations, sentiment analysis and text generation. Nevertheless, these models also face scalability and computational efficiency issues with huge volumes of data. Quantum computing offers a solution to all this by reducing the time exponentially that it takes to fetch large amounts of language data and running deep learning algorithms. This paper investigates the opportunities that integrating quantum computing and deep learning into NLP practices might unlock. We drafted the fundamentals of quantum computing and why it is a need over classical computing, where we discussed on how quantum beneficial for data processing & optimization of an algorithm. We then explore applications of quantum enhanced deep learning for NLP, with a focus on the impact that training and inference can have on model performance. We demonstrate the utility of this integration by integrating our four SQDs to showcase improvements on diverse NLP tasks through a series of experiments and case studies. We also demonstrate that hybrid quantum-classical approaches allow the combination of traditional ML and quantum-enhanced models, achieving state-of-the-art performance with respect to effectiveness, scalability and precision
The recent developments in the field of deep learning have made Natural Language Processing (NLP) quite useful, but there are still issues of the complexity of computation, energy consumption, and modeling of complex semantics. Representations and optimization techniques that are quantum enhanced are available in quantum computing and provide new possibilities. Hybrid Quantum Neural Networks (HQNNs) combine quantum computational concepts and classical neural networks, allowing the introduction of a new era in intelligent language processing. The chapter provides the basics of quantum computing and neural NLP models and looks at the hybrid methods of semantic representation and learning. The text classification, sentiment analysis, named entity recognition, and machine translation tasks that are fundamental to NLP are examined through a hybrid quantum-neural approach. Such methods as quantum data encoding, quantum feature extraction and hybrid training approaches are described and the issues associated with scalability, noise, and hardware limitations are discussed.
Quantum Natural Language Processing (QNLP) develops natural language processing (NLP) models for deployment on quantum computers. We explore feature and data prototype selection techniques to address challenges posed by encoding high dimensional features. Our study builds quantum circuit classifiers that includes classical feature pre-processing, quantum embedding and quantum model training. The quantum models are built on 4 or 6 qubits and the quantum neural network (QNN) uses the established bricklayer design. We compare the dependence of model performance (in terms of accuracy and F1 scores) on feature length, embedding gates and parameterized unitary design. We compare the performance of quantum machine learning models to classical convolution neural network model (CNN) on binary and multi-class classification tasks using two datasets of synthetic features and labels. The first is the ECP-CANDLE P3B3 dataset a corpus of synthetically generated cancer pathology reports. The second dataset is extracted from well-known benchmark dataset (MADELON) - features are generated with a combination of informative, repeated and uninformative features. Both datasets are used for binary classification and multi-class classification with 3 classes. We observe robust, accurate performance from all models on the binary classification tasks, but multiclass classification is a challenge for the quantum models-there is a notable decrease in accuracy when using 3 classes. Overall the performance is comparable in terms of recall and accuracy between QNNs and CNNs, even with large datasets. These results provide a point of comparison between quantum and classical models on real-world datasets.