Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)

Hybrid Quantum Machine Learning based Human Speech Emotion Recognition

Sparsh Mittal, Yash Chand, Mintu Kumar, Neel Kanth Kundu

Published Apr 6, 2025• 4 citations
Publisher

Abstract

This paper proposes hybrid quantum machine learning (QML) models for automatic emotion recognition from human speech signals. The proposed quantum support vector machine (QSVM) and hybrid quantum neural network (HQNN) models use Mel-Frequency Cepstral Coefficients (MFCC) as the features extracted from the speech data. We present a detailed analysis comparing the performance of QML models to conventional machine learning models for human speech-based emotion recognition, which is a multi-class classification problem. Our results illustrate that QSVM can achieve higher classification accuracy with a much reduced number of speech signal variables compared to traditional SVMs. Furthermore, the proposed HQNN classifier outperforms classical neural networks (NN) in terms of classification accuracy while utilizing a reduced number of training parameters. We have tested the performance of the HQNN model on a real IBM quantum computer. The results indicate that QML models provide a more effective and precise method for classification tasks involving the recognition of human emotions.

DOI
10.1109/icasspw65056.2025.11011221

Related papers

Quantum Machine Learning Architecture for EEG-Based Emotion Recognition

C. U. Om Kumar, B. Balakannan, Suguna Marappan +3 more

Emotion Recognition (ER) is an important capability that is increasingly being used to enhance the user experience in various fields such as, Human-Computer interaction, Cognitive Neuroscience, Neurofeedback, Robotics, Artificial Intelligence, Augmented Reality, Virtual Reality, Mental Health, etc. Emotions are generated in the limbic system, a set of brain structures that are involved in emotional processing, memory, and motivation. ER from electroencephalography (EEG) signals has gained attention from researchers in recent years as it provides a more accurate and non-intrusive way of understanding human emotions. This research paper presents a comprehensive study of the use of Quantum Support Vector Machines (QSVMs) and Quantum Neural Networks (QNNs) for ER using EEG signals. The aim of this study is to investigate the potential of quantum machine learning algorithms in improving the performance of ER tasks compared to classical Machine Learning (ML) algorithms. The model was simulated using IBM Qiskit due to the limited resources of quantum computers. Intriguingly, the experimental results contradict the speed-up claims of Quantum Computing (QC) by exhibiting longer computation times and lesser accuracy when compared to traditional methods. SVM and NN yield 68.5% and 69.2% accuracy while the quantum version gives 63% and 65.2% accuracy on the benchmark dataset SEED. This research provides evidence that Quantum Machine Learning (QML) algorithms need to be improved for ER from EEG signals and provide a reliable and non-intrusive way of understanding human emotions.

Advances in information security, privacy, and ethics book series•Nov 27, 2024•0 citations

Representation learning with parameterised quantum circuits for advancing speech emotion recognition

Thejan Rajapakshe, Rajib Kumar Rana, Farina Riaz +2 more

Quantum machine learning (QML) offers a promising avenue for advancing representation learning in complex signal domains. In this study, we investigate the use of parameterised quantum circuits (PQCs) for speech emotion recognition (SER)-a challenging task due to the subtle temporal variations and overlapping affective states in vocal signals. We propose a hybrid quantum-classical architecture that integrates PQCs into a conventional convolutional neural network (CNN), leveraging quantum properties such as superposition and entanglement to enrich emotional feature representations. Experimental evaluations on three benchmark datasets IEMOCAP, RECOLA, and MSP-IMPROV-demonstrate that our hybrid model achieves improved classification performance relative to a purely classical CNN baseline, with over 50% reduction in trainable parameters. Furthermore, Adjusted Rand Index (ARI) analysis demonstrates that the quantum model yields feature representations with improved alignment to true emotion classes compared with the classical model, reinforcing the observed performance gains. This work provides early evidence of the potential for QML to enhance emotion recognition and lays the foundation for future quantum-enabled affective computing systems.

arXiv:2501.12050•Scientific Reports•Nov 22, 2025•7 citations

Quantum Kernel-aided Support Vector Machine Classifier for Improved Speech Classification

Hasmitha Krishna N, S. Sridevi, R Prasanna Kumar

The field of machine learning has been revolutionized by quantum computing, as it has the capacity to tackle complex problems that are beyond the capabilities of classical computers. One such problem is the efficient classification of speech signals with limited data, employing extracted feature attributes like Mel-scale frequency cepstral coefficients (MFCCs). This study compares the performance of classical machine learning models with a Quantum Support Vector Machine (QKSVM) classifier on a data set with a limited number of audio samples. Interestingly, the quantum kernel method outperformed classical models despite the small sample size. This result can be attributed to the quantum kernel method’s ability to extract high-dimensional features efficiently, allowing it to learn more from fewer samples. The Quantum Kernel Circuit (QKC) is contrived in different variants comprising 13, 8, 7, and 4 qubits. This QKC is built with an Angle Embedding layer, an adjoint version of the Angle Embedding layer, and a Hermitian space observable layer. Our findings demonstrate that the hybrid quantum kernel-based technique outperforms existing classical solutions. Amongst variants, the Quantum support vector machine model with 13 optimal numbers of coefficients is efficient in speech classification with the highest accuracy of 87.32%.

International Conference on Computing, Communication and Networking Technologies (ICCCNT)•Jul 6, 2023•14 citations

A Comparison of Traditional Natural Language Processing Methods for Emotion Recognition Using Quantum Computing

Srirajarajeswari Thota, Sandeep Kumar Dash

Emotion Recognition plays an important role in recognizing human behavior. Human behavior may be represented in text, speech, and facial expressions. In traditional form, natural language processing known as NLP is used to extract features to evaluate emotions. With the evolution of Quantum Computing, Quantum Machine learning often called QML is one of the research areas used to evaluate emotions. This paper is designed to compare traditional ML models with QML models to analyze the sentiments and emotions of multimodal data. Here, NLP techniques are used for preprocessing. A hybrid model is built by combining NLP and QML. The preprocessed data are transmitted into quantum circuits for computation, and its results are compared with conventional machine learning models. This evaluation identifies QML as a promising future as it is useful for large and complex data sets with high dimensions. This study highlights the potential of QML in NLP and outlines the challenges such as encoding and hardware limitations.

International Conference on Machine Learning and Autonomous Systems (ICMLAS)•Mar 10, 2025•3 citations

Classical to Quantum Neural Network Transfer Learning Approach for Speech Emotion Recognition

Sheikh Iftekhar Ahmed, Shaswata Mahernob Sarkar, Shaikh Anowarul Fattah +1 more

Speech emotion recognition (SER) has gained utmost attention among researchers for its vital role in Human-Computer Interaction, enabling systems to understand and respond to the emotional states of the users. In this work, the concept of transfer learning has been extended to the novel domain of hybrid classical-quantum neural networks for enhancing SER performance. The classical part involves preprocessing raw speech signals to generate three-channel log mel-spectrograms and the pretrained VGG 19 network for extracting useful emotional features. The quantum part is built upon a dressed quantum neural network (QNN), comprising multiple parallel QNN blocks, for accurate emotion classification. Extensive experiments on the publicly accessible TESS dataset reveal that the proposed hybrid transfer learning approach achieves state of the art accuracy of 98.93 %. An ablation study demonstrates the significant performance improvement attributed to the incorporation of QNN blocks. The integration of classical and quantum neural networks provides a robust and efficient solution, leveraging the strengths of both computational paradigms to enhance SER based applications.

IEEE Region 10 Conference (TENCON)•Dec 1, 2024•2 citations

HQTN-SER: Speech Emotion Recognition with Hybrid Quantum Tensor Networks

Mahad Mohtashim, Nouhaila Innan, Muhammad Shafique

Speech emotion recognition (SER) remains fragile in real-world conditions because emotional cues are subtle, speaker-dependent, and easily confounded by recording variability, while high-performing deep models typically rely on large and carefully curated training sets. Quantum machine learning offers an alternative way to introduce nonlinear correlation modeling with compact modules, yet existing quantum SER studies remain limited, and the impact of circuit structure is not well understood. This paper presents HQTN-SER, a hybrid quantum-classical framework that investigates how quantum tensor network connectivity can support SER under small-qubit settings. HQTN-SER introduces (i) an MPS-inspired quantum tensor network module that enforces structured interactions to model correlations in speech representations with a small number of trainable parameters, and (ii) a fusion strategy that combines quantum measurement features with a learned classical latent embedding for end-to-end emotion classification. We evaluate HQTN-SER on three public benchmarks (RAVDESS, SAVEE, and MDER) under a unified preprocessing and training protocol. The proposed model achieves test accuracies of 80.09\% on RAVDESS, 78.12\% on SAVEE, and 73.51\% on MDER, with corresponding macro-F1 scores of 0.8012, 0.7826, and 0.7351, respectively. The model also exhibits stable convergence while using only three or four qubits, suggesting that MPS-inspired circuit structure can be an effective and hardware-aware design choice for quantum-assisted SER. These results provide a compact experimental baseline for studying structured quantum modules in affective computing.

quant-pharXiv:2605.14523•May 15, 2026•0 citations
This paper proposes hybrid quantum machine learning (QML) models for automatic emotion recognition from human speech signals. The proposed quantum support vector machine (QSVM) and hybrid quantum neural network (HQNN) models use Mel-Frequency Cepstral Coefficients (MFCC) as the features extracted from the speech data. We present a detailed analysis comparing the performance of QML models to conventional machine learning models for human speech-based emotion recognition, which is a multi-class classification problem. Our results illustrate that QSVM can achieve higher classification accuracy with a much reduced number of speech signal variables compared to traditional SVMs. Furthermore, the proposed HQNN classifier outperforms classical neural networks (NN) in terms of classification accuracy while utilizing a reduced number of training parameters. We have tested the performance of the HQNN model on a real IBM quantum computer. The results indicate that QML models provide a more effective and precise method for classification tasks involving the recognition of human emotions.
Emotion Recognition (ER) is an important capability that is increasingly being used to enhance the user experience in various fields such as, Human-Computer interaction, Cognitive Neuroscience, Neurofeedback, Robotics, Artificial Intelligence, Augmented Reality, Virtual Reality, Mental Health, etc. Emotions are generated in the limbic system, a set of brain structures that are involved in emotional processing, memory, and motivation. ER from electroencephalography (EEG) signals has gained attention from researchers in recent years as it provides a more accurate and non-intrusive way of understanding human emotions. This research paper presents a comprehensive study of the use of Quantum Support Vector Machines (QSVMs) and Quantum Neural Networks (QNNs) for ER using EEG signals. The aim of this study is to investigate the potential of quantum machine learning algorithms in improving the performance of ER tasks compared to classical Machine Learning (ML) algorithms. The model was simulated using IBM Qiskit due to the limited resources of quantum computers. Intriguingly, the experimental results contradict the speed-up claims of Quantum Computing (QC) by exhibiting longer computation times and lesser accuracy when compared to traditional methods. SVM and NN yield 68.5% and 69.2% accuracy while the quantum version gives 63% and 65.2% accuracy on the benchmark dataset SEED. This research provides evidence that Quantum Machine Learning (QML) algorithms need to be improved for ER from EEG signals and provide a reliable and non-intrusive way of understanding human emotions.
Quantum machine learning (QML) offers a promising avenue for advancing representation learning in complex signal domains. In this study, we investigate the use of parameterised quantum circuits (PQCs) for speech emotion recognition (SER)-a challenging task due to the subtle temporal variations and overlapping affective states in vocal signals. We propose a hybrid quantum-classical architecture that integrates PQCs into a conventional convolutional neural network (CNN), leveraging quantum properties such as superposition and entanglement to enrich emotional feature representations. Experimental evaluations on three benchmark datasets IEMOCAP, RECOLA, and MSP-IMPROV-demonstrate that our hybrid model achieves improved classification performance relative to a purely classical CNN baseline, with over 50% reduction in trainable parameters. Furthermore, Adjusted Rand Index (ARI) analysis demonstrates that the quantum model yields feature representations with improved alignment to true emotion classes compared with the classical model, reinforcing the observed performance gains. This work provides early evidence of the potential for QML to enhance emotion recognition and lays the foundation for future quantum-enabled affective computing systems.
The field of machine learning has been revolutionized by quantum computing, as it has the capacity to tackle complex problems that are beyond the capabilities of classical computers. One such problem is the efficient classification of speech signals with limited data, employing extracted feature attributes like Mel-scale frequency cepstral coefficients (MFCCs). This study compares the performance of classical machine learning models with a Quantum Support Vector Machine (QKSVM) classifier on a data set with a limited number of audio samples. Interestingly, the quantum kernel method outperformed classical models despite the small sample size. This result can be attributed to the quantum kernel method’s ability to extract high-dimensional features efficiently, allowing it to learn more from fewer samples. The Quantum Kernel Circuit (QKC) is contrived in different variants comprising 13, 8, 7, and 4 qubits. This QKC is built with an Angle Embedding layer, an adjoint version of the Angle Embedding layer, and a Hermitian space observable layer. Our findings demonstrate that the hybrid quantum kernel-based technique outperforms existing classical solutions. Amongst variants, the Quantum support vector machine model with 13 optimal numbers of coefficients is efficient in speech classification with the highest accuracy of 87.32%.
Emotion Recognition plays an important role in recognizing human behavior. Human behavior may be represented in text, speech, and facial expressions. In traditional form, natural language processing known as NLP is used to extract features to evaluate emotions. With the evolution of Quantum Computing, Quantum Machine learning often called QML is one of the research areas used to evaluate emotions. This paper is designed to compare traditional ML models with QML models to analyze the sentiments and emotions of multimodal data. Here, NLP techniques are used for preprocessing. A hybrid model is built by combining NLP and QML. The preprocessed data are transmitted into quantum circuits for computation, and its results are compared with conventional machine learning models. This evaluation identifies QML as a promising future as it is useful for large and complex data sets with high dimensions. This study highlights the potential of QML in NLP and outlines the challenges such as encoding and hardware limitations.
Speech emotion recognition (SER) has gained utmost attention among researchers for its vital role in Human-Computer Interaction, enabling systems to understand and respond to the emotional states of the users. In this work, the concept of transfer learning has been extended to the novel domain of hybrid classical-quantum neural networks for enhancing SER performance. The classical part involves preprocessing raw speech signals to generate three-channel log mel-spectrograms and the pretrained VGG 19 network for extracting useful emotional features. The quantum part is built upon a dressed quantum neural network (QNN), comprising multiple parallel QNN blocks, for accurate emotion classification. Extensive experiments on the publicly accessible TESS dataset reveal that the proposed hybrid transfer learning approach achieves state of the art accuracy of 98.93 %. An ablation study demonstrates the significant performance improvement attributed to the incorporation of QNN blocks. The integration of classical and quantum neural networks provides a robust and efficient solution, leveraging the strengths of both computational paradigms to enhance SER based applications.
Speech emotion recognition (SER) remains fragile in real-world conditions because emotional cues are subtle, speaker-dependent, and easily confounded by recording variability, while high-performing deep models typically rely on large and carefully curated training sets. Quantum machine learning offers an alternative way to introduce nonlinear correlation modeling with compact modules, yet existing quantum SER studies remain limited, and the impact of circuit structure is not well understood. This paper presents HQTN-SER, a hybrid quantum-classical framework that investigates how quantum tensor network connectivity can support SER under small-qubit settings. HQTN-SER introduces (i) an MPS-inspired quantum tensor network module that enforces structured interactions to model correlations in speech representations with a small number of trainable parameters, and (ii) a fusion strategy that combines quantum measurement features with a learned classical latent embedding for end-to-end emotion classification. We evaluate HQTN-SER on three public benchmarks (RAVDESS, SAVEE, and MDER) under a unified preprocessing and training protocol. The proposed model achieves test accuracies of 80.09\% on RAVDESS, 78.12\% on SAVEE, and 73.51\% on MDER, with corresponding macro-F1 scores of 0.8012, 0.7826, and 0.7351, respectively. The model also exhibits stable convergence while using only three or four qubits, suggesting that MPS-inspired circuit structure can be an effective and hardware-aware design choice for quantum-assisted SER. These results provide a compact experimental baseline for studying structured quantum modules in affective computing.