Q-OmniNet: Quantum-Inspired Hybrid TensorNetworks with Quantum Kernel Estimation for Polysemy-Aware Multimodal Affective Analysis of Code-Mixed Hindi–English Text
Abstract The rapid growth of Hinglish communication onsocial media has introduced complex linguistic, cultural, andmultimodal patterns that conventional affective computing sys-tems struggle to handle. While deep learning and transformer-based models perform well on monolingual and grammaticallyconsistent text, they are limited in code-mixed Hinglish settings.These models rely on deterministic, single-meaning embeddingsthat inadequately represent polysemy, fail to capture context-dependent polarity shifts across Hindi–English transitions, andtreat multimodal signals—such as text, emojis, and visuals—asweakly coupled rather than jointly dependent. Consequently,emotional nuance, irony, and ambiguity common in real-worldHinglish interactions are often misinterpreted.To overcome these limitations, this work proposes Q-OmniNet,a quantum-inspired hybrid tensor network that models affectivemeaning as contextual superposition and captures non-separable(entangled) relationships across modalities. The framework inte-grates (i) a tensor-network-based contextual encoder to simulatemultimodal entanglement, (ii) complex-valued embeddings to en-code semantic magnitude and contextual phase, and (iii) quantumkernel estimation to model higher-order affective similarity viaquantum-state overlap. Together, these components provide aricher representation of Hinglish emotion dynamics than classicalor transformer-based approaches.Experimental results on real-world multimodal Hinglishdatasets show substantial improvements. Q-OmniNet achievesaccuracies of 0.89 for emotion classification, 0.93 for sentimentanalysis, and 0.97 for sarcasm detection, outperforming tradi-tional baselines by 15–25% and transformer models by 8–14%.The quantum-hybrid variant demonstrates superior robustnessunder noisy and ambiguous conditions, achieving an averageaccuracy of 0.9275 compared to 0.7617 for conventional models.These findings highlight the effectiveness of quantum-inspiredarchitectures for context-sensitive, multilingual, and multimodalaffective understanding.
Abstract The rapid growth of Hinglish communication onsocial media has introduced complex linguistic, cultural, andmultimodal patterns that conventional affective computing sys-tems struggle to handle. While deep learning and transformer-based models perform well on monolingual and grammaticallyconsistent text, they are limited in code-mixed Hinglish settings.These models rely on deterministic, single-meaning embeddingsthat inadequately represent polysemy, fail to capture context-dependent polarity shifts across Hindi–English transitions, andtreat multimodal signals—such as text, emojis, and visuals—asweakly coupled rather than jointly dependent. Consequently,emotional nuance, irony, and ambiguity common in real-worldHinglish interactions are often misinterpreted.To overcome these limitations, this work proposes Q-OmniNet,a quantum-inspired hybrid tensor network that models affectivemeaning as contextual superposition and captures non-separable(entangled) relationships across modalities. The framework inte-grates (i) a tensor-network-based contextual encoder to simulatemultimodal entanglement, (ii) complex-valued embeddings to en-code semantic magnitude and contextual phase, and (iii) quantumkernel estimation to model higher-order affective similarity viaquantum-state overlap. Together, these components provide aricher representation of Hinglish emotion dynamics than classicalor transformer-based approaches.Experimental results on real-world multimodal Hinglishdatasets show substantial improvements. Q-OmniNet achievesaccuracies of 0.89 for emotion classification, 0.93 for sentimentanalysis, and 0.97 for sarcasm detection, outperforming tradi-tional baselines by 15–25% and transformer models by 8–14%.The quantum-hybrid variant demonstrates superior robustnessunder noisy and ambiguous conditions, achieving an averageaccuracy of 0.9275 compared to 0.7617 for conventional models.These findings highlight the effectiveness of quantum-inspiredarchitectures for context-sensitive, multilingual, and multimodalaffective understanding.
Emotions and semantics across languages are important in digital communication to be used in social media analysis applications, customer feedback systems, and humancomputer interfaces. Conventional machine learning methods tend to have issues with the specifics of multilingual data, resulting in less than optimal results in emotion recognition and semantic understanding. To cope with these issues, the paper presents a hybrid ML-NLP model based on quantum embeddings. The framework takes advantage of transformerbased models to extract the initial features and uses quantum machine learning to achieve high classification accuracy. The dataset utilized in the present study is a mix of PEMO dataset of Punjabi text emotions based on the work of [1] pemo and GoEmotions dataset of English with an annotation of more than 58,000 samples in 27 emotion categories. We supplemented this with multilingual samples of SemEval-2018 Task 1, which left us with an evenly distributed corpus of 100,000 entries with support to the English, Punjabi and Hindi languages. This heterogeneous dataset is robust in the way of dealing with code-switched and diversified language forms. Driven by shortcomings of the current model, including lack of dealing with ambiguity in semantics of low-resource languages, inability of classical embeddings to learn quantumlike superposition in emotional states, our model is an integration between BERT embeddings and quantum variational circuits. The approach is pre-training on semantic tasks, fine-tuning on quantum classifiers, and cross-lingual benchmark. According to the experimental results, an overall accuracy of92%, precision and recall of over90%across emotions have been proven. Quantum embeddings showed a 15 percent increase in semantic understanding compared to the classical approaches especially in the multilingual set-ups. This model exceeds such baselines as SVM and standard BERT by a wide margin, making it a promising solution in the realm of such applications in emotion-aware systems.
Sarcasm detection in unimodal or multimodal setting is a very complex task. Sarcasm, emotion, and sentiment are related to each other, and hence any multitask model could be an effective way to leverage the interdependence among these tasks. In order to better represent these clandestine associations, we avoid solely relying on traditional machine learning methods to encode the relationships between the modalities. In this article, we propose a hybrid quantum model that banks upon the low computational complexity and robust representational power of a variational quantum circuit (VQC) and the tried and tested dense neural network to tackle sentiment, emotion, and sarcasm classification simultaneously. We empirically establish that the quantum properties like superposition, entanglement, and interference will better capture and replicate not only the cross-modal interactions between text, acoustics, and visuals but also the correlations between the three responses. We consider the extended MUStARD dataset to evaluate our proposed hybrid model. The results show that our proposed hybrid quantum framework yields more promising results for the primary task of sarcasm detection with the help of the two secondary classification tasks,viz.sentiment and emotion.
The understanding of emotion is essential to intelligent systems today including virtual assistants, recommender systems, and human computer interaction platforms. Nonetheless, the classical Natural Language Processing (NLP) models frequently fail to effectively capture contextual meaning, emotional vagueness and multilingual variation, particularly in the presence of multiple data paradigms. Classical methods tend to assume emotions as a priori labels and neglect the dynamic and probabilistic aspect of human emotions. In order to overcome these shortcomings, this paper suggests a Quantum-Inspired NLP architecture to context-sensitive multilingual and multimodal emotion interpretation and personalized recommendations. A real multimodal fusion strategy is used to analyze text, acoustic and visual features together to promote the recognition of emotions. Depending on the perceived emotional context, adaptive responses are created in a personalized recommendation module. The proposed framework outperforms the conventional NLP models on benchmark datasets because of experimental evaluation. The findings suggest that quantum-inspired representations have a bright future in creating high-performance and context-sensitive emotion-sensitive intelligent systems.
Speech emotion recognition (SER) remains fragile in real-world conditions because emotional cues are subtle, speaker-dependent, and easily confounded by recording variability, while high-performing deep models typically rely on large and carefully curated training sets. Quantum machine learning offers an alternative way to introduce nonlinear correlation modeling with compact modules, yet existing quantum SER studies remain limited, and the impact of circuit structure is not well understood. This paper presents HQTN-SER, a hybrid quantum-classical framework that investigates how quantum tensor network connectivity can support SER under small-qubit settings. HQTN-SER introduces (i) an MPS-inspired quantum tensor network module that enforces structured interactions to model correlations in speech representations with a small number of trainable parameters, and (ii) a fusion strategy that combines quantum measurement features with a learned classical latent embedding for end-to-end emotion classification. We evaluate HQTN-SER on three public benchmarks (RAVDESS, SAVEE, and MDER) under a unified preprocessing and training protocol. The proposed model achieves test accuracies of 80.09\% on RAVDESS, 78.12\% on SAVEE, and 73.51\% on MDER, with corresponding macro-F1 scores of 0.8012, 0.7826, and 0.7351, respectively. The model also exhibits stable convergence while using only three or four qubits, suggesting that MPS-inspired circuit structure can be an effective and hardware-aware design choice for quantum-assisted SER. These results provide a compact experimental baseline for studying structured quantum modules in affective computing.
Sentiment, emotion, and sarcasm analysis in multimodal dialogues is crucial for understanding the underlying intentions and attitudes expressed by individuals. Traditional methods often struggle to capture the full intensity of these polarities, leading to less accurate results. To address this limitation, we propose a quantum-inspired approach leveraging Quantum Neural Networks (QNNs) for enhanced classification and intensity analysis. A key component of our method is the Variational Quantum Eigensolver (VQE), a hybrid quantum-classical algorithm that optimizes the parameters of the QNN by minimizing the eigenvalues of a Hamiltonian system. This optimization enables the network to learn complex relationships in multimodal data more effectively. Our approach surpasses state-of-the-art methods, achieving up to 7.5 % higher accuracy and 6.8 % greater precision. Experiments on benchmark datasets such as MUStARD, Memotion, CMU-MOSEI, and MELD demonstrate its effectiveness, with an F1-score of 87.3 % on CMU-MOSEI. This method is particularly beneficial in domains like social media, customer support, and entertainment, where both verbal and non-verbal cues play a critical role in accurate sentiment analysis .
Sentiment analysis (SA) is a critical component of Natural Language Processing (NLP), particularly for automatic text classification. However, previous approaches have shortcomings in capturing nuances such as negation, word pairings, and contextual understanding, particularly in languages like Hindi. To solve these issues, this research offers a novel Quantum Neural Network (QNN) technique designed specifically for sentiment analysis in Hindi text data, which employs quantum computing concepts to capture linguistic nuances and context better. This study uses a Quantum Variational Auto Encoder to encode classical data into a quantum form, capturing diverse sentiments like sarcasm and colloquial expressions. A Tuned Quantum Convolutional Neural Network architecture is introduced to capture complex linguistic syntax. A novel Sequential-based hyperband optimization technique is used to enhance model performance. The hybrid approach significantly improves accuracy and efficiency in handling quantum data, contributing to the advancement of SA, particularly in Hindi Movie Reviews. The findings demonstrate that the proposed strategy performs best with accuracy 97.64 %, precision 85.93%, recall 99.17%, F-1 score 92.20%, than other accepted strategies.