Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2601.07856

Feature Entanglement-based Quantum Multimodal Fusion Neural Network

Yu Wu, Qianli Zhou, Jie Geng, Xinyang Deng, Wen Jiang

quant-phcs.AIcs.LGSubmitted Jan 9, 2026• Announced Jan 12, 2026• 2 citations
arXivHTMLPDF

Abstract

Multimodal learning aims to enhance perceptual and decision-making capabilities by integrating information from diverse sources. However, classical deep learning approaches face a critical trade-off between the high accuracy of black-box feature-level fusion and the interpretability of less outstanding decision-level fusion, alongside the challenges of parameter explosion and complexity. This paper discusses the accuracy-interpretablity-complexity dilemma under the quantum computation framework and propose a feature entanglement-based quantum multimodal fusion neural network. The model is composed of three core components: a classical feed-forward module for unimodal processing, an interpretable quantum fusion block, and a quantum convolutional neural network (QCNN) for deep feature extraction. By leveraging the strong expressive power of quantum, we have reduced the complexity of multimodal fusion and post-processing to linear, and the fusion process also possesses the interpretability of decision-level fusion. The simulation results demonstrate that our model achieves classification accuracy comparable to classical networks with dozens of times of parameters, exhibiting notable stability and performance across multimodal image datasets.

Related papers

Hybrid quantum-classical-quantum convolutional neural networks

Changzhou Long, Mengyuan Huang, Xiucai Ye +2 more

Deep learning has achieved significant success in pattern recognition, with convolutional neural networks (CNNs) serving as a foundational architecture for extracting spatial features from images. Quantum computing provides an alternative computational framework, a hybrid quantum-classical convolutional neural networks (QCCNNs) leverage high-dimensional Hilbert spaces and entanglement to surpass classical CNNs in image classification accuracy under comparable architectures. Despite performance improvements, QCCNNs typically use fixed quantum layers without incorporating trainable quantum parameters. This limits their ability to capture non-linear quantum representations and separates the model from the potential advantages of expressive quantum learning. In this work, we present a hybrid quantum-classical-quantum convolutional neural network (QCQ-CNN) that incorporates a quantum convolutional filter, a shallow classical CNN, and a trainable variational quantum classifier. This architecture aims to enhance the expressivity of decision boundaries in image classification tasks by introducing tunable quantum parameters into the end-to-end learning process. Through a series of small-sample experiments on MNIST, F-MNIST, and MRI tumor datasets, QCQ-CNN demonstrates competitive accuracy and convergence behavior compared to classical and hybrid baselines. We further analyze the effect of ansatz depth and find that moderate-depth quantum circuits can improve learning stability without introducing excessive complexity. Additionally, simulations incorporating depolarizing noise and finite sampling shots suggest that QCQ-CNN maintains a certain degree of robustness under realistic quantum noise conditions. While our results are currently limited to simulations with small-scale quantum circuits, the proposed approach offers a potentially promising direction for hybrid quantum learning in near-term applications.

Scientific Reports•Aug 28, 2025•93 citations

Quantum-enhanced feature learning: a hybrid QCNN for multi-category classification on NISQ devices

Li Dongfen, Yuhang Yuan, Zhikang Hu +2 more

Abstract Quantum Machine Learning (QML) has emerged as a promising paradigm that leverages the principles of quantum mechanics—such as superposition and entanglement—to overcome the limitations of classical machine learning in handling complex, high-dimensional data. However, practical challenges such as limited coherence times of qubits and the integration of quantum circuits with classical architectures have hindered the full realization of QML’s potential. To address these challenges, this paper proposes a novel hybrid architecture, termed the Classical-Quantum Hybrid Convolutional Neural Network (CQHCNN), which integrates quantum-inspired layers into conventional deep learning frameworks. These quantum layers utilize quantum information processing to extract complex features, while the classical components perform feature extraction and classification. This paper evaluates the performance of our model on several benchmark datasets, including MNIST, Fashion-MNIST, CIFAR-10 and COVID-19 Radiography, demonstrating its ability to outperform some other Quantum Convolutional Neural Networks (QCNNs) in terms of many metrics. Experimental results indicate that the hybrid model achieves significant improvements in classification accuracy and computational efficiency, highlighting the potential of quantum-inspired techniques to enhance classical machine learning models.

Physica Scripta•May 30, 2025•6 citations

A Quantum Multimodal Neural Network Model for Sentiment Analysis on Quantum Circuits

Jin Zheng, Qing Zhong Gao, Daoyi Dong +2 more

This article proposes a quantum multimodal neural network (QMNN) model that can be implemented on parameterized quantum circuits (PQCs), providing a novel avenue for processing multimodal data and performing advanced multimodal sentiment analysis tasks. The comprehensive QMNN model is structured into four fundamental blocks: multimodal data preprocessing, unimodal feature extraction, multimodal feature fusion, and optimization. Through these blocks, multimodal data are initially preprocessed and encoded into quantum states. Subsequently, visual and textual features are extracted from the quantum states and are then integrated to learn the interactions between different modalities. Finally, the model parameters are fine-tuned to optimize the sentiment analysis performance. Simulation results confirm that QMNN surpasses state-of-the-art baselines, using significantly lower input dimensions and substantially fewer parameters than classical models. Furthermore, the entanglement, integrity, robustness, and scalability of the model are analyzed in depth. Internally, the strong entanglement within the multimodal fusion block enhances interactions between textual and visual features, and the integrity of the model reflects the indispensable contribution of each component to the overall performance. Externally, robustness ensures the model operates stably under noisy conditions and incomplete inputs, and scalability enables it to efficiently adapt to varying architectural depths and widths. The above simulation results and performance analyses showcase the comprehensive strength of our proposed model.

IEEE Transactions on Artificial Intelligence•Dec 4, 2024•16 citations

Design and Implementation of Quantum Kernel Convolution for Hybrid Neural Networks

Erdem Şeker, Yusuf Kağan Bayraktaroğlu, Deniz Eren Çam +2 more

Classical convolutional neural networks (CNNs) have achieved notable success in image classification but face challenges in scalability, interpretability, and computational cost. With the growing availability of Noisy Intermediate-Scale Quantum (NISQ) devices, hybrid quantum-classical models offer a promising alternative by leveraging quantum parallelism and entanglement. In this work, we present a hybrid Quantum Convolutional Neural Network (QCNN) that integrates quantum convolutional layers into classical image classification pipeline for the MNIST dataset. Our architecture features a modular, low-depth Quantum Kernel Convolution (QKC) design suitable for near-term hardware. We implement the system using Qiskit and evaluate in terms of classification accuracy, circuit efficiency, and integration feasibility. Our results demonstrate that (i) the hybrid QCNN achieves similar accuracy to classical models while reducing the number of classical parameters, and (ii) quantum layers can successfully perform dimensionality reduction through entanglement-based pooling. This study highlights the potential of hybrid QCNN as a practical quantum-enhanced model for real-world image recognition tasks.

International Conference on Computer Science and Engineering (UBMK)•Sep 17, 2025•1 citation

Image Classification using Quantum Convolutional Neural Network (QCNN)

R. Sivaranjani, Bandaru Shanmukha Priya, Omprakash Gurrapu +3 more

Convolutional Neural Networks (CNNs) are extensively utilized for image classification due to their ability to exploit data correlations effectively. However, traditional CNNs encounter several challenges, including limitations in accuracy improvement, computational efficiency, explain ability, and generalization. As data dimensionality or model complexity increases, CNNs often become more difficult to train efficiently, leading to slower processing times. To overcome these challenges, Quantum Convolutional Neural Networks (QCNNs) offer a promising quantum-based approach to enhance existing models, particularly by improving training efficiency and reducing processing times. This paper provides a comparative analysis of classical CNNs and a novel quantum circuit architecture tailored for image-based tasks. The analysis emphasizes the adaptability and potential of quantum circuits to enhance feature extraction, recognition accuracy, and processing efficiency.We applied various QCNN architectures to the Chinese-MNIST dataset and compared their performance with traditional CNN models. Although QCNNs achieved slightly lower accuracy, they demonstrated significantly greater stability. These findings high- light QCNNs’ potential to overcome the computational limitations of conventional deep learning, offering a promising pathway for quantum-enhanced solutions in computer vision. Future work will focus on refining quantum circuit designs, developing hybrid quantum-classical models, and extending QCNN applications to larger and more diverse datasets.

International Conference on Metaverse and Current Trends in Computing (ICMCTC)•Apr 10, 2025•2 citations

Quantum-enhanced multimodal fusion for robust and accurate fake news detection

Thulasi Bikku

The digital era has witnessed a significant rise in misinformation, underscoring the urgent need for effective tools to distinguish factual news from fabricated content.This study proposes a novel methodology for fake news detection that leverages quantum entanglement to facilitate multimodal fusion of textual, visual, and acoustic data.The quantum entanglement algorithm offers significant advantages in managing high-dimensional data by enabling efficient feature optimization through quantum computing encodings integrated with neural network architectures.The existing quantum circuits for text, visual, and audio would co-occur while witnessing the message from humans to machines with the machines acting as quantum computers integrated with neural networks, specifically designed for fake news detection.The results generated from our method demonstrate significantly improved fake news detection accuracy, and increased accuracy in the noise simulation, and the system is resilient to adversarial methods, all in contrast to typical methods.The proposed Quantum Encoding with Multimodal Fusion (QEMF) framework surpasses existing approaches by offering as it suggests promising future directions to tackle fake news across the web.The system, in a scientific manner, performs a variety of strict pre-processing techniques to all textual data such as tokenization, stemming, and lemmatization, along with sophisticated image pre-processing to all visual data.It uses the latest extracting features, i.e., Glove for text embedding, and conventional convolutional networks, like VGG16, for visual data.The feature representation is significantly enriched through quantum encoding, while the capability of QCNNs to identify the most salient and discriminative features enhances accuracy and ensures robustness against noise and adversarial interference.Furthermore, the system's real-time detection capability and its scalability position it as a powerful tool in combating misinformation within the evolving bio-informational ecosystem.

Sigma Journal of Engineering and Natural Sciences – Sigma Mühendislik ve Fen Bilimleri Dergisi•Jan 1, 2025•3 citations
Multimodal learning aims to enhance perceptual and decision-making capabilities by integrating information from diverse sources. However, classical deep learning approaches face a critical trade-off between the high accuracy of black-box feature-level fusion and the interpretability of less outstanding decision-level fusion, alongside the challenges of parameter explosion and complexity. This paper discusses the accuracy-interpretablity-complexity dilemma under the quantum computation framework and propose a feature entanglement-based quantum multimodal fusion neural network. The model is composed of three core components: a classical feed-forward module for unimodal processing, an interpretable quantum fusion block, and a quantum convolutional neural network (QCNN) for deep feature extraction. By leveraging the strong expressive power of quantum, we have reduced the complexity of multimodal fusion and post-processing to linear, and the fusion process also possesses the interpretability of decision-level fusion. The simulation results demonstrate that our model achieves classification accuracy comparable to classical networks with dozens of times of parameters, exhibiting notable stability and performance across multimodal image datasets.
Deep learning has achieved significant success in pattern recognition, with convolutional neural networks (CNNs) serving as a foundational architecture for extracting spatial features from images. Quantum computing provides an alternative computational framework, a hybrid quantum-classical convolutional neural networks (QCCNNs) leverage high-dimensional Hilbert spaces and entanglement to surpass classical CNNs in image classification accuracy under comparable architectures. Despite performance improvements, QCCNNs typically use fixed quantum layers without incorporating trainable quantum parameters. This limits their ability to capture non-linear quantum representations and separates the model from the potential advantages of expressive quantum learning. In this work, we present a hybrid quantum-classical-quantum convolutional neural network (QCQ-CNN) that incorporates a quantum convolutional filter, a shallow classical CNN, and a trainable variational quantum classifier. This architecture aims to enhance the expressivity of decision boundaries in image classification tasks by introducing tunable quantum parameters into the end-to-end learning process. Through a series of small-sample experiments on MNIST, F-MNIST, and MRI tumor datasets, QCQ-CNN demonstrates competitive accuracy and convergence behavior compared to classical and hybrid baselines. We further analyze the effect of ansatz depth and find that moderate-depth quantum circuits can improve learning stability without introducing excessive complexity. Additionally, simulations incorporating depolarizing noise and finite sampling shots suggest that QCQ-CNN maintains a certain degree of robustness under realistic quantum noise conditions. While our results are currently limited to simulations with small-scale quantum circuits, the proposed approach offers a potentially promising direction for hybrid quantum learning in near-term applications.
Abstract Quantum Machine Learning (QML) has emerged as a promising paradigm that leverages the principles of quantum mechanics—such as superposition and entanglement—to overcome the limitations of classical machine learning in handling complex, high-dimensional data. However, practical challenges such as limited coherence times of qubits and the integration of quantum circuits with classical architectures have hindered the full realization of QML’s potential. To address these challenges, this paper proposes a novel hybrid architecture, termed the Classical-Quantum Hybrid Convolutional Neural Network (CQHCNN), which integrates quantum-inspired layers into conventional deep learning frameworks. These quantum layers utilize quantum information processing to extract complex features, while the classical components perform feature extraction and classification. This paper evaluates the performance of our model on several benchmark datasets, including MNIST, Fashion-MNIST, CIFAR-10 and COVID-19 Radiography, demonstrating its ability to outperform some other Quantum Convolutional Neural Networks (QCNNs) in terms of many metrics. Experimental results indicate that the hybrid model achieves significant improvements in classification accuracy and computational efficiency, highlighting the potential of quantum-inspired techniques to enhance classical machine learning models.
This article proposes a quantum multimodal neural network (QMNN) model that can be implemented on parameterized quantum circuits (PQCs), providing a novel avenue for processing multimodal data and performing advanced multimodal sentiment analysis tasks. The comprehensive QMNN model is structured into four fundamental blocks: multimodal data preprocessing, unimodal feature extraction, multimodal feature fusion, and optimization. Through these blocks, multimodal data are initially preprocessed and encoded into quantum states. Subsequently, visual and textual features are extracted from the quantum states and are then integrated to learn the interactions between different modalities. Finally, the model parameters are fine-tuned to optimize the sentiment analysis performance. Simulation results confirm that QMNN surpasses state-of-the-art baselines, using significantly lower input dimensions and substantially fewer parameters than classical models. Furthermore, the entanglement, integrity, robustness, and scalability of the model are analyzed in depth. Internally, the strong entanglement within the multimodal fusion block enhances interactions between textual and visual features, and the integrity of the model reflects the indispensable contribution of each component to the overall performance. Externally, robustness ensures the model operates stably under noisy conditions and incomplete inputs, and scalability enables it to efficiently adapt to varying architectural depths and widths. The above simulation results and performance analyses showcase the comprehensive strength of our proposed model.
Classical convolutional neural networks (CNNs) have achieved notable success in image classification but face challenges in scalability, interpretability, and computational cost. With the growing availability of Noisy Intermediate-Scale Quantum (NISQ) devices, hybrid quantum-classical models offer a promising alternative by leveraging quantum parallelism and entanglement. In this work, we present a hybrid Quantum Convolutional Neural Network (QCNN) that integrates quantum convolutional layers into classical image classification pipeline for the MNIST dataset. Our architecture features a modular, low-depth Quantum Kernel Convolution (QKC) design suitable for near-term hardware. We implement the system using Qiskit and evaluate in terms of classification accuracy, circuit efficiency, and integration feasibility. Our results demonstrate that (i) the hybrid QCNN achieves similar accuracy to classical models while reducing the number of classical parameters, and (ii) quantum layers can successfully perform dimensionality reduction through entanglement-based pooling. This study highlights the potential of hybrid QCNN as a practical quantum-enhanced model for real-world image recognition tasks.
Convolutional Neural Networks (CNNs) are extensively utilized for image classification due to their ability to exploit data correlations effectively. However, traditional CNNs encounter several challenges, including limitations in accuracy improvement, computational efficiency, explain ability, and generalization. As data dimensionality or model complexity increases, CNNs often become more difficult to train efficiently, leading to slower processing times. To overcome these challenges, Quantum Convolutional Neural Networks (QCNNs) offer a promising quantum-based approach to enhance existing models, particularly by improving training efficiency and reducing processing times. This paper provides a comparative analysis of classical CNNs and a novel quantum circuit architecture tailored for image-based tasks. The analysis emphasizes the adaptability and potential of quantum circuits to enhance feature extraction, recognition accuracy, and processing efficiency.We applied various QCNN architectures to the Chinese-MNIST dataset and compared their performance with traditional CNN models. Although QCNNs achieved slightly lower accuracy, they demonstrated significantly greater stability. These findings high- light QCNNs’ potential to overcome the computational limitations of conventional deep learning, offering a promising pathway for quantum-enhanced solutions in computer vision. Future work will focus on refining quantum circuit designs, developing hybrid quantum-classical models, and extending QCNN applications to larger and more diverse datasets.
The digital era has witnessed a significant rise in misinformation, underscoring the urgent need for effective tools to distinguish factual news from fabricated content.This study proposes a novel methodology for fake news detection that leverages quantum entanglement to facilitate multimodal fusion of textual, visual, and acoustic data.The quantum entanglement algorithm offers significant advantages in managing high-dimensional data by enabling efficient feature optimization through quantum computing encodings integrated with neural network architectures.The existing quantum circuits for text, visual, and audio would co-occur while witnessing the message from humans to machines with the machines acting as quantum computers integrated with neural networks, specifically designed for fake news detection.The results generated from our method demonstrate significantly improved fake news detection accuracy, and increased accuracy in the noise simulation, and the system is resilient to adversarial methods, all in contrast to typical methods.The proposed Quantum Encoding with Multimodal Fusion (QEMF) framework surpasses existing approaches by offering as it suggests promising future directions to tackle fake news across the web.The system, in a scientific manner, performs a variety of strict pre-processing techniques to all textual data such as tokenization, stemming, and lemmatization, along with sophisticated image pre-processing to all visual data.It uses the latest extracting features, i.e., Glove for text embedding, and conventional convolutional networks, like VGG16, for visual data.The feature representation is significantly enriched through quantum encoding, while the capability of QCNNs to identify the most salient and discriminative features enhances accuracy and ensures robustness against noise and adversarial interference.Furthermore, the system's real-time detection capability and its scalability position it as a powerful tool in combating misinformation within the evolving bio-informational ecosystem.