Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2301.09138 · Quantum Machine Intelligence

Explaining quantum circuits with Shapley values: towards explainable quantum machine learning

Raoul Heese, Thore Gerlach, Sascha Mücke, Sabine Müller, Matthias Jakobs, Nico Piatkowski

Published Feb 25, 2025• 63 citations
arXivHTMLPDF

Abstract

Abstract Methods of artificial intelligence (AI) and especially machine learning (ML) have been growing ever more complex, and at the same time have more and more impact on people’s lives. This leads to explainable AI (XAI) manifesting itself as an important research field that helps humans to better comprehend ML systems. In parallel, quantum machine learning (QML) is emerging with the ongoing improvement of quantum computing hardware combined with its increasing availability via cloud services. QML enables quantum-enhanced ML in which quantum mechanics is exploited to facilitate ML tasks, typically in the form of quantum-classical hybrid algorithms that combine quantum and classical resources. Quantum gates constitute the building blocks of gate-based quantum hardware and form circuits that can be used for quantum computations. For QML applications, quantum circuits are typically parameterized and their parameters are optimized classically such that a suitably defined objective function is minimized. Inspired by XAI, we raise the question of the explainability of such circuits by quantifying the importance of (groups of) gates for specific goals. To this end, we apply the well-established concept of Shapley values. The resulting attributions can be interpreted as explanations for why a specific circuit works well for a given task, improving the understanding of how to construct parameterized (or variational) quantum circuits, and fostering their human interpretability in general. An experimental evaluation on simulators and two superconducting quantum hardware devices demonstrates the benefits of the proposed framework for classification, generative modeling, transpilation, and optimization. Furthermore, our results shed some light on the role of specific gates in popular QML approaches.

DOI
10.1007/s42484-025-00254-8

Related papers

QRLaXAI: quantum representation learning and explainable AI

Asitha Kottahachchi Kankanamge Don, Ibrahim Khalil

Abstract As machine learning grows increasingly complex due to big data and deep learning, model explainability has become essential to fostering user trust. Quantum machine learning (QML) has emerged as a promising field, leveraging quantum computing to enhance classical machine learning methods, particularly through quantum representation learning (QRL). QRL aims to provide more efficient and powerful machine learning capabilities on noisy intermediate-scale quantum (NISQ) devices. However, interpreting QRL models poses significant challenges due to the reliance on quantum gate-based parameterized circuits, which, while analogous to classical neural network layers, operate in the quantum domain. To address these challenges, we propose an explainable QRL framework combining a quantum autoencoder (QAE) with a variational quantum classifier (VQC) and incorporating theoretical and empirical explainability for image data. Our dual approach enhances model interpretability by integrating visual explanations via local interpretable model-agnostic explanations (LIME) and analytical insights using Shapley Additive Explanations (SHAP). These complementary methods provide a deeper understanding of the model’s decision-making process based on prediction outcomes. Experimental evaluations on simulators and superconducting quantum hardware validate the effectiveness of the proposed framework for classification tasks, underscoring the importance of explainable representation learning in advancing QML towards more transparent and reliable applications.

Quantum Machine Intelligence•Feb 19, 2025•19 citations

Towards Explainable Quantum Machine Learning: A Hybrid Quantum SHAP-based Framework

M. Ramu, Donapati Deepika, Nikhila Baddula +3 more

Quantum machine learning is becoming popular as a method to enhance computational intelligence using concepts of quantum mechanics. However, quantum models tend to be complex and probabilistic, making them difficult to interpret and limiting their application in real-world scenarios where transparent decision-making is important. This work introduces a quantum-aware feature attribution framework that combines hybrid quantum-classical models with Quantum SHAP-based explainability. The proposed methodology enables prediction interpretation by analyzing the sensitivity of classical input features within quantum circuits. Experiments conducted on benchmark datasets demonstrate that the proposed method achieves competitive predictive performance while improving the stability and consistency of explanations. The framework also provides better understanding of feature contributions even in the presence of quantum noise. Overall, the findings indicate that explainability methods can improve transparency and trust in quantum machine learning models. This work contributes toward the development of more reliable and interpretable quantum-based learning systems by bridging quantum computing and explainable artificial intelligence.

International Conference on Computing Methodologies and Communication (ICCMC)•Jul 1, 2026•0 citations

From Black Boxes to Glass Boxes: Interpretable Quantum Machine Learning through Explainability Tools

Manojkumar S. Langote, Abhishek Kawane

Quantum Machine Learning (QML) has emerged as a promising paradigm that leverages quantum mechanical principles to accelerate machine learning tasks.Despite its potential, most QML models remain opaque "black boxes," hindering their deployment in high-stakes or regulated domains where trust and accountability are essential.This work introduces two novel interpretability methods tailored for QML: Quantum Shapley Values (QSV) and Quantum Local Interpretable Model-Agnostic Explanations (Q-LIME).QSV adapts cooperative game theory to quantify the contribution of individual qubits, observables, or circuit parameters, while Q-LIME generates perturbed quantum states and trains surrogate classical models to approximate local decision boundaries.Through experiments on variational quantum classifiers and hybrid quantum-classical neural networks, we demonstrate that QSV provides rigorous attribution but suffers from scalability constraints, whereas Q-LIME yields efficient, approximate explanations suitable for near-term devices.By transforming quantum models from opaque "black boxes" into interpretable "glass boxes," this research lays the foundation for trustworthy, transparent, and human centred quantum AI.

•Dec 29, 2025•0 citations

Quantum Circuit-Based Learning Models: Bridging Quantum Computing and Machine Learning

Fan Fan, Yilei Shi, Mihai Datcu +5 more

Machine Learning (ML) has been widely applied across numerous domains due to its ability to automatically identify informative patterns from data for various tasks. The availability of large-scale data and advanced computational power enables the development of sophisticated models and training strategies, leading to state-of-the-art performance, but it also introduces substantial challenges. Quantum Computing (QC), which exploits quantum mechanisms for computation, has attracted growing attention and significant global investment as it may address these challenges. Consequently, Quantum Machine Learning (QML), the integration of these two fields, has received increasing interest, with a notable rise in related studies in recent years. We are motivated to review these existing contributions regarding quantum circuit-based learning models for classical data analysis and highlight the identified potentials and challenges of this technique. Specifically, we focus not only on QML models, both kernel-based and neural network-based, but also on recent explorations of their integration with classical machine learning layers within hybrid frameworks. Moreover, we examine both theoretical analysis and empirical findings to better understand their capabilities, and we also discuss the efforts on noise-resilient and hardware-efficient QML that could enhance its practicality under current hardware limitations. In addition, we cover several emerging paradigms for advanced quantum circuit design and highlight the adaptability of QML across representative application domains. This study aims to provide an overview of the contributions made to bridge quantum computing and machine learning, offering insights and guidance to support its future development and pave the way for broader adoption in the coming years.

quant-pharXiv:2602.00048•Artificial Intelligence Review•Jan 20, 2026•2 citations

Quantum Computing for Explainable AI: Developing Quantum-inspired Interpretable Models for Complex Decision-making Systems

Chidera Onyeka Agu

The rapid advancement of Artificial Intelligence (AI) has heightened concerns about the opacity of decision-making processes in complex models, particularly deep neural networks. This research explores a novel paradigm that integrates quantum computing principles into Explainable AI (XAI) to enhance interpretability without compromising predictive accuracy. The study introduces a Quantum-inspired Interpretable Model (QIIM) framework that leverages Hilbert space embeddings, unitary transformations, and operator-based learning to represent knowledge in a mathematically transparent form. The proposed model computes interpretability through the expectation values of observable operators, enabling the decomposition of decisions into quantifiable, human-understandable components. To capture hierarchical relationships, a Tensor Network Interpretable Model (TNIM) is further developed, offering scalable insights into complex dependencies among features. Experimental evaluations—performed on benchmark datasets for decision-making tasks—demonstrate that the quantum-inspired models achieve competitive accuracy while significantly improving local and global interpretability metrics compared to classical XAI techniques. The findings underscore the potential of quantum formalism as a new foundation for transparent AI systems, bridging the gap between computational efficiency and explainability. This study contributes to both theoretical understanding and practical advancement in interpretable machine learning, paving the way for ethically aligned, transparent, and human-trustworthy AI-driven decision support systems.

British Journal of Computer Networking and Information Technology•Dec 3, 2025•1 citation

Towards Explainability of Classical Neural Network via Quantum Computing

Junyong Lee, Jeihee Cho, Daniel Justice +1 more

In recent years, machine learning has achieved remarkable success in tasks such as image classification and solving complex real-world problems. The achievements of deep neural networks (DNNs) have led to the widespread adoption of block-based architectures. However, as the demand for Explainable AI (XAI) grows, there is a need for models that provide greater transparency and interpretability. Our work addresses this need by exploring the potential of quantum-classical hybrid models. By integrating classical neural networks (ClaNNs) with quantum neural networks (QNNs), we aim to develop AI systems that are not only powerful but also interpretable. We propose a framework that combines parameterized quantum circuits (PQCs) with classical layers to create a hybrid block design for QNNs. By adding a linear layer after the PQCs, the flexibility of the block design is increased. This architecture enhances the adaptability of QNN design and facilitates the integration of XAI principles through the comparison of the loss function planes. Our training method, inspired by knowledge distillation, addresses existing challenges in PQC-based QNN designs, providing insights into the optimization landscape. We validate the effectiveness of our hybrid block through experiments on standard datasets, demonstrating its potential to achieve comparable accuracy to traditional DNNs while providing improved interpretability.

IEEE International Conference on Quantum Computing and Engineering (QCE)•Sep 1, 2024•2 citations
Abstract Methods of artificial intelligence (AI) and especially machine learning (ML) have been growing ever more complex, and at the same time have more and more impact on people’s lives. This leads to explainable AI (XAI) manifesting itself as an important research field that helps humans to better comprehend ML systems. In parallel, quantum machine learning (QML) is emerging with the ongoing improvement of quantum computing hardware combined with its increasing availability via cloud services. QML enables quantum-enhanced ML in which quantum mechanics is exploited to facilitate ML tasks, typically in the form of quantum-classical hybrid algorithms that combine quantum and classical resources. Quantum gates constitute the building blocks of gate-based quantum hardware and form circuits that can be used for quantum computations. For QML applications, quantum circuits are typically parameterized and their parameters are optimized classically such that a suitably defined objective function is minimized. Inspired by XAI, we raise the question of the explainability of such circuits by quantifying the importance of (groups of) gates for specific goals. To this end, we apply the well-established concept of Shapley values. The resulting attributions can be interpreted as explanations for why a specific circuit works well for a given task, improving the understanding of how to construct parameterized (or variational) quantum circuits, and fostering their human interpretability in general. An experimental evaluation on simulators and two superconducting quantum hardware devices demonstrates the benefits of the proposed framework for classification, generative modeling, transpilation, and optimization. Furthermore, our results shed some light on the role of specific gates in popular QML approaches.
Abstract As machine learning grows increasingly complex due to big data and deep learning, model explainability has become essential to fostering user trust. Quantum machine learning (QML) has emerged as a promising field, leveraging quantum computing to enhance classical machine learning methods, particularly through quantum representation learning (QRL). QRL aims to provide more efficient and powerful machine learning capabilities on noisy intermediate-scale quantum (NISQ) devices. However, interpreting QRL models poses significant challenges due to the reliance on quantum gate-based parameterized circuits, which, while analogous to classical neural network layers, operate in the quantum domain. To address these challenges, we propose an explainable QRL framework combining a quantum autoencoder (QAE) with a variational quantum classifier (VQC) and incorporating theoretical and empirical explainability for image data. Our dual approach enhances model interpretability by integrating visual explanations via local interpretable model-agnostic explanations (LIME) and analytical insights using Shapley Additive Explanations (SHAP). These complementary methods provide a deeper understanding of the model’s decision-making process based on prediction outcomes. Experimental evaluations on simulators and superconducting quantum hardware validate the effectiveness of the proposed framework for classification tasks, underscoring the importance of explainable representation learning in advancing QML towards more transparent and reliable applications.
Quantum machine learning is becoming popular as a method to enhance computational intelligence using concepts of quantum mechanics. However, quantum models tend to be complex and probabilistic, making them difficult to interpret and limiting their application in real-world scenarios where transparent decision-making is important. This work introduces a quantum-aware feature attribution framework that combines hybrid quantum-classical models with Quantum SHAP-based explainability. The proposed methodology enables prediction interpretation by analyzing the sensitivity of classical input features within quantum circuits. Experiments conducted on benchmark datasets demonstrate that the proposed method achieves competitive predictive performance while improving the stability and consistency of explanations. The framework also provides better understanding of feature contributions even in the presence of quantum noise. Overall, the findings indicate that explainability methods can improve transparency and trust in quantum machine learning models. This work contributes toward the development of more reliable and interpretable quantum-based learning systems by bridging quantum computing and explainable artificial intelligence.
Quantum Machine Learning (QML) has emerged as a promising paradigm that leverages quantum mechanical principles to accelerate machine learning tasks.Despite its potential, most QML models remain opaque "black boxes," hindering their deployment in high-stakes or regulated domains where trust and accountability are essential.This work introduces two novel interpretability methods tailored for QML: Quantum Shapley Values (QSV) and Quantum Local Interpretable Model-Agnostic Explanations (Q-LIME).QSV adapts cooperative game theory to quantify the contribution of individual qubits, observables, or circuit parameters, while Q-LIME generates perturbed quantum states and trains surrogate classical models to approximate local decision boundaries.Through experiments on variational quantum classifiers and hybrid quantum-classical neural networks, we demonstrate that QSV provides rigorous attribution but suffers from scalability constraints, whereas Q-LIME yields efficient, approximate explanations suitable for near-term devices.By transforming quantum models from opaque "black boxes" into interpretable "glass boxes," this research lays the foundation for trustworthy, transparent, and human centred quantum AI.
Machine Learning (ML) has been widely applied across numerous domains due to its ability to automatically identify informative patterns from data for various tasks. The availability of large-scale data and advanced computational power enables the development of sophisticated models and training strategies, leading to state-of-the-art performance, but it also introduces substantial challenges. Quantum Computing (QC), which exploits quantum mechanisms for computation, has attracted growing attention and significant global investment as it may address these challenges. Consequently, Quantum Machine Learning (QML), the integration of these two fields, has received increasing interest, with a notable rise in related studies in recent years. We are motivated to review these existing contributions regarding quantum circuit-based learning models for classical data analysis and highlight the identified potentials and challenges of this technique. Specifically, we focus not only on QML models, both kernel-based and neural network-based, but also on recent explorations of their integration with classical machine learning layers within hybrid frameworks. Moreover, we examine both theoretical analysis and empirical findings to better understand their capabilities, and we also discuss the efforts on noise-resilient and hardware-efficient QML that could enhance its practicality under current hardware limitations. In addition, we cover several emerging paradigms for advanced quantum circuit design and highlight the adaptability of QML across representative application domains. This study aims to provide an overview of the contributions made to bridge quantum computing and machine learning, offering insights and guidance to support its future development and pave the way for broader adoption in the coming years.
The rapid advancement of Artificial Intelligence (AI) has heightened concerns about the opacity of decision-making processes in complex models, particularly deep neural networks. This research explores a novel paradigm that integrates quantum computing principles into Explainable AI (XAI) to enhance interpretability without compromising predictive accuracy. The study introduces a Quantum-inspired Interpretable Model (QIIM) framework that leverages Hilbert space embeddings, unitary transformations, and operator-based learning to represent knowledge in a mathematically transparent form. The proposed model computes interpretability through the expectation values of observable operators, enabling the decomposition of decisions into quantifiable, human-understandable components. To capture hierarchical relationships, a Tensor Network Interpretable Model (TNIM) is further developed, offering scalable insights into complex dependencies among features. Experimental evaluations—performed on benchmark datasets for decision-making tasks—demonstrate that the quantum-inspired models achieve competitive accuracy while significantly improving local and global interpretability metrics compared to classical XAI techniques. The findings underscore the potential of quantum formalism as a new foundation for transparent AI systems, bridging the gap between computational efficiency and explainability. This study contributes to both theoretical understanding and practical advancement in interpretable machine learning, paving the way for ethically aligned, transparent, and human-trustworthy AI-driven decision support systems.
In recent years, machine learning has achieved remarkable success in tasks such as image classification and solving complex real-world problems. The achievements of deep neural networks (DNNs) have led to the widespread adoption of block-based architectures. However, as the demand for Explainable AI (XAI) grows, there is a need for models that provide greater transparency and interpretability. Our work addresses this need by exploring the potential of quantum-classical hybrid models. By integrating classical neural networks (ClaNNs) with quantum neural networks (QNNs), we aim to develop AI systems that are not only powerful but also interpretable. We propose a framework that combines parameterized quantum circuits (PQCs) with classical layers to create a hybrid block design for QNNs. By adding a linear layer after the PQCs, the flexibility of the block design is increased. This architecture enhances the adaptability of QNN design and facilitates the integration of XAI principles through the comparison of the loss function planes. Our training method, inspired by knowledge distillation, addresses existing challenges in PQC-based QNN designs, providing insights into the optimization landscape. We validate the effectiveness of our hybrid block through experiments on standard datasets, demonstrating its potential to achieve comparable accuracy to traditional DNNs while providing improved interpretability.