Foundation models have recently improved electrocardiogram (ECG) representation learning, but their deployment can be limited by computational cost and latency constraints. In this work, we fine-tune ECGFounder as a high-capacity teacher for binary ECG classification on PTB-XL and the MIT-BIH Arrhythmia Database, and investigate whether knowledge distillation can transfer its predictive behavior to compact students. We evaluate two classical 1D students (ResNet-1D and a lightweight CNN-1D) and a quantum-ready pipeline that combines a convolutional autoencoder, which compresses 256-sample ECG windows into a low-dimensional latent representation, with a 6-qubit variational quantum circuit implemented in Qiskit and executed in a simulated backend. Across both datasets, the teacher provides the strongest overall performance, while distillation yields competitive students under a considerable reduction in trainable parameters. We further analyze the sensitivity of student performance to distillation settings, highlighting consistent accuracy--efficiency trade-offs when compressing a foundation ECG model into classical and quantum-ready learners under a unified evaluation protocol.
Foundation models have recently improved electrocardiogram (ECG) representation learning, but their deployment can be limited by computational cost and latency constraints. In this work, we fine-tune ECGFounder as a high-capacity teacher for binary ECG classification on PTB-XL and the MIT-BIH Arrhythmia Database, and investigate whether knowledge distillation can transfer its predictive behavior to compact students. We evaluate two classical 1D students (ResNet-1D and a lightweight CNN-1D) and a quantum-ready pipeline that combines a convolutional autoencoder, which compresses 256-sample ECG windows into a low-dimensional latent representation, with a 6-qubit variational quantum circuit implemented in Qiskit and executed in a simulated backend. Across both datasets, the teacher provides the strongest overall performance, while distillation yields competitive students under a considerable reduction in trainable parameters. We further analyze the sensitivity of student performance to distillation settings, highlighting consistent accuracy--efficiency trade-offs when compressing a foundation ECG model into classical and quantum-ready learners under a unified evaluation protocol.
Abstract Quantum computing has emerged as a promising paradigm for addressing computational tasks intractable for classical systems, leveraging quantum mechanical principles such as superposition and entanglement to efficiently explore high-dimensional solution spaces. In recent years, hybrid quantum-classical approaches have gained increasing attention as a means to exploit the representational power of quantum systems while preserving the practicality of classical machine learning frameworks. This paper presents a study on quantum-enhanced model compression via feature-based knowledge distillation, in which a large classical neural network (the teacher) transfers knowledge to a substantially smaller hybrid student model. The proposed hybrid quantum-classical student architecture incorporates a parameterized quantum circuit (PQC) implemented in Qiskit, employing a linear $$\varvec{R_y}$$ angle-encoding feature map followed by an EfficientSU2 variational ansatz, with features bounded through a $$\varvec{\tanh (\cdot )\times \frac{\pi }{2}}$$ scaling to ensure stable gradient propagation. Gradient computation is performed via Reverse-Mode (adjoint) differentiation through the StatevectorEstimator primitive, which provides exact, shot-noise-free gradients at the cost of a single forward–backward pass per optimization step. The hybrid student is compared against a parameter-matched purely classical student under strict 1:1 parameter parity across a six-task binary benchmark spanning MNIST and Fashion-MNIST, as well as a four-class multi-class benchmark, totaling eleven classification experiments. A hardware validation experiment is additionally conducted on the IQM Garnet 20-qubit quantum processor using the Parameter-Shift Rule. The results indicate that the hybrid student outperforms its classical counterpart in five of six binary tasks (83%) and in the two hardest multi-class configurations, with advantages most pronounced in high-confusion regimes where compact classical classifiers approach the limits of their expressive capacity. On real quantum hardware, accuracy decreases from 99.04% in noiseless simulation to 80.50%, reflecting the impact of gate noise, readout errors, and transpilation overhead. While the hybrid model demonstrates improved parameter efficiency and expressive capacity, it incurs higher computational overhead and exhibits greater epoch-to-epoch training variability relative to classical baselines. We discuss practical limitations related to noise, scalability, and current hardware constraints, and identify directions for future work including hardware-efficient gradient estimation and advanced error mitigation protocols. Overall, our findings suggest that variational quantum circuits can serve as compact yet expressive components within neural compression schemes, with their representational advantage most effectively realized in binary and high-ambiguity classification scenarios.
Low-resource classification remains a persistent bottleneck for quantum machine learning due to label scarcity, class imbalance, and finite-shot measurement variance under NISQ constraints. This study proposes a hybrid framework that couples Quantum Transfer Learning with Distilled Quantum Teachers, where a high-capacity quantum teacher provides temperature-smoothed soft targets to train a compact student quantum adapter on top of a pretrained classical encoder. Experiments on three low-resource tasks (LR-Text-4, LR-Image-3, LR-Sensor-5) demonstrate consistent gains over non-distilled training at fixed student inference cost (2048 shots). The distilled student improves accuracy from 0.794 to 0.821 on LR-Text-4, from 0.781 to 0.812 on LR-Image-3, and from 0.768 to 0.809 on LR-Sensor-5, while macro F1 increases from 0.781 to 0.811, from 0.772 to 0.804, and from 0.742 to 0.789, respectively. Calibration improves substantially, with expected calibration error decreasing from 0.071 to 0.049 (LR-Text-4), from 0.074 to 0.052 (LR-Image-3), and from 0.083 to 0.056 (LR-Sensor-5), indicating more reliable confidence under scarcity. A temperature sweep reveals an optimal stability region around T ≈ 3.0 to 3.5, where aggregate accuracy peaks near 0.831 and mean calibration reaches its minimum near 0.043. Transfer ablations show that moderate encoder unfreezing (ratio 0.25) yields the best trade-off, achieving mean accuracy 0.842 and mean ECE 0.039, while full fine-tuning reduces accuracy to 0.818 and degrades calibration to 0.058. Resource analysis using a cost proxy (shots × depth) confirms that distilled students dominate the efficient regime, achieving 0.828 accuracy at cost 20,480 versus the teacher’s 0.867 accuracy at cost 180,224. Compared with classical baselines, the distilled student remains most advantageous in the high-overlap sensor setting, outperforming shallow random forests (0.809 vs 0.778 accuracy) while maintaining better calibrated uncertainty. These results position distilled quantum teachers as an effective offline supervision mechanism for compressing high-capacity quantum decision structure into deployable low-cost students for low-resource classification.
While hybrid quantum–classical architectures and knowledge distillation have each been explored independently in medical imaging and model compression, no prior work has unified these domains within a single framework. This study addresses this gap by investigating the integration of quantum–classical neural networks with knowledge distillation for medical image analysis, with a focus on circuit behavior, parameter efficiency, and diagnostic performance. The framework (QuantumMedKD) employs classical CNN architectures (ResNet-50, EfficientNet-B0, Xception) as teacher models, transferring learned representations to parameter-efficient quantum student networks via parameterized quantum circuits across qubit configurations (3-8), demonstrated through pneumonia detection from pediatric chest radiographs. Experimental validation reveals remarkable parameter efficiency, requiring only 24-36 trainable parameters compared to millions for classical counterparts, achieving compression ratios exceeding 1 0 5 while maintaining competitive diagnostic performance. Optimal configurations achieve 84.00% accuracy (EfficientNet-B0, 6-qubit) and 73.33% (Xception, 4-qubit), with knowledge distillation providing statistically significant improvements ( p -vallues < 0.001, Cohen’s d > 2.0). Medical evaluation confirms diagnostic capability with sensitivity 81.4%, specificity 73.9%, and AUC 0.89, establishing quantum–classical knowledge transfer viability for resource-constrained healthcare deployment. QuantumMedKD reveals essential principles and proof-of-concept for quantum-enhanced healthcare AI systems within and beyond the noisy intermediate-scale quantum (NISQ) era for high efficiency and deployability, paving the way for future advancements in the field.
Knowledge distillation transfers predictions, representations, or other supervisory information between learning models and is increasingly investigated in quantum machine learning. Its applications extend beyond compression to cross-architecture transfer, circuit approximation, distributed learning, and classical deployment of models trained using quantum-derived supervision. This survey reviews these approaches using two complementary classification axes: teacher-student configuration and the role of quantum resources in the distillation process. Quantum-inspired methods are discussed separately from methods that simulate quantum computations classically or execute them on quantum hardware. We explain how measurement probabilities, expectation values, classical readouts, state overlaps, and circuit-level objectives support different transfer mechanisms. We then critically assess the presented results against baseline design, execution conditions, uncertainty, and resource costs. The evidence shows that distillation can improve selected quantum students, but benefits are task- and architecture-dependent, and several studies find negligible gains or even performance degradation. Evaluations on physical quantum hardware remain limited, with some testing individual quantum components rather than complete learning pipelines. Heterogeneous protocols and incomplete resource reporting prevent general conclusions about practical quantum advantage. We identify priorities for controlled benchmarking, noise-aware learning, reproducible evaluation, and efficient transfer between quantum and classical models.
Early and accurate identification of heart conditions from electrocardiogram (ECG) signals is particularly important for ongoing patient health monitoring, yet classical deep learning frameworks have been inadequate at achieving high accuracy and low latency under noisy, real-time conditions. This work focuses on developing a quantum-accelerated cardiac ECG (electrocardiogram) analysis. The study introduces a novel hybrid quantum–classical framework capable of simultaneously performing ECG denoising, feature embedding, and arrhythmia classification with reduced latency and improved robustness under noisy real-time conditions. The one introduced in the article is the hybrid quantum-classical architecture, including Quantum Variational ECG Embedding (QVEE) for high-dimensional morphological representation, Quantum Enhanced Denoising Module (QEDM) for noise suppression and signal distortion, and hybrid quantum classification for arrhythmia recognition. Experiments were conducted on the MIT-BIH Arrhythmia Database, and a corpus with noise augmentation showed that the proposed framework was found to be 99.4% correct with an F1 score of 0.97 and reduced the inference latency by 23.7% compared to state-of-the-art CNN-LSTM, Transformer-based models, and showed higher robustness under the condition of low signal-to-noise ratios. The results show that quantum embeddings tend to improve ECG feature separability and that quantum denoising helps preserve clinically relevant waveform structure (i.e., structure detection), particularly for rare arrhythmias. The proposed framework is a promising approach for establishing real-time quantum-assisted monitoring of the human heart, enabling more reliable early diagnosis in wearable and clinical environments.
Quantum neural networks (QNNs) have recently attracted remarkable attention as a potential alternative to classical and deep neural network (NN) models particularly under constraints imposed by noisy intermediate-scale quantum (NISQ) devices, which support only shallow circuits with few quantum bits (qubits) and limited variational depth. However, applying QNNs to natural language processing (NLP) remains challenging because text representations are typically high-dimensional, while NISQ classifiers can only encode a small number of features at a time, requiring classical compression to enable stable training and flexible circuit configuration. In addition, many existing studies integrate QNNs into rich-text representation pipelines, where the quantum circuit is often implemented as a variational quantum circuit (VQC). Here, the VQC acts as an additional component within a larger model, and it remains unclear how the quantum component improves the classification task. Therefore, in this work, we propose a fully reproducible and compact QNN pipeline that provides a controlled setting for studying the contribution of the VQC to text classification. The model is trained end-to-end with a lightweight classical compression layer, and the overall study is supported by systematic ablation analyses of the compression layer, the classifier heads under a shared frozen low-dimensional representation, and quantum circuit structure. Our model uses the term frequency-inverse document frequency (TF-IDF) features with linear compression followed by a shallow four-qubit, two-layer VQC, implemented in PyTorch and PennyLane for end-to-end training. It is evaluated on five benchmark text classification datasets against classical baselines, including logistic regression and multilayer perceptron (MLP) models. Experimental results show that the proposed QNN achieves a competitive performance across all evaluated datasets, yielding the best results on three of the five benchmark datasets.