Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2609.18219

APGEM: Adaptive Policy-Guided Error Mitigation for Quantum Reinforcement Learning on a Real-World CVRP Case Study

Shabir Ahmad Sofi, Bisma Majid, Mir Mohammad Yousuf

Published Sep 16, 2026• 1 citation
arXivHTMLPDF

Abstract

Quantum Reinforcement Learning (QRL) represents policies as variational quantum circuits (VQCs), making it attractive for combinatorial optimization such as the Capacitated Vehicle Routing Problem (CVRP). On noisy intermediate-scale quantum (NISQ) hardware, however, decoherence degrades fidelity and destabilizes learning, and conventional error mitigation is applied statically without regard to the learning context. We introduce Adaptive Policy-Guided Error Mitigation (APGEM), a controller that selects among Zero-Noise Extrapolation (ZNE), Probabilistic Error Cancellation (PEC), Clifford Data Regression (CDR), and Readout Error Mitigation (REM) online, driven by a fidelity, entropy, and cost aware utility function and an epsilon-greedy rule over temporal-difference Q-scores. We evaluate on a realistic urban-logistics testbed, a Delhi-based CVRP over real landmarks with geodesic inter-node costs, exercised across five noise families and four severity levels. On this instance, the QRL agent outperforms constructive heuristics and approaches metaheuristics, while mitigation restores approximation ratios from 0.84-0.87 to 0.92-0.94 under high noise. The controller shifts from a CDR-dominated regime under short training horizons to a balanced deployment across all four techniques under longer horizons, indicating genuine regime-dependent selection. These preliminary results position adaptive, learning-aware mitigation as a practical route to noise-resilient QRL.

DOI
10.48550/arxiv.2609.18219

Related papers

Context-Aware Error Mitigation Orchestration for Hybrid Quantum Reinforcement Learning on NISQ Systems

Bisma Majid, Shabir Ahmed Sofi, Mir Mohammad Yousuf

Quantum Reinforcement Learning (QRL) integrates reinforcement learning with parameterized quantum circuits and is a promising approach to combinatorial optimization. On Noisy Intermediate-Scale Quantum (NISQ) devices, however, decoherence, gate imperfections, and measurement errors reduce policy quality and make learning less reliable. Existing error mitigation techniques are generally applied as fixed corrections that do not adapt to changing noise conditions or to the evolving state of training. This work presents Adaptive Policy-Guided Error Mitigation (APGEM) as a context-aware orchestration layer of the hybrid quantum-classical training loop that dynamically selects the most suitable mitigation strategy during QRL training. APGEM evaluates Zero-Noise Extrapolation (ZNE), Probabilistic Error Cancellation (PEC), Clifford Data Regression (CDR), and Readout Error Mitigation (REM) using policy-level indicators, including quantum-state fidelity, policy entropy, cumulative reward, and approximation ratio, and integrates the selected strategy directly into the reinforcement learning loop. The framework is evaluated on the Capacitated Vehicle Routing Problem (CVRP), a representative NP-hard problem in urban logistics, under a range of NISQ noise models and noise levels. APGEM consistently outperforms conventional static mitigation methods, reaches approximately 94% of the utility of an oracle strategy, maintains higher quantum-state fidelity as noise increases, and produces more stable learning behaviour throughout training. Ablation studies show that the framework learns context-aware mitigation policies that adapt to different noise environments and circuit execution conditions. These findings demonstrate that integrating adaptive error mitigation into the learning process substantially improves the robustness and reliability of QRL on NISQ hardware.

cs.LGCross-listedarXiv:2610.01253•Oct 2, 2026•0 citations

Adaptive Policy-Guided Error Mitigation (APGEM): A Unified Learning-Based Framework for Noise Resilience in Quantum Machine Learning

Bisma Majid, Shabir Ahmad Sofi, Mir Mohammad Yousuf

Error mitigation stands between variational quantum algorithms and useful results on today's noisy hardware, yet in practice a mitigation method is usually chosen once, by hand, and applied unchanged for the life of an experiment. This is a poor fit for quantum machine learning (QML), where the circuit and the noise drift as training proceeds, so the best strategy in one regime is often wrong in another. We present a generalized form of Adaptive Policy-Guided Error Mitigation (APGEM), which treats the choice of mitigation technique as an online decision made from an algorithm's own feedback. A single contextual-bandit controller observes signals any variational algorithm already produces, such as fidelity, entropy, reward or loss, and gradient behavior, and selects among Zero-Noise Extrapolation, Probabilistic Error Cancellation, Measurement Error Mitigation, Dynamical Decoupling, and circuit optimization per step. Because it depends only on this shared feedback interface, the framework applies unchanged across supervised, unsupervised, reinforcement, and hybrid quantum-classical learning. Evaluated on five paradigms across 80 algorithm-and-noise conditions, adaptive selection reaches 95.5% of an oracle that always picks the best technique and significantly outperforms all six fixed strategies (Friedman $χ^{2}=92.18$, $p\approx1.1\times10^{-17}$; pairwise Wilcoxon $p<4\times10^{-6}$). The learned policy is noise-aware: its favored technique shifts as depolarizing and readout error rise. On noise models from eight real IBM devices, APGEM tracks the oracle almost exactly (99.9% of oracle utility) at a flat cost of roughly $1.3\times10^{4}$ shots from three to eight qubits.

arXiv:2611.13815•Nov 10, 2026•0 citations

Zero-Noise Quantum Reinforcement Learning: Error-Resilient Learning Architectures for Scalable Quantum Control Systems

Kainat Rizwan

Quantum reinforcement learning (QRL) is a prospective system that can solve sequential control problems with quantum control, but the problem of hardware noise and decoherence cripples its application in noisy intermediate-scale quantum (NISQ) systems. This paper introduces a framework of Zero-Noise Quantum Reinforcement Learning (ZN-QRL), which directly includes the noise-resilient learning framework of zero-noise extrapolation (ZNE) into the policy optimization procedure. The presented architecture is implemented to perform parameterized quantum policies using amplified levels of noise and interpolates reward signal on the noise-free limit of a quantum system, where the learning agent is free to optimize policies as it would in an ideal environment with a quantum noisefree system but does not need to fully correct the error. Detailed simulation performance of quantum control benchmarks, such as state transfer and gate synthesis control, indicate that ZN-QRL is always better than standard variational QRL and post-hoc error-reducing control. In particular, the proposed framework attains control fidelity up to 30% greater, convergence is faster and more stable and performance is robust over a large dynamic depolarizing noise. Moreover, ZN-QRL also exhibits higher scalability and is able to maintain a steady learning rate with greater circuit depth and qubit count, therefore illustrating its usefulness in practical use of quantum control on existing NISQ devices.

International Conference on Information Science and Communication Technology (ICISCT)•Apr 15, 2026•0 citations

Quantum Noise Mitigation with Adaptive Zero-Noise Extrapolation: A Contextual Multi-Armed Bandits Approach

Ratun Rahman, Dinh C. Nguyen

Variational quantum circuits (VQCs) are central to near-term quantum computing, yet their practical deployment is severely hindered by noise. While existing error mitigation methods, such as zero-noise extrapolation (ZNE), typically assume static noise, real noisy intermediate-scale quantum (NISQ) systems exhibit dynamic, time-varying noise that remains largely unaddressed. To overcome this critical gap, our work introduces a novel adaptive noise mitigation framework for VQCs that integrates ZNE with contextual multi-armed bandits (CMAB), enabling dynamic, context-aware selection of circuit-folding levels based on ansatz parameters (e.g., depth, parameter count) and the evolving noise environment. Unlike fixed-fold or heuristic ZNE, our approach uses online adaptation to improve the accuracy of ZNE and reduce redundant quantum circuit executions. Our extensive simulations and experiments on real quantum hardware reveal the following important properties: (i) deeper VQCs accumulate noise, degrading accuracy and increasing the number of quantum circuit executions; (ii) ZNE restores estimator fidelity when the folding level is chosen appropriately; and (iii) CMAB-guided folding cuts quantum circuit execution round trips by up to 40\%, bytes exchanged by up to 35\%, and end-to-end cost by up to 30\% under a 10~Mbps budget, with up to 6.9\% higher estimator fidelity (CIFAR-10, depth 3, noise band $η=0.05$), versus fixed-fold and grid-search ZNE. These results demonstrate substantial performance gains over existing noise mitigation methods, underscoring the effectiveness of our design in supporting robust noise mitigation for VQCs. The source code is also publicly released to support reproducibility.

quant-pharXiv:2608.06426•IEEE Journal on Selected Areas in Communications•Aug 7, 2026•2 citations

Adaptive Hardware-Aware Quantum Error Mitigation Policy Selection Framework on Edge Devices

Sathvik Rao, Ilaqquan Rajesh Indu, Sowmya B.J. +1 more

Near-term quantum processors operate in the noisy intermediate-scale quantum (NISQ) region, where it is impractical to implement fault-tolerant error correction. Quantum Error Mitigation (QEM) provides a practical alternative, but most existing approaches rely on computationally intensive classical resources which are impractical to implement in embedded or edge-controlled systems. This work presents an adaptive, hardware-aware QEM framework designed for resource-constrained classical processors, demonstrated using a Raspberry Pi 5 as an edge controller for IBM Quantum hardware. A deep neural network predicts circuit fidelity and entropy from circuit and hardware features, enabling an online fuzzy-logic policy selector to choose among no mitigation, dynamical decoupling, and zero-noise extrapolation. Using real hardware feedback, an adaptive bias mechanism update policy was developed. The system operates without full-state simulation or offline recalibration and is evaluated on both randomized and benchmark-referenced circuits. Results show stable mitigation behaviour across depth regimes, primarily preventing fidelity degradation and selectively improving output similarity where mitigation is effective. This work demonstrates the feasibility of adaptive QEM deployment on classical edge devices under strict resource constraints.

IEEE International Conference for Convergence in Computing Technology (I3CTCON)•Mar 14, 2026•0 citations

Adaptive V16: Cost-Aware Reinforcement Learning Control for Robust NISQ Variational Optimization

Kondamudi Sivaparvathi, Cheppali Prabhavathi

Variational quantum algorithms (VQAs) are promising for near-term noisy intermediate-scale quantum (NISQ) devices, but their performance is often limited by device noise, finite-shot uncertainty, and nonstationary behavior that destabilize optimization. This paper proposes a cost-aware closed-loop hybrid framework (Adaptive V16) that augments a standard VQA loop with an online decision policy to adapt measurement effort and mitigation actions during execution. At each iteration, the controller uses runtime signals such as objective progress and uncertainty to select an action comprising the shot budget, mitigation mode, and step-scaling factor, explicitly trading solution improvement against resource overhead under a fixed budget. Experimental evaluation on a representative molecular Hamiltonian optimization task shows that Adaptive V16 achieves a lower final energy than a static VQE baseline and reduces the absolute error from 0.1391 to 0.0657. The controller’s decision module also demonstrates strong predictive performance with 0.9700 accuracy, 0.9595 F1-score, and 0.9951 ROC–AUC, indicating reliable adaptive behavior across thresholds. These results suggest that policy-driven adaptation can improve robustness and budget efficiency for hybrid quantum–classical optimization in realistic NISQ settings.

International Conference on Knowledge Engineering and Communication Systems (ICKECS)•Apr 24, 2026•0 citations
Quantum Reinforcement Learning (QRL) represents policies as variational quantum circuits (VQCs), making it attractive for combinatorial optimization such as the Capacitated Vehicle Routing Problem (CVRP). On noisy intermediate-scale quantum (NISQ) hardware, however, decoherence degrades fidelity and destabilizes learning, and conventional error mitigation is applied statically without regard to the learning context. We introduce Adaptive Policy-Guided Error Mitigation (APGEM), a controller that selects among Zero-Noise Extrapolation (ZNE), Probabilistic Error Cancellation (PEC), Clifford Data Regression (CDR), and Readout Error Mitigation (REM) online, driven by a fidelity, entropy, and cost aware utility function and an epsilon-greedy rule over temporal-difference Q-scores. We evaluate on a realistic urban-logistics testbed, a Delhi-based CVRP over real landmarks with geodesic inter-node costs, exercised across five noise families and four severity levels. On this instance, the QRL agent outperforms constructive heuristics and approaches metaheuristics, while mitigation restores approximation ratios from 0.84-0.87 to 0.92-0.94 under high noise. The controller shifts from a CDR-dominated regime under short training horizons to a balanced deployment across all four techniques under longer horizons, indicating genuine regime-dependent selection. These preliminary results position adaptive, learning-aware mitigation as a practical route to noise-resilient QRL.
Quantum Reinforcement Learning (QRL) integrates reinforcement learning with parameterized quantum circuits and is a promising approach to combinatorial optimization. On Noisy Intermediate-Scale Quantum (NISQ) devices, however, decoherence, gate imperfections, and measurement errors reduce policy quality and make learning less reliable. Existing error mitigation techniques are generally applied as fixed corrections that do not adapt to changing noise conditions or to the evolving state of training. This work presents Adaptive Policy-Guided Error Mitigation (APGEM) as a context-aware orchestration layer of the hybrid quantum-classical training loop that dynamically selects the most suitable mitigation strategy during QRL training. APGEM evaluates Zero-Noise Extrapolation (ZNE), Probabilistic Error Cancellation (PEC), Clifford Data Regression (CDR), and Readout Error Mitigation (REM) using policy-level indicators, including quantum-state fidelity, policy entropy, cumulative reward, and approximation ratio, and integrates the selected strategy directly into the reinforcement learning loop. The framework is evaluated on the Capacitated Vehicle Routing Problem (CVRP), a representative NP-hard problem in urban logistics, under a range of NISQ noise models and noise levels. APGEM consistently outperforms conventional static mitigation methods, reaches approximately 94% of the utility of an oracle strategy, maintains higher quantum-state fidelity as noise increases, and produces more stable learning behaviour throughout training. Ablation studies show that the framework learns context-aware mitigation policies that adapt to different noise environments and circuit execution conditions. These findings demonstrate that integrating adaptive error mitigation into the learning process substantially improves the robustness and reliability of QRL on NISQ hardware.
Error mitigation stands between variational quantum algorithms and useful results on today's noisy hardware, yet in practice a mitigation method is usually chosen once, by hand, and applied unchanged for the life of an experiment. This is a poor fit for quantum machine learning (QML), where the circuit and the noise drift as training proceeds, so the best strategy in one regime is often wrong in another. We present a generalized form of Adaptive Policy-Guided Error Mitigation (APGEM), which treats the choice of mitigation technique as an online decision made from an algorithm's own feedback. A single contextual-bandit controller observes signals any variational algorithm already produces, such as fidelity, entropy, reward or loss, and gradient behavior, and selects among Zero-Noise Extrapolation, Probabilistic Error Cancellation, Measurement Error Mitigation, Dynamical Decoupling, and circuit optimization per step. Because it depends only on this shared feedback interface, the framework applies unchanged across supervised, unsupervised, reinforcement, and hybrid quantum-classical learning. Evaluated on five paradigms across 80 algorithm-and-noise conditions, adaptive selection reaches 95.5% of an oracle that always picks the best technique and significantly outperforms all six fixed strategies (Friedman χ2=92.18χ^{2}=92.18χ2=92.18, p≈1.1×10−17p\approx1.1\times10^{-17}p≈1.1×10−17; pairwise Wilcoxon p<4×10−6p<4\times10^{-6}p<4×10−6). The learned policy is noise-aware: its favored technique shifts as depolarizing and readout error rise. On noise models from eight real IBM devices, APGEM tracks the oracle almost exactly (99.9% of oracle utility) at a flat cost of roughly 1.3×1041.3\times10^{4}1.3×104 shots from three to eight qubits.
Quantum reinforcement learning (QRL) is a prospective system that can solve sequential control problems with quantum control, but the problem of hardware noise and decoherence cripples its application in noisy intermediate-scale quantum (NISQ) systems. This paper introduces a framework of Zero-Noise Quantum Reinforcement Learning (ZN-QRL), which directly includes the noise-resilient learning framework of zero-noise extrapolation (ZNE) into the policy optimization procedure. The presented architecture is implemented to perform parameterized quantum policies using amplified levels of noise and interpolates reward signal on the noise-free limit of a quantum system, where the learning agent is free to optimize policies as it would in an ideal environment with a quantum noisefree system but does not need to fully correct the error. Detailed simulation performance of quantum control benchmarks, such as state transfer and gate synthesis control, indicate that ZN-QRL is always better than standard variational QRL and post-hoc error-reducing control. In particular, the proposed framework attains control fidelity up to 30% greater, convergence is faster and more stable and performance is robust over a large dynamic depolarizing noise. Moreover, ZN-QRL also exhibits higher scalability and is able to maintain a steady learning rate with greater circuit depth and qubit count, therefore illustrating its usefulness in practical use of quantum control on existing NISQ devices.
Variational quantum circuits (VQCs) are central to near-term quantum computing, yet their practical deployment is severely hindered by noise. While existing error mitigation methods, such as zero-noise extrapolation (ZNE), typically assume static noise, real noisy intermediate-scale quantum (NISQ) systems exhibit dynamic, time-varying noise that remains largely unaddressed. To overcome this critical gap, our work introduces a novel adaptive noise mitigation framework for VQCs that integrates ZNE with contextual multi-armed bandits (CMAB), enabling dynamic, context-aware selection of circuit-folding levels based on ansatz parameters (e.g., depth, parameter count) and the evolving noise environment. Unlike fixed-fold or heuristic ZNE, our approach uses online adaptation to improve the accuracy of ZNE and reduce redundant quantum circuit executions. Our extensive simulations and experiments on real quantum hardware reveal the following important properties: (i) deeper VQCs accumulate noise, degrading accuracy and increasing the number of quantum circuit executions; (ii) ZNE restores estimator fidelity when the folding level is chosen appropriately; and (iii) CMAB-guided folding cuts quantum circuit execution round trips by up to 40\%, bytes exchanged by up to 35\%, and end-to-end cost by up to 30\% under a 10~Mbps budget, with up to 6.9\% higher estimator fidelity (CIFAR-10, depth 3, noise band η=0.05η=0.05η=0.05), versus fixed-fold and grid-search ZNE. These results demonstrate substantial performance gains over existing noise mitigation methods, underscoring the effectiveness of our design in supporting robust noise mitigation for VQCs. The source code is also publicly released to support reproducibility.
Near-term quantum processors operate in the noisy intermediate-scale quantum (NISQ) region, where it is impractical to implement fault-tolerant error correction. Quantum Error Mitigation (QEM) provides a practical alternative, but most existing approaches rely on computationally intensive classical resources which are impractical to implement in embedded or edge-controlled systems. This work presents an adaptive, hardware-aware QEM framework designed for resource-constrained classical processors, demonstrated using a Raspberry Pi 5 as an edge controller for IBM Quantum hardware. A deep neural network predicts circuit fidelity and entropy from circuit and hardware features, enabling an online fuzzy-logic policy selector to choose among no mitigation, dynamical decoupling, and zero-noise extrapolation. Using real hardware feedback, an adaptive bias mechanism update policy was developed. The system operates without full-state simulation or offline recalibration and is evaluated on both randomized and benchmark-referenced circuits. Results show stable mitigation behaviour across depth regimes, primarily preventing fidelity degradation and selectively improving output similarity where mitigation is effective. This work demonstrates the feasibility of adaptive QEM deployment on classical edge devices under strict resource constraints.
Variational quantum algorithms (VQAs) are promising for near-term noisy intermediate-scale quantum (NISQ) devices, but their performance is often limited by device noise, finite-shot uncertainty, and nonstationary behavior that destabilize optimization. This paper proposes a cost-aware closed-loop hybrid framework (Adaptive V16) that augments a standard VQA loop with an online decision policy to adapt measurement effort and mitigation actions during execution. At each iteration, the controller uses runtime signals such as objective progress and uncertainty to select an action comprising the shot budget, mitigation mode, and step-scaling factor, explicitly trading solution improvement against resource overhead under a fixed budget. Experimental evaluation on a representative molecular Hamiltonian optimization task shows that Adaptive V16 achieves a lower final energy than a static VQE baseline and reduces the absolute error from 0.1391 to 0.0657. The controller’s decision module also demonstrates strong predictive performance with 0.9700 accuracy, 0.9595 F1-score, and 0.9951 ROC–AUC, indicating reliable adaptive behavior across thresholds. These results suggest that policy-driven adaptation can improve robustness and budget efficiency for hybrid quantum–classical optimization in realistic NISQ settings.