Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

International Conference on Information Science and Communication Technology (ICISCT)

Zero-Noise Quantum Reinforcement Learning: Error-Resilient Learning Architectures for Scalable Quantum Control Systems

Kainat Rizwan

Published Apr 15, 2026• 0 citations
Publisher

Abstract

Quantum reinforcement learning (QRL) is a prospective system that can solve sequential control problems with quantum control, but the problem of hardware noise and decoherence cripples its application in noisy intermediate-scale quantum (NISQ) systems. This paper introduces a framework of Zero-Noise Quantum Reinforcement Learning (ZN-QRL), which directly includes the noise-resilient learning framework of zero-noise extrapolation (ZNE) into the policy optimization procedure. The presented architecture is implemented to perform parameterized quantum policies using amplified levels of noise and interpolates reward signal on the noise-free limit of a quantum system, where the learning agent is free to optimize policies as it would in an ideal environment with a quantum noisefree system but does not need to fully correct the error. Detailed simulation performance of quantum control benchmarks, such as state transfer and gate synthesis control, indicate that ZN-QRL is always better than standard variational QRL and post-hoc error-reducing control. In particular, the proposed framework attains control fidelity up to 30% greater, convergence is faster and more stable and performance is robust over a large dynamic depolarizing noise. Moreover, ZN-QRL also exhibits higher scalability and is able to maintain a steady learning rate with greater circuit depth and qubit count, therefore illustrating its usefulness in practical use of quantum control on existing NISQ devices.

DOI
10.1109/icisct67740.2026.11576471

Related papers

Adversarial Robust Quantum Reinforcement Learning: Defending Variational Policies Against Quantum-State Perturbations

Kainat Rizwan, Mir Wajid Ali

Quantum reinforcement learning (QRL) has shown potential significant potential for solving difficult sequence decision-making with the power of representation of quantum computing. However quantum states and their measurements are sensitive, and this implies that such systems are vulnerable to adversarial perturbation together with hardware noise. Avoiding variational quantum policy being misled by any but small, intelligible perturbations of quantum states, inputs or measurement outcomes can generate incorrect actions and unstable learning behaviour. This paper has provided an adversarially resilient quantum reinforcement learning (AR-QRL) architecture, which specifically aims to address these security and dependability challenges. It is a mixture of adversarial training, robust quantum states encoding and variance-sensitive policy optimization, which defends variational quantum policies against malicious quantumstate perturbation. Benchmarking quantum-control experiments have demonstrated improvements of 30%-40% in control fidelity to that of standard QRL, up to a 75% decreased reward variance, and a 40% acceleration of convergence under adversarial conditions.. These findings suggest the impact of adversarial robustness in improving effective and secure quantum reinforcement learning of noisy intermediate-scale quantum (NISQ) devices.

International Bhurban Conference on Applied Sciences and Technology (IBCAST)•Aug 1, 2026•0 citations

Noise-resilient quantum reinforcement learning

Jing-Ci Yue, Jun‐Hong An

As a branch of quantum machine learning, quantum reinforcement learning (QRL) aims to solve complex sequential decision-making problems more efficiently and effectively than its classical counterpart by exploiting quantum resources. However, in the noisy intermediate-scale quantum (NISQ) era, its realization is challenged by the ubiquitous noise-induced decoherence. Here, we propose a noise-resilient QRL scheme for a quantum eigensolver with a two-level system as an agent. By investigating the non-Markovian decoherence effect on the QRL for solving the eigenstates of the agent-environment interaction Hamiltonian, we find that the formation of a bound state in the energy spectrum of the total agent-noise system restores the QRL performance to that in the noiseless case. Providing a universal physical mechanism to suppress the decoherence effect on quantum machine learning, our result lays the foundation for designing NISQ algorithms and offers a guideline for their practical implementation.

arXiv:2508.20601•Physical Review Applied•Mar 26, 2026•0 citations

Context-Aware Error Mitigation Orchestration for Hybrid Quantum Reinforcement Learning on NISQ Systems

Bisma Majid, Shabir Ahmed Sofi, Mir Mohammad Yousuf

Quantum Reinforcement Learning (QRL) integrates reinforcement learning with parameterized quantum circuits and is a promising approach to combinatorial optimization. On Noisy Intermediate-Scale Quantum (NISQ) devices, however, decoherence, gate imperfections, and measurement errors reduce policy quality and make learning less reliable. Existing error mitigation techniques are generally applied as fixed corrections that do not adapt to changing noise conditions or to the evolving state of training. This work presents Adaptive Policy-Guided Error Mitigation (APGEM) as a context-aware orchestration layer of the hybrid quantum-classical training loop that dynamically selects the most suitable mitigation strategy during QRL training. APGEM evaluates Zero-Noise Extrapolation (ZNE), Probabilistic Error Cancellation (PEC), Clifford Data Regression (CDR), and Readout Error Mitigation (REM) using policy-level indicators, including quantum-state fidelity, policy entropy, cumulative reward, and approximation ratio, and integrates the selected strategy directly into the reinforcement learning loop. The framework is evaluated on the Capacitated Vehicle Routing Problem (CVRP), a representative NP-hard problem in urban logistics, under a range of NISQ noise models and noise levels. APGEM consistently outperforms conventional static mitigation methods, reaches approximately 94% of the utility of an oracle strategy, maintains higher quantum-state fidelity as noise increases, and produces more stable learning behaviour throughout training. Ablation studies show that the framework learns context-aware mitigation policies that adapt to different noise environments and circuit execution conditions. These findings demonstrate that integrating adaptive error mitigation into the learning process substantially improves the robustness and reliability of QRL on NISQ hardware.

cs.LGCross-listedarXiv:2610.01253•Oct 2, 2026•0 citations

APGEM: Adaptive Policy-Guided Error Mitigation for Quantum Reinforcement Learning on a Real-World CVRP Case Study

Shabir Ahmad Sofi, Bisma Majid, Mir Mohammad Yousuf

Quantum Reinforcement Learning (QRL) represents policies as variational quantum circuits (VQCs), making it attractive for combinatorial optimization such as the Capacitated Vehicle Routing Problem (CVRP). On noisy intermediate-scale quantum (NISQ) hardware, however, decoherence degrades fidelity and destabilizes learning, and conventional error mitigation is applied statically without regard to the learning context. We introduce Adaptive Policy-Guided Error Mitigation (APGEM), a controller that selects among Zero-Noise Extrapolation (ZNE), Probabilistic Error Cancellation (PEC), Clifford Data Regression (CDR), and Readout Error Mitigation (REM) online, driven by a fidelity, entropy, and cost aware utility function and an epsilon-greedy rule over temporal-difference Q-scores. We evaluate on a realistic urban-logistics testbed, a Delhi-based CVRP over real landmarks with geodesic inter-node costs, exercised across five noise families and four severity levels. On this instance, the QRL agent outperforms constructive heuristics and approaches metaheuristics, while mitigation restores approximation ratios from 0.84-0.87 to 0.92-0.94 under high noise. The controller shifts from a CDR-dominated regime under short training horizons to a balanced deployment across all four techniques under longer horizons, indicating genuine regime-dependent selection. These preliminary results position adaptive, learning-aware mitigation as a practical route to noise-resilient QRL.

arXiv:2609.18219•Sep 16, 2026•1 citation

A New Framework for Quantum Reinforcement Learning

Alireza Tavakoli, Mohsen Heidari

Quantum reinforcement learning (QRL) has emerged as a promising approach for controlling quantum systems and accelerating learning tasks with quantum resources. However, most existing QRL formulations still retain a classical reinforcement learning interface: states and actions are often encoded in computational bases and rewards are extracted through measurements. This interface is restrictive for genuinely quantum environments: choosing a measurement can discard entanglement information, while repeated intermediate measurements collapse the evolving state and require costly re-preparation. This motivates a fully QRL framework in which the agent, environment, rewards, and return accumulation are all quantum. In this paper, we take a step toward this goal and introduce a new QRL framework in which both the policy and the environment are modeled by conditional quantum channels. We then propose a quantum policy-gradient algorithm for parameterized conditional quantum channels with a trainable control basis. We also derive finite- and infinite-horizon gradient estimators using a new parameter-shift rule. This rule is needed because policy parameters are shared across repeated interaction blocks and the infinite-horizon objective is not a finite circuit; rather than shifting every occurrence and evaluating the whole trajectory, our estimator shifts only one sampled policy block. Sampling this block from a geometric distribution yields an unbiased gradient estimator under bounded rewards. Finally, we establish convergence of the resulting stochastic gradient-ascent procedure to stationary points under standard smoothness and step-size assumptions.

arXiv:2611.14731•Nov 10, 2026•0 citations

Adaptive Noise-Aware Variational Quantum Classifier for Robust Machine Learning on NISQ Devices

Vinodh Kumar S, Pravin P

The execution of Variational Quantum Algorithms on Noisy Intermediate-Scale Quantum hardware is severely impacted by hardware noise variations over time and decoherence. This work introduces an Adaptive Noise-Aware Variational Quantum Classifier (ANAVQC) that integrates Zero-Noise Extrapolation (ZNE) dynamically into the training loop to counter variations. The framework approximates the instantaneous depolarizing noise from calibration and adapts noise scaling and linear extrapolation to estimate noise-free expectation values at training. A two-qubit parameterized quantum circuit is built and simulated in MATLAB, with the inclusion of stochastic gradient descent coupled with parameter-shift-based gradients. The model is conditioned on a synthetic binary classification data under a time-varying depolarizing noise profile and exhibits improved convergence stability and classification accuracy over non-adaptive methods. The simulation results identify that adaptive ZNE increases model robustness against time-varying noise and offers a scalable route to reliable quantum machine learning on practical NISQ hardware. The current ANAVQC scheme is extendable to multi-qubit platforms and practical quantum backends for the purposes of future experimental testing.

International Conference on Intelligent Computing and Automation for Sustainable Solutions (ICASS)•Feb 12, 2026•0 citations
Quantum reinforcement learning (QRL) is a prospective system that can solve sequential control problems with quantum control, but the problem of hardware noise and decoherence cripples its application in noisy intermediate-scale quantum (NISQ) systems. This paper introduces a framework of Zero-Noise Quantum Reinforcement Learning (ZN-QRL), which directly includes the noise-resilient learning framework of zero-noise extrapolation (ZNE) into the policy optimization procedure. The presented architecture is implemented to perform parameterized quantum policies using amplified levels of noise and interpolates reward signal on the noise-free limit of a quantum system, where the learning agent is free to optimize policies as it would in an ideal environment with a quantum noisefree system but does not need to fully correct the error. Detailed simulation performance of quantum control benchmarks, such as state transfer and gate synthesis control, indicate that ZN-QRL is always better than standard variational QRL and post-hoc error-reducing control. In particular, the proposed framework attains control fidelity up to 30% greater, convergence is faster and more stable and performance is robust over a large dynamic depolarizing noise. Moreover, ZN-QRL also exhibits higher scalability and is able to maintain a steady learning rate with greater circuit depth and qubit count, therefore illustrating its usefulness in practical use of quantum control on existing NISQ devices.
Quantum reinforcement learning (QRL) has shown potential significant potential for solving difficult sequence decision-making with the power of representation of quantum computing. However quantum states and their measurements are sensitive, and this implies that such systems are vulnerable to adversarial perturbation together with hardware noise. Avoiding variational quantum policy being misled by any but small, intelligible perturbations of quantum states, inputs or measurement outcomes can generate incorrect actions and unstable learning behaviour. This paper has provided an adversarially resilient quantum reinforcement learning (AR-QRL) architecture, which specifically aims to address these security and dependability challenges. It is a mixture of adversarial training, robust quantum states encoding and variance-sensitive policy optimization, which defends variational quantum policies against malicious quantumstate perturbation. Benchmarking quantum-control experiments have demonstrated improvements of 30%-40% in control fidelity to that of standard QRL, up to a 75% decreased reward variance, and a 40% acceleration of convergence under adversarial conditions.. These findings suggest the impact of adversarial robustness in improving effective and secure quantum reinforcement learning of noisy intermediate-scale quantum (NISQ) devices.
As a branch of quantum machine learning, quantum reinforcement learning (QRL) aims to solve complex sequential decision-making problems more efficiently and effectively than its classical counterpart by exploiting quantum resources. However, in the noisy intermediate-scale quantum (NISQ) era, its realization is challenged by the ubiquitous noise-induced decoherence. Here, we propose a noise-resilient QRL scheme for a quantum eigensolver with a two-level system as an agent. By investigating the non-Markovian decoherence effect on the QRL for solving the eigenstates of the agent-environment interaction Hamiltonian, we find that the formation of a bound state in the energy spectrum of the total agent-noise system restores the QRL performance to that in the noiseless case. Providing a universal physical mechanism to suppress the decoherence effect on quantum machine learning, our result lays the foundation for designing NISQ algorithms and offers a guideline for their practical implementation.
Quantum Reinforcement Learning (QRL) integrates reinforcement learning with parameterized quantum circuits and is a promising approach to combinatorial optimization. On Noisy Intermediate-Scale Quantum (NISQ) devices, however, decoherence, gate imperfections, and measurement errors reduce policy quality and make learning less reliable. Existing error mitigation techniques are generally applied as fixed corrections that do not adapt to changing noise conditions or to the evolving state of training. This work presents Adaptive Policy-Guided Error Mitigation (APGEM) as a context-aware orchestration layer of the hybrid quantum-classical training loop that dynamically selects the most suitable mitigation strategy during QRL training. APGEM evaluates Zero-Noise Extrapolation (ZNE), Probabilistic Error Cancellation (PEC), Clifford Data Regression (CDR), and Readout Error Mitigation (REM) using policy-level indicators, including quantum-state fidelity, policy entropy, cumulative reward, and approximation ratio, and integrates the selected strategy directly into the reinforcement learning loop. The framework is evaluated on the Capacitated Vehicle Routing Problem (CVRP), a representative NP-hard problem in urban logistics, under a range of NISQ noise models and noise levels. APGEM consistently outperforms conventional static mitigation methods, reaches approximately 94% of the utility of an oracle strategy, maintains higher quantum-state fidelity as noise increases, and produces more stable learning behaviour throughout training. Ablation studies show that the framework learns context-aware mitigation policies that adapt to different noise environments and circuit execution conditions. These findings demonstrate that integrating adaptive error mitigation into the learning process substantially improves the robustness and reliability of QRL on NISQ hardware.
Quantum Reinforcement Learning (QRL) represents policies as variational quantum circuits (VQCs), making it attractive for combinatorial optimization such as the Capacitated Vehicle Routing Problem (CVRP). On noisy intermediate-scale quantum (NISQ) hardware, however, decoherence degrades fidelity and destabilizes learning, and conventional error mitigation is applied statically without regard to the learning context. We introduce Adaptive Policy-Guided Error Mitigation (APGEM), a controller that selects among Zero-Noise Extrapolation (ZNE), Probabilistic Error Cancellation (PEC), Clifford Data Regression (CDR), and Readout Error Mitigation (REM) online, driven by a fidelity, entropy, and cost aware utility function and an epsilon-greedy rule over temporal-difference Q-scores. We evaluate on a realistic urban-logistics testbed, a Delhi-based CVRP over real landmarks with geodesic inter-node costs, exercised across five noise families and four severity levels. On this instance, the QRL agent outperforms constructive heuristics and approaches metaheuristics, while mitigation restores approximation ratios from 0.84-0.87 to 0.92-0.94 under high noise. The controller shifts from a CDR-dominated regime under short training horizons to a balanced deployment across all four techniques under longer horizons, indicating genuine regime-dependent selection. These preliminary results position adaptive, learning-aware mitigation as a practical route to noise-resilient QRL.
Quantum reinforcement learning (QRL) has emerged as a promising approach for controlling quantum systems and accelerating learning tasks with quantum resources. However, most existing QRL formulations still retain a classical reinforcement learning interface: states and actions are often encoded in computational bases and rewards are extracted through measurements. This interface is restrictive for genuinely quantum environments: choosing a measurement can discard entanglement information, while repeated intermediate measurements collapse the evolving state and require costly re-preparation. This motivates a fully QRL framework in which the agent, environment, rewards, and return accumulation are all quantum. In this paper, we take a step toward this goal and introduce a new QRL framework in which both the policy and the environment are modeled by conditional quantum channels. We then propose a quantum policy-gradient algorithm for parameterized conditional quantum channels with a trainable control basis. We also derive finite- and infinite-horizon gradient estimators using a new parameter-shift rule. This rule is needed because policy parameters are shared across repeated interaction blocks and the infinite-horizon objective is not a finite circuit; rather than shifting every occurrence and evaluating the whole trajectory, our estimator shifts only one sampled policy block. Sampling this block from a geometric distribution yields an unbiased gradient estimator under bounded rewards. Finally, we establish convergence of the resulting stochastic gradient-ascent procedure to stationary points under standard smoothness and step-size assumptions.
The execution of Variational Quantum Algorithms on Noisy Intermediate-Scale Quantum hardware is severely impacted by hardware noise variations over time and decoherence. This work introduces an Adaptive Noise-Aware Variational Quantum Classifier (ANAVQC) that integrates Zero-Noise Extrapolation (ZNE) dynamically into the training loop to counter variations. The framework approximates the instantaneous depolarizing noise from calibration and adapts noise scaling and linear extrapolation to estimate noise-free expectation values at training. A two-qubit parameterized quantum circuit is built and simulated in MATLAB, with the inclusion of stochastic gradient descent coupled with parameter-shift-based gradients. The model is conditioned on a synthetic binary classification data under a time-varying depolarizing noise profile and exhibits improved convergence stability and classification accuracy over non-adaptive methods. The simulation results identify that adaptive ZNE increases model robustness against time-varying noise and offers a scalable route to reliable quantum machine learning on practical NISQ hardware. The current ANAVQC scheme is extendable to multi-qubit platforms and practical quantum backends for the purposes of future experimental testing.