Abstract The paper introduces a novel hybrid Feedback-Based Quantum Optimization (FBQO) framework that integrates reinforcement learning (RL) for adaptive parameter control and Kalman filters for noise mitigation to enhance quantum optimization on noisy intermediate-scale quantum (NISQ) devices. Unlike traditional quantum Approximate optimization algorithm (QAOA), the proposed method dynamically tunes parameters through learned policies and statistically filtered feedback, enabling faster convergence and greater noise resilience. Key contributions include the formulation of quantum optimization as a Markov Decision Process, integration of deep quantum networks (DQNs) for adaptive control, and the use of Kalman filtering for robust state estimation. Experimental results on the Max-Cut problem demonstrate superior performance in convergence rate, stability, and optimization accuracy over existing techniques. The main finding is that RL-FBQO achieves convergence in 10–20 iterations, compared to 20–30 for FBQO and 40–50 for QAOA, with superior stability.
Abstract The paper introduces a novel hybrid Feedback-Based Quantum Optimization (FBQO) framework that integrates reinforcement learning (RL) for adaptive parameter control and Kalman filters for noise mitigation to enhance quantum optimization on noisy intermediate-scale quantum (NISQ) devices. Unlike traditional quantum Approximate optimization algorithm (QAOA), the proposed method dynamically tunes parameters through learned policies and statistically filtered feedback, enabling faster convergence and greater noise resilience. Key contributions include the formulation of quantum optimization as a Markov Decision Process, integration of deep quantum networks (DQNs) for adaptive control, and the use of Kalman filtering for robust state estimation. Experimental results on the Max-Cut problem demonstrate superior performance in convergence rate, stability, and optimization accuracy over existing techniques. The main finding is that RL-FBQO achieves convergence in 10–20 iterations, compared to 20–30 for FBQO and 40–50 for QAOA, with superior stability.
Adaptive quantum computing control is important for the stability and efficiency of quantum systems, especially in the presence of dynamic environmental noise and hardware fluctuations. We present a unified strategy for machine learning (ML) techniques to improve adaptive quantum control in two main directions: optimization speed and out-of-sample error. Here, we propose a hybrid learning method combining reinforcement learning (RL), deep neural networks (DNNs), and quantum-inspired models to actively and adaptively update quantum gate parameters and error mitigation strategies on the fly. Embedding of quantum noise models directly into the learning allows the system to predict and correct for decoherence, gate errors and measurement inaccuracy before they affect computational fidelity. Using extensive simulations as well as experimental validation on noisy intermediate-scale quantum (NISQ) processors, our improved ML model achieves a substantially higher fidelity and robustness compared to standard model-free and static control approaches. We introduce a novel feedback-loop mechanism based on online learning algorithms enabling the system to adjust for changing noise profiles and hardware drift without retraining. The optimization part uses metaheuristic methods to quickly converge to control parameters that perform well, and the error prevention mechanism features anomaly detection and prediction correction layers to minimize the effects of cumulative decoherence. The results demonstrate that our adaptive control framework can be used to not only speed up the convergence in training quantum algorithms, but also sustain the performance of gates against error at a variety of error rates with the reduction of the real-time impact of the error up to 35 %. This work highlights the promise of machine learningaugmented quantum control for improving reliability and scalability in quantum computing and serves as a stepping stone for future incorporation with fault-tolerant designs.
The quantum approximate optimization algorithm (QAOA), as a hybrid quantum/classical algorithm, has received much interest recently. QAOA can also be viewed as a variational ansatz for quantum control. However, its direct application to emergent quantum technology encounters additional physical constraints: (i) the states of the quantum system are not observable; (ii) obtaining the derivatives of the objective function can be computationally expensive or even inaccessible in experiments, and (iii) the values of the objective function may be sensitive to various sources of uncertainty, as is the case for noisy intermediate-scale quantum (NISQ) devices. Taking such constraints into account, we show that policy-gradient-based reinforcement learning (RL) algorithms are well suited for optimizing the variational parameters of QAOA in a noise-robust fashion, opening up the way for developing RL techniques for continuous quantum control. This is advantageous to help mitigate and monitor the potentially unknown sources of errors in modern quantum simulators. We analyze the performance of the algorithm for quantum state transfer problems in single- and multi-qubit systems, subject to various sources of noise such as error terms in the Hamiltonian, or quantum uncertainty in the measurement process. We show that, in noisy setups, it is capable of outperforming state-of-the-art existing optimization algorithms.
The hardware noise and drift, combined with the fragility of stationary hybrid algorithms like the variational quantum eigensolver (VQE), limit the usefulness of noise quantum advantage accessed through Noisy intermediate-scale quantum (NISQ) processors, but allow near-term quantum advantage. In this paper, a Hybrid Quantum-Classical Adaptive Intelligence Framework is suggested, which bridges the gap between quantum hardware, a parameterized quantum circuit, explicit error-mitigation routines, and a controller trained through learning. The quantum subsystem prepares variational states and calculates the expectation values of the problem Hamiltonian, and an AI/ML model approximates an online noise probability signal and moves an optimizer based on reinforcement learning (RL). The RL policy chooses the parameter updates and enables mitigation measures depending on noise-sensitive state functions, such as energy, gradient norm, and estimated noise level. It was demonstrated experimentally using a simulated NISQ-style molecular Hamiltonian that the adaptive controller can reduce the error in the absolute ground state of the system by about 52.8 percent versus a standard static VQE baseline using the same ansatz. The integrated classifier that drives the process of mitigation is accurate with 97 percent accuracy, 100 percent precision, 92 percent recall, 95.9 F1-score, and 99.5 AUC, which shows reliable decision-making with minimal false alarms. All these findings indicate that the close-knit quantum-classical adaptivity can significantly contribute to the robustness and accuracy of VQE-like workloads on NISQ and serve as a scalable template to design noise-aware hybrid algorithms in the future.
This paper presents a novel approach to designing adaptive quantum control policies using reinforcement learning (RL). Traditional methods for quantum control often rely on hand-designed pulse shapes or iterative optimization techniques, which can be computationally expensive and may not generalize well to different systems or desired operations. We propose a framework where an RL agent learns to dynamically adjust quantum control parameters in real-time, based on the system's state and the objective of achieving a specific quantum gate with high fidelity. The core of our approach lies in formulating the quantum control problem as a Markov Decision Process (MDP) and utilizing an RL algorithm to train a policy that maps system states to control parameters. We demonstrate the feasibility and effectiveness of this method through a theoretical analysis and a simplified numerical simulation. The resulting adaptive control policies offer a significant advantage over traditional methods, particularly for complex quantum systems and demanding fidelity requirements. The key contributions are the integration of RL for adaptive control and the formalization of the problem as an MDP.
This paper investigates the application of reinforcement learning (RL) for adaptive quantum control. Traditional quantum control methods often rely on pre-designed pulse shapes optimized for specific scenarios, lacking adaptability to variations in system parameters or environmental noise. This work proposes a novel framework where an RL agent learns to dynamically adjust quantum control pulses in real-time, maximizing the fidelity of quantum operations. The agent receives feedback from the quantum system, typically measured through state variables, and utilizes this information to optimize the control pulse sequence. This adaptive approach addresses the limitations of static control schemes and promises enhanced robustness and performance in complex quantum systems. The core claim centers on utilizing reinforcement learning to design optimal quantum control pulses. The central mechanism involves a trained controller dynamically adjusting pulses based on system feedback. The presented methodology offers a new approach to quantum control, particularly relevant in noisy environments and systems with parameter variations. The research demonstrates the potential of RL for achieving superior quantum control outcomes compared to conventional techniques. ---
Feedback-based methods have gained significant attention as an alternative training paradigm for the Quantum Approximate Optimization Algorithm (QAOA) in solving combinatorial optimization problems such as MAX-CUT. In particular, Quantum Lyapunov Control (QLC) employs feedback-driven control laws that guarantee monotonic non-decreasing objective values, can substantially reduce the training overhead of QAOA, and mitigate barren plateaus. However, these methods might require long control sequences, leading to sub-optimal convergence rates. In this work, we propose a hybrid method that incorporates per-layer gradient estimation to accelerate the convergence of QLC while preserving its low training overhead and stability guarantees. By leveraging layer-wise gradient information, the proposed approach selects near-optimal control parameters, resulting in significantly faster convergence and improved robustness. We validate the effectiveness of the method through extensive numerical experiments across a range of problem instances and optimization settings.