Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

Journal of Applied Automation Technologies

Quantum Gradient Descent in Neural Network Training Optimization

Zacharias Rallis, Kyriakos Vougiouklis

Published Aug 24, 2023• 0 citations
Publisher

Abstract

Optimisation of training still faces challenges due to an ill-conditioned loss surface and noisy gradient signals; at the same time, limited computational resources also restrict training options. Quantum Gradient Descent as a Hybrid Optimisation Strategy for Neural Network Training. The proposed noise-resilient quantum gradient descent framework maps selected gradient components to parameterised quantum circuits, estimates directional derivatives via parameter-shift measurements, and returns stable updates to the classical optimizer. It is not directly substituted for backpropagation; instead, it is a type of controllable gradient module that can be added to sensitive layers or low-dimensional projection heads. Add adaptive shot scheduling, damped momentum and layer-wise trust constraints to reduce estimator variance and prevent unstable quantum updates. Representative classification tasks are selected as the subjects of experiments for convergence speed, validation accuracy, gradient fidelity, measurement cost and noise robustness. Based on the above analysis, the new optimizer outperforms standard SGD in terms of final accuracy by 1.6% - 3.2% when using the same number of epochs; at the same time, it reduces the median gradient variance by 28.4% and maintains stable convergence even with an increase in simulated depolarizing noise from 0.001 to 0.015. Based on the above, it can be seen that Quantum Gradient Descent is not an all-purpose optimizer but rather a target-specific training accelerator for gradient-sensitive modules that can trade off sampling cost for more informative descent directions in measurement-aware update design.

DOI
10.64972/jaat.2023v1.304p18e:242-254

Related papers

Quantum-Inspired Stochastic Gradient Descent for Large-Scale Neural Networks

Jincheng Zhang

Training large-scale neural networks with traditional stochastic gradient descent (SGD) methods often faces significant challenges, including slow convergence rates and high computational costs. This paper proposes a novel approach, Quantum-Inspired Stochastic Gradient Descent (QISGD), designed to address these limitations. QISGD leverages principles inspired by quantum measurement processes, specifically employing a random projection operator to approximate the gradient. This technique aims to provide a more efficient and potentially faster way to update the network's parameters during training. The theoretical underpinnings of QISGD are presented, along with a detailed explanation of the algorithm's components. We demonstrate the potential benefits of QISGD through a conceptual analysis and outline a framework for future research and implementation. The core innovation lies in translating quantum measurement intuition into a practical optimization strategy for classical neural networks. The goal is to improve the training efficiency of large networks while retaining the benefits of SGD.

•Aug 28, 2026•0 citations

Hybrid Quantum-Classical Training in Quantum Neural Networks: A Framework for Bridging Parameterized Quantum Circuits and Classical Optimization

Matthew Busel

Quantum Neural Networks (QNNs) represent a compelling convergence of quantum mechanics and machine learning, yet their practical deployment remains constrained by noise, limited qubit counts, and the cost of full quantum execution. Hybrid quantum-classical (HQC) training offers a pragmatic path forward: parameterized quantum circuits (PQCs) process information in exponentially large Hilbert spaces while classical optimizers update parameters via gradient methods accessible on today's hardware. We present a modular HQC training framework, formalising the parameter-shift rule for hardware-compatible gradient estimation, characterising the barren-plateau phenomenon through a variance-decay analysis, and introducing noise-aware training strategies for NISQ devices. Empirical results from state-vector and shot-based simulation confirm measurable quantum advantage on quantum-structured tasks, with the phase classification benchmark improving +12.1% over a classical MLP baseline. The accompanying open-source library provides a clean abstraction between quantum simulation and classical optimisation, serving as a foundation for near-term quantum machine learning research.

•Mar 3, 2026•0 citations

Quantum-Inspired Stochastic Gradient Descent with Adaptive Noise Injection

Jincheng Zhang

This paper presents a novel optimization algorithm, Quantum-Inspired Stochastic Gradient Descent (QISGD), designed to accelerate convergence in training machine learning models. QISGD leverages concepts from quantum mechanics, specifically quantum tunneling and superposition, to introduce adaptive noise into gradient estimates. The algorithm dynamically adjusts the noise level based on the training progress, aiming to escape local minima more effectively and navigate the loss landscape with greater precision. Unlike traditional stochastic gradient descent (SGD) which relies solely on random perturbations, QISGD incorporates a nuanced noise strategy informed by quantum principles, offering a potentially more robust and efficient approach to optimization. The core idea is to mimic the probabilistic nature of quantum systems, allowing the algorithm to explore the search space more thoroughly. This research explores the theoretical underpinnings of QISGD and provides a framework for its implementation and evaluation. The algorithm's performance is assessed through simulations, demonstrating its potential to outperform standard SGD in specific scenarios.

•Sep 2, 2026•0 citations

Adaptive Grover-driven optimization for quantum-inspired deep learning: A gradient-free training framework

Irsa Sajjad, Huda M. Alshanbari, Mohammed M. A. Almazah +2 more

Training deep neural networks remains difficult due to vanishing gradients, non-convex loss surfaces, and hyperparameter sensitivity. These obstacles are compounded by quantum machine learning, where barren plateaus, circuit depth, and hardware noise restrict the applicability of gradient-based approaches. To overcome these drawbacks, this study presents adaptive Grover-driven parallel quantum optimization (AG-PQO), a hybrid, gradient-free scheme that leverages Grover's quadratic search speedup, along with adaptive loss-aware discretization and fidelity-based regularization. In contrast to more classical optimizers, such as Adam or evolutionary strategies (ES), which are either sensitive to the adequacy of the gradient update or exhibit poor scaling behavior, AG-PQO optimizes by performing Grover-accelerated candidate exploration across layers and reuses high-quality solutions in quantum memory caching. Testing indicates that AG-PQO yields higher accuracy, 2%–3% above Adam and ES, and faster convergence with less end-value loss than Adam, ES, and quantum feedforward-backpropagation (QFB). It is worth noting that AG-PQO remains stable at the simulated noise level of NISQ and has the potential to scale to near-term quantum processors.

AIMS Mathematics•Jan 1, 2025•4 citations

Quantum-aware gradient descent for hybrid machine learning architectures

Nadia Ahmed Sharna, Izzet F. Senturk

A viable approach for applying quantum computing to practical problems is hybrid quantum-classical machine learning (QML) systems. However, gradient discrepancies between quantum and classical components make it difficult to optimize such systems. For hybrid QML models, we suggest a new gradient descent technique called Quantum-Aware Gradient Descent (QAGD), which is intended to increase training stability and convergence. Our method addresses noise sensitivity and gradient scale mismatches by introducing layer-specific learning rate techniques and gradient normalization. The objective of this approach is to improve robustness and performance in noisy intermediate-scale quantum (NISQ) settings.

Quantum Computing, Communication, and Simulation•Mar 5, 2026•0 citations

Quantum-Inspired Optimization of Neural Network Training Dynamics

Jincheng Zhang

Training deep neural networks remains a computationally intensive and often challenging process. Traditional optimization methods, such as stochastic gradient descent (SGD) and its variants, frequently struggle to escape local minima and converge to optimal solutions, leading to suboptimal network performance. This paper proposes a novel approach to neural network training that leverages principles inspired by quantum mechanics. Specifically, we investigate the application of quantum-inspired optimization techniques, including simulated annealing and quantum walks, to dynamically adjust the training process. The core idea is to mimic the probabilistic exploration inherent in quantum systems to effectively navigate the complex loss landscape of neural networks. We formulate the training process as a quantum-inspired optimization problem, where the network's weights are treated as quantum bits (Qubits) and the optimization algorithm seeks to find the lowest energy state, analogous to finding the minimum loss. The proposed method demonstrates the potential for accelerating convergence and improving the overall accuracy of neural networks compared to conventional optimization strategies. Our analysis focuses on the key aspects of the approach, including the mathematical formulation of the quantum-inspired optimization problem and the selection of appropriate parameters to govern the exploration and exploitation phases. We present a theoretical framework for understanding the dynamics of this approach and discuss potential avenues for further research, including hybrid quantum-classical algorithms and the integration of quantum computing hardware.

•Sep 5, 2026•0 citations
Optimisation of training still faces challenges due to an ill-conditioned loss surface and noisy gradient signals; at the same time, limited computational resources also restrict training options. Quantum Gradient Descent as a Hybrid Optimisation Strategy for Neural Network Training. The proposed noise-resilient quantum gradient descent framework maps selected gradient components to parameterised quantum circuits, estimates directional derivatives via parameter-shift measurements, and returns stable updates to the classical optimizer. It is not directly substituted for backpropagation; instead, it is a type of controllable gradient module that can be added to sensitive layers or low-dimensional projection heads. Add adaptive shot scheduling, damped momentum and layer-wise trust constraints to reduce estimator variance and prevent unstable quantum updates. Representative classification tasks are selected as the subjects of experiments for convergence speed, validation accuracy, gradient fidelity, measurement cost and noise robustness. Based on the above analysis, the new optimizer outperforms standard SGD in terms of final accuracy by 1.6% - 3.2% when using the same number of epochs; at the same time, it reduces the median gradient variance by 28.4% and maintains stable convergence even with an increase in simulated depolarizing noise from 0.001 to 0.015. Based on the above, it can be seen that Quantum Gradient Descent is not an all-purpose optimizer but rather a target-specific training accelerator for gradient-sensitive modules that can trade off sampling cost for more informative descent directions in measurement-aware update design.
Training large-scale neural networks with traditional stochastic gradient descent (SGD) methods often faces significant challenges, including slow convergence rates and high computational costs. This paper proposes a novel approach, Quantum-Inspired Stochastic Gradient Descent (QISGD), designed to address these limitations. QISGD leverages principles inspired by quantum measurement processes, specifically employing a random projection operator to approximate the gradient. This technique aims to provide a more efficient and potentially faster way to update the network's parameters during training. The theoretical underpinnings of QISGD are presented, along with a detailed explanation of the algorithm's components. We demonstrate the potential benefits of QISGD through a conceptual analysis and outline a framework for future research and implementation. The core innovation lies in translating quantum measurement intuition into a practical optimization strategy for classical neural networks. The goal is to improve the training efficiency of large networks while retaining the benefits of SGD.
Quantum Neural Networks (QNNs) represent a compelling convergence of quantum mechanics and machine learning, yet their practical deployment remains constrained by noise, limited qubit counts, and the cost of full quantum execution. Hybrid quantum-classical (HQC) training offers a pragmatic path forward: parameterized quantum circuits (PQCs) process information in exponentially large Hilbert spaces while classical optimizers update parameters via gradient methods accessible on today's hardware. We present a modular HQC training framework, formalising the parameter-shift rule for hardware-compatible gradient estimation, characterising the barren-plateau phenomenon through a variance-decay analysis, and introducing noise-aware training strategies for NISQ devices. Empirical results from state-vector and shot-based simulation confirm measurable quantum advantage on quantum-structured tasks, with the phase classification benchmark improving +12.1% over a classical MLP baseline. The accompanying open-source library provides a clean abstraction between quantum simulation and classical optimisation, serving as a foundation for near-term quantum machine learning research.
This paper presents a novel optimization algorithm, Quantum-Inspired Stochastic Gradient Descent (QISGD), designed to accelerate convergence in training machine learning models. QISGD leverages concepts from quantum mechanics, specifically quantum tunneling and superposition, to introduce adaptive noise into gradient estimates. The algorithm dynamically adjusts the noise level based on the training progress, aiming to escape local minima more effectively and navigate the loss landscape with greater precision. Unlike traditional stochastic gradient descent (SGD) which relies solely on random perturbations, QISGD incorporates a nuanced noise strategy informed by quantum principles, offering a potentially more robust and efficient approach to optimization. The core idea is to mimic the probabilistic nature of quantum systems, allowing the algorithm to explore the search space more thoroughly. This research explores the theoretical underpinnings of QISGD and provides a framework for its implementation and evaluation. The algorithm's performance is assessed through simulations, demonstrating its potential to outperform standard SGD in specific scenarios.
Training deep neural networks remains difficult due to vanishing gradients, non-convex loss surfaces, and hyperparameter sensitivity. These obstacles are compounded by quantum machine learning, where barren plateaus, circuit depth, and hardware noise restrict the applicability of gradient-based approaches. To overcome these drawbacks, this study presents adaptive Grover-driven parallel quantum optimization (AG-PQO), a hybrid, gradient-free scheme that leverages Grover's quadratic search speedup, along with adaptive loss-aware discretization and fidelity-based regularization. In contrast to more classical optimizers, such as Adam or evolutionary strategies (ES), which are either sensitive to the adequacy of the gradient update or exhibit poor scaling behavior, AG-PQO optimizes by performing Grover-accelerated candidate exploration across layers and reuses high-quality solutions in quantum memory caching. Testing indicates that AG-PQO yields higher accuracy, 2%–3% above Adam and ES, and faster convergence with less end-value loss than Adam, ES, and quantum feedforward-backpropagation (QFB). It is worth noting that AG-PQO remains stable at the simulated noise level of NISQ and has the potential to scale to near-term quantum processors.
A viable approach for applying quantum computing to practical problems is hybrid quantum-classical machine learning (QML) systems. However, gradient discrepancies between quantum and classical components make it difficult to optimize such systems. For hybrid QML models, we suggest a new gradient descent technique called Quantum-Aware Gradient Descent (QAGD), which is intended to increase training stability and convergence. Our method addresses noise sensitivity and gradient scale mismatches by introducing layer-specific learning rate techniques and gradient normalization. The objective of this approach is to improve robustness and performance in noisy intermediate-scale quantum (NISQ) settings.
Training deep neural networks remains a computationally intensive and often challenging process. Traditional optimization methods, such as stochastic gradient descent (SGD) and its variants, frequently struggle to escape local minima and converge to optimal solutions, leading to suboptimal network performance. This paper proposes a novel approach to neural network training that leverages principles inspired by quantum mechanics. Specifically, we investigate the application of quantum-inspired optimization techniques, including simulated annealing and quantum walks, to dynamically adjust the training process. The core idea is to mimic the probabilistic exploration inherent in quantum systems to effectively navigate the complex loss landscape of neural networks. We formulate the training process as a quantum-inspired optimization problem, where the network's weights are treated as quantum bits (Qubits) and the optimization algorithm seeks to find the lowest energy state, analogous to finding the minimum loss. The proposed method demonstrates the potential for accelerating convergence and improving the overall accuracy of neural networks compared to conventional optimization strategies. Our analysis focuses on the key aspects of the approach, including the mathematical formulation of the quantum-inspired optimization problem and the selection of appropriate parameters to govern the exploration and exploitation phases. We present a theoretical framework for understanding the dynamics of this approach and discuss potential avenues for further research, including hybrid quantum-classical algorithms and the integration of quantum computing hardware.