Recent research has demonstrated that parametric quantum circuits (PQCs) are affected by gradients that progressively vanish to zero as a function of the number of qubits. We show that using a combination of gradient-free natural evolutionary strategy and gradient descent can mitigate the possibility of optimizing barren plateaus in the landscape. We implemented 2 specific methods: natural evolutionary strategy stochastic gradient descent (NESSGD) and natural evolutionary strategy adapting the step size according to belief in observed gradients (NESAdaBelief) to optimize PQC parameter values. They were compared with standard stochastic gradient descent, adaptive moment estimation, and a version of adaptive moment estimation adapting the step size according to belief in observed gradients in 5 classification tasks. NESSGD and NESAdaBelief demonstrated some superiority in 4 of the tasks. NESAdaBelief showed higher accuracy than AdaBelief in all 5 tasks. In addition, we investigated the applicability of NESSGD under the parameter shift rule and demonstrated that NESSGD can adapt to this rule, which means that our proposed method could also optimize the parameters of PQCs on quantum computers.
Recent research has demonstrated that parametric quantum circuits (PQCs) are affected by gradients that progressively vanish to zero as a function of the number of qubits. We show that using a combination of gradient-free natural evolutionary strategy and gradient descent can mitigate the possibility of optimizing barren plateaus in the landscape. We implemented 2 specific methods: natural evolutionary strategy stochastic gradient descent (NESSGD) and natural evolutionary strategy adapting the step size according to belief in observed gradients (NESAdaBelief) to optimize PQC parameter values. They were compared with standard stochastic gradient descent, adaptive moment estimation, and a version of adaptive moment estimation adapting the step size according to belief in observed gradients in 5 classification tasks. NESSGD and NESAdaBelief demonstrated some superiority in 4 of the tasks. NESAdaBelief showed higher accuracy than AdaBelief in all 5 tasks. In addition, we investigated the applicability of NESSGD under the parameter shift rule and demonstrated that NESSGD can adapt to this rule, which means that our proposed method could also optimize the parameters of PQCs on quantum computers.
Abstract Natural evolutionary strategies (NES) are a family of gradient-free black-box optimization algorithms. This study illustrates their use for the optimization of randomly initialized parameterized quantum circuits (PQCs) in the region of vanishing gradients. We show that using the NES gradient estimator the exponential decrease in variance can be alleviated. We implement two specific approaches, the exponential and separable NES, for parameter optimization of PQCs and compare them against standard gradient descent. We apply them to two different problems of ground state energy estimation using variational quantum eigensolver and state preparation with circuits of varying depth and length. We also introduce batch optimization for circuits with larger depth to extend the use of ES to a larger number of parameters. We achieve accuracy comparable to state-of-the-art optimization techniques in all the above cases with a lower number of circuit evaluations. Our empirical results indicate that one can use NES as a hybrid tool in tandem with other gradient-based methods for optimization of deep quantum circuits in regions with vanishing gradients.
Variational quantum algorithms (VQAs) employ parametrized quantum circuits optimized using classical methods to minimize a cost function. While VQAs have found broad applications, certain challenges persist. Notably, a significant computational burden arises during parameter optimization. The prevailing ``parameter shift rule'' mandates a double evaluation of the cost function for each parameter. In this paper, we introduce an optimization approach named ``learning to learn with an evolutionary strategy'' (LLES). LLES unifies ``learning to learn'' and ``evolutionary strategy'' methods. Learning to learn treats optimization as a learning problem, utilizing recurrent neural networks to iteratively propose VQA parameters. Conversely, evolutionary strategy employs gradient searches to estimate function gradients. Our optimization method is applied to two distinct tasks: determining the ground state of an Ising Hamiltonian and training a quantum neural network. The obtained results underscore the efficacy of this approach. Additionally, we identify a key hyperparameter that significantly influences gradient estimation using the evolutionary strategy method.
Variational quantum circuits have arisen as an important method in quantum computing. A crucial step of it is parameter optimization, which is typically tackled through gradient-descent techniques. We advantageously explore instead the use of evolutionary algorithms for such optimization, specifically for time-series forecasting. We perform a comparison, for diverse instances of real-world data, between gradient-descent parameter optimization and covariant-matrix adaptation evolutionary strategy. We observe that gradient descent becomes permanently trapped in local minima that have been avoided by evolutionary algorithms in all tested datasets, reaching up to a six-fold decrease in prediction error. Finally, the combined use of evolutionary and gradient-based techniques is explored, aiming at retaining advantages of both. The results are particularly applicable in scenarios sensitive to gains in accuracy.
Variational quantum algorithms are viewed as promising candidates for demonstrating quantum advantage on near-term devices. These approaches typically involve the training of parameterized quantum circuits through a classical optimization loop. However, they often encounter challenges attributed to the exponentially diminishing gradient components, known as the barren plateau (BP) problem. This work introduces a novel optimization approach designed to alleviate the adverse effects of BPs during circuit training. In contrast to conventional gradient descent methods with a small learning parameter, our approach relies on making a finite hops along the search direction determined on a randomly chosen subsets of the free parameters. The optimization search direction, together with the range of the search, is determined by the distant features of the cost-function landscape. This enables the optimization path to navigate around barren plateaus without the need for external control mechanisms. We have successfully applied our optimization strategy to quantum circuits comprising 21 qubits and 15000 entangling gates, demonstrating robust resistance against BPs. Additionally, we have extended our optimization strategy by incorporating an evolutionary selection framework, enhancing its ability to avoid local minima in the landscape. The modified algorithm has been successfully utilized in quantum gate synthesis applications, showcasing a significantly improved efficiency in generating highly compressed quantum circuits compared to traditional gradient-based optimization approaches.
Variational quantum circuits (VQCs) are flexible models for optimization and learning based on parameterized quantum circuits trained via cost minimization. A key challenge in their optimization is the presence of barren plateaus, where gradients vanish exponentially with the number of qubits, severely limiting trainability. Local cost functions mitigate this issue by restricting evaluation to qubit subsets, improving gradient scaling. In this work, we propose an evolutionary strategy-inspired method to automatically identify informative qubit subsets for constructing local cost functions. Operating at the level of qubit selection rather than parameter optimization, the approach enables adaptive, circuit-aware objective design. Numerical experiments using the PennyLane framework show that the method alleviates barren plateaus and improves optimization performance in the identity-gate learning problem.
Abstract Variational Quantum Algorithms (VQAs) are widely regarded as the most promising route to practical quantum advantage on Noisy Intermediate-Scale Quantum (NISQ) hardware, but their trainability is threatened by the barren plateau phenomenon, in which cost-function gradients vanish exponentially with system size and circuit depth. Standard first-order optimizers, which treat the parameter space of a parameterized quantum circuit (PQC) as flat Euclidean space, are especially vulnerable to this effect and to the additional gradient suppression introduced by hardware noise. This extended treatment presents (i) a from-first-principles derivation of Quantum Natural Gradient (QNG) descent, tracing its lineage from Amari's classical information geometry [1] through the Fubini-Study metric to the Quantum Fisher Information Matrix (QFIM); (ii) a complete taxonomy of barren-plateau mechanisms (expressibility-induced, entanglement-induced, cost-function-locality-induced, and noise-induced); (iii) a comparative survey of the broader NISQ optimizer landscape (SPSA, Adam, COBYLA, Rotosolve, Quantum Natural SPSA, and reduced-cost QFIM estimators); and (iv) a controlled simulation study comparing QNG against vanilla gradient descent on a 4-qubit weighted MaxCut problem under three physically motivated NISQ noise models. Across 50 independent trials, QNG raised the convergence success rate from 30% to 95%, reduced the mean iteration count to convergence by a factor of roughly 6, and achieved a 16% net wall-clock speedup despite the added per-iteration cost of QFIM estimation. We give the full theoretical basis for these gains, an exhaustive discussion of their limitations, an A-to-Z glossary of the field's terminology, and a staged roadmap toward physical hardware validation. Figure placements throughout the document are annotated with detailed image-generation prompts so that the accompanying visual assets can be produced independently of this text.