This work introduces Q3SAT-GPT, a generative model for discovering quantum circuits for the Max-E3-SAT problem. Our method learns from high-performing QAOA-style ansätze to directly generate candidate circuits. To create high-quality supervision, we also introduce Mosaic Adaptive QAOA (MosaicADAPT-QAOA), an adaptive strategy for constructing low-depth QAOA circuits by selecting subsets of mixer operators in each step, rather than inserting operators sequentially. The resulting circuits serve as training data for the generative model, allowing it to learn effective circuit design patterns while eliminating the need for costly variational optimization at inference time. Experiments show that our framework attains strong solution quality with shallow circuits and scales significantly better than both our adaptive construction procedure and conventional variational baselines. Our results establish generative modeling as a high-performance route toward the scalable discovery of quantum optimization circuits, demonstrating that these models can effectively internalize circuit logic while providing a foundation for future, instance-aware inductive biases. Reproducibility: The source code is available at https://github.com/pratimugale/Q3SAT-GPT.
This work introduces Q3SAT-GPT, a generative model for discovering quantum circuits for the Max-E3-SAT problem. Our method learns from high-performing QAOA-style ansätze to directly generate candidate circuits. To create high-quality supervision, we also introduce Mosaic Adaptive QAOA (MosaicADAPT-QAOA), an adaptive strategy for constructing low-depth QAOA circuits by selecting subsets of mixer operators in each step, rather than inserting operators sequentially. The resulting circuits serve as training data for the generative model, allowing it to learn effective circuit design patterns while eliminating the need for costly variational optimization at inference time. Experiments show that our framework attains strong solution quality with shallow circuits and scales significantly better than both our adaptive construction procedure and conventional variational baselines. Our results establish generative modeling as a high-performance route toward the scalable discovery of quantum optimization circuits, demonstrating that these models can effectively internalize circuit logic while providing a foundation for future, instance-aware inductive biases. Reproducibility: The source code is available at https://github.com/pratimugale/Q3SAT-GPT.
Quantum computing has the potential to improve our ability to solve certain optimization problems that are computationally difficult for classical computers by offering new algorithmic approaches that may provide speedups under specific conditions. In this work, we introduce QAOA-GPT, a generative framework that leverages Generative Pretrained Transformers (GPT) to directly synthesize quantum circuits for solving quadratic unconstrained binary optimization problems, and demonstrate it on the Max-Cut problem on graphs. To diversify the training circuits and ensure their quality, we have generated a synthetic dataset using the adaptive QAOA approach, a method that incrementally builds and optimizes problemspecific circuits. The experiments conducted on a curated set of graph instances demonstrate that QAOA-GPT generates high quality quantum circuits for new problem instances unseen in the training as well as successfully parametrizes QAOA. Our results show that using QAOA-GPT to generate quantum circuits will significantly decrease both the computational overhead of classical QAOA and adaptive approaches that often use gradient evaluation to generate the circuit and the classical optimization of the circuit parameters. Our work shows that generative AI could be a promising avenue to generate compact quantum circuits in a scalable way. Reproducibility: source code and computational results are available at https://github.com/IlyaTyagin/QAOA-GPT.
The recently proposed QAOA-GPT framework demonstrated that generative pre-trained transformers can learn mappings between problem graphs and optimized quantum circuits for the Quantum Approximate Optimization Algorithm (QAOA). In this work, we extend QAOA-GPT to Higher-Order Unconstrained Binary Optimization (HUBO) problems, focusing on spin-glass Hamiltonians that include cubic interaction terms. Using FEATHER graph embeddings to encode topological information, we train the model on graph-circuit pairs generated via ADAPT-QAOA and evaluate its performance on 8- and 16-qubit instances embedded on heavy-hex lattices. The generative model produces adaptive QAOA-like circuits and corresponding variational parameters in a single forward pass, bypassing the iterative classical optimization loop. The generated circuits achieve average approximation ratios exceeding 0.95, closely matching classically optimized ADAPT-QAOA results, while maintaining consistent parameter distributions across circuit depths. These results demonstrate that QAOA-GPT generalizes effectively to higher-order cost Hamiltonians and complex energy landscapes, establishing generative modeling as a scalable pathway toward autonomous variational circuit design and quantum algorithm discovery in the NISQ era.
While combinatorial optimization problems are central to many scientific and engineering applications, their solution remains challenging due to exponentially large search spaces. Variational quantum algorithms offer a promising route for tackling such problems, yet their practical performance is limited by repeated quantum circuit evaluations and classical parameter updates. In this work, we introduce DQAOA-GPT, a hybrid framework that integrates the distributed quantum approximate optimization algorithm (DQAOA), which decomposes a large optimization problem into smaller sub-problems, with GPT-based quantum circuit generation for solving those sub-problems. Rather than relying on iterative variational optimization, the proposed approach uses a trained generative model to directly generate high-quality quantum circuits for the decomposed sub-problems. As a benchmark, we evaluate DQAOA-GPT against conventional DQAOA on dense HUBO optimization problems with up to 100 decision variables. The results demonstrate that DQAOA-GPT significantly reduces computational cost while maintaining competitive solution quality, with larger acceleration observed for larger sub-problem sizes. Although this work focuses on benchmark-scale validation, the framework provides a promising foundation for larger-scale combinatorial optimization in hybrid HPC-QC environments through increased GPU resources and parallel computing capability.
The ground state search problem is central to quantum computing, with applications spanning quantum chemistry, condensed matter physics, and optimization. The Variational Quantum Eigensolver (VQE) has shown promise for small systems but faces significant limitations. These include barren plateaus, restricted ansatz expressivity, and reliance on domain-specific structure. We present SpinGQE, an extension of the Generative Quantum Eigensolver (GQE) framework to spin Hamiltonians. Our approach reframes circuit design as a generative modeling task. We employ a transformer-based decoder to learn distributions over quantum circuits that produce low-energy states. Training is guided by a weighted mean-squared error loss between model logits and circuit energies evaluated at each gate subsequence. We validate our method on the four-qubit Heisenberg model, demonstrating successfulconvergencetonear-groundstates. Throughsystematichyperparameterexploration, we identify optimal configurations: smaller model architectures (12 layers, 8 attention heads), longer sequence lengths (12 gates), and carefully chosen operator pools yield the most reliable convergence. Our results show that generative approaches can effectively navigate complex energy landscapes without relying on problem-specific symmetries or structure. This provides a scalable alternative to traditional variational methods for general quantum systems. An open-source implementation is available at https://github.com/Mindbeam-AI/SpinGQE.
Quantum computing is a computational paradigm with the potential to outperform classical methods for a variety of problems. Proposed recently, the Quantum Approximate Optimization Algorithm (QAOA) is considered as one of the leading candidates for demonstrating quantum advantage in the near term. QAOA is a variational hybrid quantum-classical algorithm for approximately solving combinatorial optimization problems. The quality of the solution obtained by QAOA for a given problem instance depends on the performance of the classical optimizer used to optimize the variational parameters. In this paper, we formulate the problem of finding optimal QAOA parameters as a learning task in which the knowledge gained from solving training instances can be leveraged to find high-quality solutions for unseen test instances. To this end, we develop two machine-learning-based approaches. Our first approach adopts a reinforcement learning (RL) framework to learn a policy network to optimize QAOA circuits. Our second approach adopts a kernel density estimation (KDE) technique to learn a generative model of optimal QAOA parameters. In both approaches, the training procedure is performed on small-sized problem instances that can be simulated on a classical computer; yet the learned RL policy and the generative model can be used to efficiently solve larger problems. Extensive simulations using the IBM Qiskit Aer quantum circuit simulator demonstrate that our proposed RL- and KDE-based approaches reduce the optimality gap by factors up to 30.15 when compared with other commonly used off-the-shelf optimizers.
The central claim of this thesis is simple but underappreciated: the primary bottleneck in near-term quantum computing is not a shortage of algorithms; it is a lack of systematic decision-making. Which problem instances should we test? Which circuit architectures are worth training? Which hyperparameters actually drive performance, and which are distractions? Today’s quantum hardware sits in an uncomfortable middle ground. It is expressive enough to explore nontrivial quantum dynamics, yet it is too noisy and shallow for the theoretical speedups that motivate the field. This thesis argues that applying machine learning to classical control decisions in hybrid quantum classical methods is one of the most tractable ways to make these methods genuinely useful in this regime. This argument is developed through four research questions, each addressing a distinct decision-making layer and illustrating the thesis. The first asks whether the decisions inside a hybrid heuristic can be learned rather than hand-coded. Chapter 4 analyzes Recursive QAOA (RQAOA), a promising yet brittle approach to combinatorial optimization, and identifies regimes in which its fixed-elimination strategy fails. It then replaces that strategy with a reinforcement learning policy, RL-RQAOA, that adapts to instance structure. The resulting method performs better on the constructed failure cases while remaining competitive elsewhere. The broader point is that learned classical control policies can materially improve hybrid quantum heuristics without increasing quantum depth, which is a significant practical advantage on constrained hardware. The second question evaluates whether the quantum optimization algorithm benchmarking instances we use are principled. Chapter 5 observes that much benchmarking in this space is driven by convenience. Researchers test on whatever graphs are readily available and then report aggregate performance. Instead, the chapter proposes a generative pipeline that couples a permutation-invariant graph autoencoder with evolutionary optimization to deliberately construct Max-Cut instances that strongly discriminate between a quantum-inspired solver, RQAOA, and a strong classical baseline, Goemans-Williamson, in both directions. By connecting solver behavior to structural graph features, the chapter turns benchmarking from a static choice into an interpretable experimental tool. The generated instances also expose failure modes that random graphs often fail to reveal. The third question asks what changes when realistic noise constraints are taken seriously during circuit design, not only during execution. Chapter 6 develops RLQAS, a reinforcement learning framework for quantum architecture search that incorporates noise assumptions informed by real IBM device characteristics throughout training, rather than treating noise as a post hoc correction. Paired with an efficient Pauli transfer matrix simulation, the framework makes large-scale noisy circuit search computationally feasible. The circuits it discovers are compact, trainable, and achieve competitive accuracy on ground-state energy tasks. This suggests that hardware-aware circuit design is tractable and can yield materially different choices than noise-agnostic search. The fourth question asks: even when the circuit architecture is fixed, how much of what we attribute to quantum model design is actually due to hyperparameter sensitivity? Chapter 7 extends functional ANOVA to quantum neural networks to quantify which hyperparameter choices drive performance variance. The finding is clear. Learning rate, circuit depth, and data encoding/reuploading dominate, while many architectural micro-choices contribute far less than the literature often implies. Rather than stopping at diagnosis, the chapter turns these importance rankings into data-driven priors that accelerate hyperparameter optimization. It converts a critique into a practical improvement. Taken together, these contributions form a coherent toolkit for developing and evaluating hybrid quantum–classical methods in the NISQ regime. While the work does not eliminate the fundamental constraints of shallow, noisy hardware, it clarifies what can be improved immediately and how to do so in a reproducible manner. The broader goal is to help shift near-term quantum research from isolated demonstrations toward an engineering discipline, in which algorithms, benchmarks, and model-selection practices can be compared fairly, stress-tested rigorously, and iterated systematically as hardware matures.