Identifying optimal thermodynamical processes has been the essence of thermodynamics since its inception. Here, we show that differentiable programming (DP), a machine learning (ML) tool, can be employed to optimize finite-time thermodynamical processes in a quantum thermal machine. We consider the paradigmatic quantum Otto engine with a time-dependent harmonic oscillator as its working fluid, and build upon shortcut-to-adiabaticity (STA) protocols. We formulate the STA driving protocol as a constrained optimization task and apply DP to find optimal driving profiles for an appropriate figure of merit. Our ML scheme discovers profiles for the compression and expansion strokes that are superior to previously-suggested protocols. Moreover, using our ML algorithm we show that a previously-employed, intuitive energetic cost of the STA driving suffers from a fundamental flaw, which we resolve with an alternative construction for the cost function. Our method and results demonstrate that ML is beneficial both for solving hard-constrained quantum control problems and for devising and assessing their theoretical groundwork.
Identifying optimal thermodynamical processes has been the essence of thermodynamics since its inception. Here, we show that differentiable programming (DP), a machine learning (ML) tool, can be employed to optimize finite-time thermodynamical processes in a quantum thermal machine. We consider the paradigmatic quantum Otto engine with a time-dependent harmonic oscillator as its working fluid, and build upon shortcut-to-adiabaticity (STA) protocols. We formulate the STA driving protocol as a constrained optimization task and apply DP to find optimal driving profiles for an appropriate figure of merit. Our ML scheme discovers profiles for the compression and expansion strokes that are superior to previously-suggested protocols. Moreover, using our ML algorithm we show that a previously-employed, intuitive energetic cost of the STA driving suffers from a fundamental flaw, which we resolve with an alternative construction for the cost function. Our method and results demonstrate that ML is beneficial both for solving hard-constrained quantum control problems and for devising and assessing their theoretical groundwork.
We investigate the performance of a quantum thermal machine operating in finite time based on shortcut-to-adiabaticity techniques. We compute efficiency and power for a paradigmatic harmonic quantum Otto engine by taking the energetic cost of the shortcut driving explicitly into account. We demonstrate that shortcut-to-adiabaticity machines outperform conventional ones for fast cycles. We further derive generic upper bounds on both quantities, valid for any heat engine cycle, using the notion of quantum speed limit for driven systems. We establish that these quantum bounds are tighter than those stemming from the second law of thermodynamics.
Abstract The optimal control of open quantum systems is a challenging task but has a key role in improving existing quantum information processing technologies. We introduce a general framework based on reinforcement learning to discover optimal thermodynamic cycles that maximize the power of out-of-equilibrium quantum heat engines and refrigerators. We apply our method, based on the soft actor-critic algorithm, to three systems: a benchmark two-level system heat engine, where we find the optimal known cycle; an experimentally realistic refrigerator based on a superconducting qubit that generates coherence, where we find a non-intuitive control sequence that outperforms previous cycles proposed in literature; a heat engine based on a quantum harmonic oscillator, where we find a cycle with an elaborate structure that outperforms the optimized Otto cycle. We then evaluate the corresponding efficiency at maximum power.
A quantum thermal machine is an open quantum system that enables the conversion between heat and work at the micro or nano-scale. Optimally controlling such out-of-equilibrium systems is a crucial yet challenging task with applications to quantum technologies and devices. We introduce a general model-free framework based on reinforcement learning to identify out-of-equilibrium thermodynamic cycles that are Pareto optimal tradeoffs between power and efficiency for quantum heat engines and refrigerators. The method does not require any knowledge of the quantum thermal machine, nor of the system model, nor of the quantum state. Instead, it only observes the heat fluxes, so it is both applicable to simulations and experimental devices. We test our method on a model of an experimentally realistic refrigerator based on a superconducting qubit, and on a heat engine based on a quantum harmonic oscillator. In both cases, we identify the Pareto-front representing optimal power-efficiency tradeoffs, and the corresponding cycles. Such solutions outperform previous proposals made in the literature, such as optimized Otto cycles, reducing quantum friction.
The rapid advancements in quantum computing (QC) and machine learning (ML) have sparked significant interest, driving extensive exploration of quantum machine learning (QML) algorithms to address a wide range of complex challenges. The development of high-performance QML models requires expert-level expertise, presenting a key challenge to the widespread adoption of QML. Critical obstacles include the design of effective data encoding strategies and parameterized quantum circuits, both of which are vital for the performance of QML models. Furthermore, the measurement process is often neglected-most existing QML models employ predefined measurement schemes that may not align with the specific requirements of the targeted problem. We propose an innovative framework that renders the observable of a quantum system-specifically, the Hermitian matrix-trainable. This approach employs an end-to-end differentiable learning framework, enabling simultaneous optimization of the neural network used to program the parameterized observables and the standard quantum circuit parameters. Notably, the quantum observable parameters are dynamically programmed by the neural network, allowing the observables to adapt in real time based on the input data stream. Through numerical simulations, we demonstrate that the proposed method effectively programs observables dynamically within variational quantum circuits, achieving superior results compared to existing approaches. Notably, it delivers enhanced performance metrics, such as higher classification accuracy, thereby significantly improving the overall effectiveness of QML models.
In finite-time quantum Otto engines, maximizing power requires balancing the duration of the unitary strokes against the losses from nonadiabatic excitations. We address this trade-off in an Otto engine with a free-fermion working medium, using quantum optimal control. Having determined the single-particle energy scales that maximize ideal work at fixed reservoir temperatures, we realize them as the two endpoint Hamiltonians of a transverse-field Ising chain, connected by a path that crosses the quantum critical point. Optimal control of the unitary strokes yields near-ideal work on a time scale growing linearly with system size, instead of quadratically as for linear driving. We derive a time-rescaling relation that maps protocols with different energy scales onto a single reference problem and, for complete thermalization strokes of fixed duration, use it to build an analytical model of the cycle power. The model predicts two competing maximum-power regimes: a slow branch that approaches the ideal work, and a fast, size-independent branch that trades work for a shorter cycle and dominates above a crossover size, in quantitative agreement with numerical optimal-control results. It also identifies power-optimal energy scales that differ from the work-optimal ones and further increase the power. Our results provide a predictive approach to jointly optimizing the operating conditions and finite-time dynamics of quantum heat engines.
Finite-time quantum heat engines (QHEs) typically extract less work than their quasistatic counterparts because fast driving generates coherences and non-adiabatic transitions during the work strokes, a phenomenon commonly referred to as quantum friction. Quantum lubrication denotes a broad class of strategies that use auxiliary systems or controls to mitigate this loss. In this work, we introduce a lubrication protocol based on the quantum Zeno dynamics (QZD). By coupling the working medium to an auxiliary lubricant system and frequently monitoring the lubricant, we confine the joint evolution to a Zeno subspace and obtain an effective shortcut to adiabaticity during the work strokes of a QHE running an Otto cycle. In the ideal Zeno limit, the protocol reproduces the transitionless dynamics required to preserve populations in the instantaneous energy basis and recover the Otto efficiency at finite stroke duration. We also analyze several implementation-dependent thermodynamic costs, including switching, driving, monitoring, and imperfect thermalization, in order to assess how these costs constrain the practical gains in efficiency and power. Our results identify QZD as a conceptually distinct route to quantum lubrication and highlight quantum heat engines as a useful setting in which to study the interplay between strong coupling, measurement, and quantum thermodynamic control.