Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

ACS Photonics

Photon-Atom Hybrid Decision-Framework with Concurrent Exploration Acceleration

Feng Lu, Jian-Peng Dou, Hao Long Tang, Xiao-Yun Xu, Chao-Ni Zhang, Wenhao Zhou, Hong Sun, Xian‐Min Jin

Published Feb 12, 2025• 1 citation
Publisher

Abstract

Decision-making enables artificial intelligence to dynamically adjust and acquire knowledge from experiences, distinguishing it from traditional computing intelligence based on predetermined and rigid logic rules. However, the hardness of decision-making within the Turing framework increases exponentially with the number of decisions and decision-agents, thereby limiting the speed and scaling for artificial intelligence to process intensity-heavy tasks. Here, by introducing the quantum advantages of both photons and atoms, we report a photon-atom hybrid decision framework, whose decision-making exploration is accomplished through time-correlated atomic excitation within a quantum memory material. We develop a pseudophotonic blockade effect within memory materials to ensure that decision-making conflicts are hardly generated. With exploring a two-agent N -armed bandit in a concurrent manner, an N 2 times acceleration of decision-making exploration compared to nonconcurrent methods is demonstrated. Furthermore, the experimentally characterized performance in preference satisfaction and conflict avoidance shows an advanced capacity for distributed decision-making on a significant scale. Our research advances scalable distributed frameworks to address future reinforcement learning challenges.

DOI
10.1021/acsphotonics.4c02467

Related papers

Single Photon in Hierarchical Architecture for Physical Decision Making: Photon Intelligence

Makoto Naruse, Martin Berthel, Aurélien Drezet +3 more

Understanding and using photonic processes for intelligent functionalities, referred to as photonic intelligence, has recently attracted interest from a variety of fields, including postsilicon computing for artificial intelligence and decision making in the behavioral sciences. In a past study, we successfully used the wave–particle duality of single photons to solve the two-armed bandit problem, which constitutes one of the important foundations of decision making and reinforcement learning. In this paper, we propose and confirm a hierarchical architecture for single-photon-based decision making that verifies the scalability of the principle. Specifically, the four-armed bandit problem is solved given zero prior knowledge in a two-layer hierarchical architecture, where the polarization of single photons is autonomously adapted in order to effect adequate decision making. In the hierarchical structure, the notion of layer-dependent decisions emerges. The optimal solutions in the coarse layer and the fine layer, however, conflict with each other in some contradictory problems. We show that while what we call a tournament strategy resolves such contradictions, the probabilistic nature of single photons allows for the direct location of the optimal solution, even for contradictory problems, hence manifesting the exploration capability of single photons. This study provides insights into photon intelligence in hierarchical architectures for artificial intelligence as well as a novel aspect of photonic processes for intelligent functionalities.

arXiv:1609.00686•ACS Photonics•Nov 29, 2016•25 citations

Bandit Approach to Conflict-Free Parallel Q-Learning in View of Photonic Implementation

Hiroaki Shinkawa, Nicolas Chauvet, André Röhm +4 more

Recently, extensive studies on photonic reinforcement learning to accelerate the process of calculation by exploiting the physical nature of light have been conducted. Previous studies utilized quantum interference of photons to achieve collective decision-making without choice conflicts when solving the competitive multi-armed bandit problem, a fundamental example in reinforcement learning. However, the bandit problem deals with a static environment where the agent’s actions do not influence the reward probabilities. This study aims to extend the conventional approach to a more general type of parallel reinforcement learning targeting the grid world problem. Unlike the conventional approach, the proposed scheme deals with a dynamic environment where the reward changes because of the agent’s actions. A successful photonic reinforcement learning scheme requires both a photonic system that contributes to the quality of learning and a suitable algorithm. This study proposes a novel learning algorithm, a modified bandit Q-learning method, in view of a potential photonic implementation. Here, state–action pairs in the environment are regarded as slot machines in the context of the bandit problem and a change in Q -value is regarded as the reward of the bandit problem. We perform numerical simulations to validate the effectiveness of the bandit algorithm. In addition, we propose a parallel architecture in which multiple agents are indirectly connected through quantum interference of light and quantum principles ensure the conflict-free property of state–action pair selections among agents. We demonstrate that parallel reinforcement learning can be accelerated owing to conflict avoidance among multiple agents.

arXiv:2212.09926•Intelligent Computing•Jan 1, 2023•3 citations

Over the Quantum Rainbow: Explaining Hybrid Quantum Reinforcement Learning

Junghoon Park, Jiook Cha, Samuel Yen-Chi Chen +2 more

In the realm of artificial intelligence, deep rein-forcement learning (RL) agents struggle with generalizability and require substantial computational resources, unlike humans who easily adapt and generalize across tasks. To address these challenges, we introduce Quantum Rainbow, a hybrid algorithm that leverages the neural mechanisms of human decision-making and the efficiency of quantum computing. Quantum Rainbow combines variational quantum circuits with the Rainbow Deep Q-Network (DQN) model to create a novel approach in rein-forcement learning that integrates quantum principles into deep learning paradigms. We evaluate our model using behavioral experiments through the Iowa Gambling Task and 4-Armed Bandit Task. Our investigations reveal a significant relationship between the architecture of quantum circuits and the performance of quantum RL agents. Specifically, using causal discovery methods, we demonstrate the critical role of quantum entanglement in enhancing model performance. These findings not only show promising results but also pave the way for future explorations into optimizing quantum circuit architectures for reinforcement learning applications. This study underscores the potential of quantum-enhanced algorithms to achieve “quantum advantage” by addressing fundamental limitations in conventional deep RL methods.

IEEE International Conference on Quantum Computing and Engineering (QCE)•Sep 15, 2024•9 citations

Quantum-enhanced hybrid deep reinforcement learning for real-time volleyball tactical decision making

Nan Cai, Minghui Zhao, Yantong Ke +1 more

The complexity of real-time tactical decision making in volleyball presents significant computational challenges due to high-dimensional state spaces, multi-agent interactions, and stringent temporal constraints. This research presents a novel quantum-enhanced hybrid deep reinforcement learning framework that integrates quantum computing principles with classical neural networks to optimize tactical decision making in competitive volleyball scenarios. The proposed framework incorporates quantum variational circuits for neural network parameter optimization, quantum state encoding mechanisms for efficient high-dimensional feature representation, and quantum parallel processing algorithms to accelerate training convergence. Experimental evaluation using quantum circuit simulations on the Qiskit framework demonstrates substantial performance improvements compared to traditional deep reinforcement learning approaches, achieving 95.4% decision accuracy versus 82.1% for classical methods, 2.8-fold acceleration in convergence speed (387 epochs versus 1456 epochs), and real-time response latencies of 23.7 milliseconds well within the 50-millisecond threshold required for competitive volleyball. It should be noted that all reported performance metrics are obtained from quantum simulator experiments rather than execution on actual quantum hardware, and practical deployment on near-term quantum devices may yield different results due to hardware noise and decoherence effects. The tactical effectiveness assessment reveals 89.3% success rates in realistic volleyball scenarios while maintaining robust performance across varying opponent strategies and environmental conditions. The quantum enhancement mechanisms leverage superposition and entanglement properties to capture complex multi-player tactical dependencies more efficiently than classical approaches. This research establishes quantum machine learning as a transformative technology for sports intelligence analysis, providing foundational evidence for quantum-enhanced decision making applications across diverse competitive athletics domains.

Scientific Reports•Dec 20, 2025•4 citations

Quantum speed-ups in reinforcement learning

Valeria Saggio, Beate E. Asenbeck, Arne Hamann +10 more

As the field of artificial intelligence is pushed forward, the question arises of how fast autonomous machines can learn. Within artificial intelligence, an important paradigm is reinforcement learning, where agents - learning entities capable of decision making - interact with the world they are placed in, called an environment. Thanks to these interactions, agents receive feedback from the environment and thus progressively adjust their behaviour to accomplish a given goal. An important question in reinforcement learning is how fast agents can learn to fulfill their tasks. To answer this question we consider a novel reinforcement learning framework where quantum mechanics is used. In particular, we quantize the agent and the environment and grant them the possibility to also interact quantum-mechanically, that is, by using a quantum channel for their communication. We demonstrate that this feature enables a speed-up in the agent's learning process, and we further show that combining this scenario with classical communication enables the evaluation of such an improvement. This learning protocol is implemented on an integrated re-programmable photonic platform interfaced with photons at telecommunication wavelengths. Thanks to the full tunability of the device, this platform proves the best candidate for the implementation of learning protocols, where a continuous update of the learning process is required.

Quantum Nanophotonic Materials, Devices, and Systems•Jul 30, 2021•4 citations

Quantum-Enhanced Reinforcement Learning for Adaptive Decision-Making in Dynamic Environments

Priyanka Singh, Sonam Dubey

Many challenges that occur with traditional reinforcement learning in uncertain environments, such as slow convergence and scalability, can be addressed with Quantum-Enhanced Reinforcement Learning (QERL). Specifically, this research is for adaptive decision-making in environments with rapid change and great uncertainty. A QERL framework that combines variational quantum circuits and deep Q-networks is introduced. This framework optimizes decision-making processes in real-time and is applicable in areas such as autonomous systems, smart manufacturing, and intelligent resource allocation. Training for the framework took place in simulated dynamic environments during 50,000 training episodes and was then evaluated alongside Deep Q-Learning and Proximal Policy Optimization models. The QERL self-model outperformed the baseline in policy accuracy (+18.6%) and cumulative reward loss (-21.4%). Decision latency decreased 16.2%, and convergence improved 23.8% with the use of a hybrid quantum architecture. The proposed analysis demonstrated improved average reward (78.4 to 94.7) with 95% CI, indicating model consistency. Ultimately, QERL improves decision-making in complex scenarios and provides robust adaptive learning. Also noted, QERL frameworks with hybrid quantum architecture are useful for real-world systems. Furthermore, the learning framework proved to be more stable and adaptable to rapid and stochastic environmental changes compared to classical agents, in environments with incomplete dynamic and rapidly changing environments.

•Aug 1, 2026•0 citations
Decision-making enables artificial intelligence to dynamically adjust and acquire knowledge from experiences, distinguishing it from traditional computing intelligence based on predetermined and rigid logic rules. However, the hardness of decision-making within the Turing framework increases exponentially with the number of decisions and decision-agents, thereby limiting the speed and scaling for artificial intelligence to process intensity-heavy tasks. Here, by introducing the quantum advantages of both photons and atoms, we report a photon-atom hybrid decision framework, whose decision-making exploration is accomplished through time-correlated atomic excitation within a quantum memory material. We develop a pseudophotonic blockade effect within memory materials to ensure that decision-making conflicts are hardly generated. With exploring a two-agent N -armed bandit in a concurrent manner, an N 2 times acceleration of decision-making exploration compared to nonconcurrent methods is demonstrated. Furthermore, the experimentally characterized performance in preference satisfaction and conflict avoidance shows an advanced capacity for distributed decision-making on a significant scale. Our research advances scalable distributed frameworks to address future reinforcement learning challenges.
Understanding and using photonic processes for intelligent functionalities, referred to as photonic intelligence, has recently attracted interest from a variety of fields, including postsilicon computing for artificial intelligence and decision making in the behavioral sciences. In a past study, we successfully used the wave–particle duality of single photons to solve the two-armed bandit problem, which constitutes one of the important foundations of decision making and reinforcement learning. In this paper, we propose and confirm a hierarchical architecture for single-photon-based decision making that verifies the scalability of the principle. Specifically, the four-armed bandit problem is solved given zero prior knowledge in a two-layer hierarchical architecture, where the polarization of single photons is autonomously adapted in order to effect adequate decision making. In the hierarchical structure, the notion of layer-dependent decisions emerges. The optimal solutions in the coarse layer and the fine layer, however, conflict with each other in some contradictory problems. We show that while what we call a tournament strategy resolves such contradictions, the probabilistic nature of single photons allows for the direct location of the optimal solution, even for contradictory problems, hence manifesting the exploration capability of single photons. This study provides insights into photon intelligence in hierarchical architectures for artificial intelligence as well as a novel aspect of photonic processes for intelligent functionalities.
Recently, extensive studies on photonic reinforcement learning to accelerate the process of calculation by exploiting the physical nature of light have been conducted. Previous studies utilized quantum interference of photons to achieve collective decision-making without choice conflicts when solving the competitive multi-armed bandit problem, a fundamental example in reinforcement learning. However, the bandit problem deals with a static environment where the agent’s actions do not influence the reward probabilities. This study aims to extend the conventional approach to a more general type of parallel reinforcement learning targeting the grid world problem. Unlike the conventional approach, the proposed scheme deals with a dynamic environment where the reward changes because of the agent’s actions. A successful photonic reinforcement learning scheme requires both a photonic system that contributes to the quality of learning and a suitable algorithm. This study proposes a novel learning algorithm, a modified bandit Q-learning method, in view of a potential photonic implementation. Here, state–action pairs in the environment are regarded as slot machines in the context of the bandit problem and a change in Q -value is regarded as the reward of the bandit problem. We perform numerical simulations to validate the effectiveness of the bandit algorithm. In addition, we propose a parallel architecture in which multiple agents are indirectly connected through quantum interference of light and quantum principles ensure the conflict-free property of state–action pair selections among agents. We demonstrate that parallel reinforcement learning can be accelerated owing to conflict avoidance among multiple agents.
In the realm of artificial intelligence, deep rein-forcement learning (RL) agents struggle with generalizability and require substantial computational resources, unlike humans who easily adapt and generalize across tasks. To address these challenges, we introduce Quantum Rainbow, a hybrid algorithm that leverages the neural mechanisms of human decision-making and the efficiency of quantum computing. Quantum Rainbow combines variational quantum circuits with the Rainbow Deep Q-Network (DQN) model to create a novel approach in rein-forcement learning that integrates quantum principles into deep learning paradigms. We evaluate our model using behavioral experiments through the Iowa Gambling Task and 4-Armed Bandit Task. Our investigations reveal a significant relationship between the architecture of quantum circuits and the performance of quantum RL agents. Specifically, using causal discovery methods, we demonstrate the critical role of quantum entanglement in enhancing model performance. These findings not only show promising results but also pave the way for future explorations into optimizing quantum circuit architectures for reinforcement learning applications. This study underscores the potential of quantum-enhanced algorithms to achieve “quantum advantage” by addressing fundamental limitations in conventional deep RL methods.
The complexity of real-time tactical decision making in volleyball presents significant computational challenges due to high-dimensional state spaces, multi-agent interactions, and stringent temporal constraints. This research presents a novel quantum-enhanced hybrid deep reinforcement learning framework that integrates quantum computing principles with classical neural networks to optimize tactical decision making in competitive volleyball scenarios. The proposed framework incorporates quantum variational circuits for neural network parameter optimization, quantum state encoding mechanisms for efficient high-dimensional feature representation, and quantum parallel processing algorithms to accelerate training convergence. Experimental evaluation using quantum circuit simulations on the Qiskit framework demonstrates substantial performance improvements compared to traditional deep reinforcement learning approaches, achieving 95.4% decision accuracy versus 82.1% for classical methods, 2.8-fold acceleration in convergence speed (387 epochs versus 1456 epochs), and real-time response latencies of 23.7 milliseconds well within the 50-millisecond threshold required for competitive volleyball. It should be noted that all reported performance metrics are obtained from quantum simulator experiments rather than execution on actual quantum hardware, and practical deployment on near-term quantum devices may yield different results due to hardware noise and decoherence effects. The tactical effectiveness assessment reveals 89.3% success rates in realistic volleyball scenarios while maintaining robust performance across varying opponent strategies and environmental conditions. The quantum enhancement mechanisms leverage superposition and entanglement properties to capture complex multi-player tactical dependencies more efficiently than classical approaches. This research establishes quantum machine learning as a transformative technology for sports intelligence analysis, providing foundational evidence for quantum-enhanced decision making applications across diverse competitive athletics domains.
As the field of artificial intelligence is pushed forward, the question arises of how fast autonomous machines can learn. Within artificial intelligence, an important paradigm is reinforcement learning, where agents - learning entities capable of decision making - interact with the world they are placed in, called an environment. Thanks to these interactions, agents receive feedback from the environment and thus progressively adjust their behaviour to accomplish a given goal. An important question in reinforcement learning is how fast agents can learn to fulfill their tasks. To answer this question we consider a novel reinforcement learning framework where quantum mechanics is used. In particular, we quantize the agent and the environment and grant them the possibility to also interact quantum-mechanically, that is, by using a quantum channel for their communication. We demonstrate that this feature enables a speed-up in the agent's learning process, and we further show that combining this scenario with classical communication enables the evaluation of such an improvement. This learning protocol is implemented on an integrated re-programmable photonic platform interfaced with photons at telecommunication wavelengths. Thanks to the full tunability of the device, this platform proves the best candidate for the implementation of learning protocols, where a continuous update of the learning process is required.
Many challenges that occur with traditional reinforcement learning in uncertain environments, such as slow convergence and scalability, can be addressed with Quantum-Enhanced Reinforcement Learning (QERL). Specifically, this research is for adaptive decision-making in environments with rapid change and great uncertainty. A QERL framework that combines variational quantum circuits and deep Q-networks is introduced. This framework optimizes decision-making processes in real-time and is applicable in areas such as autonomous systems, smart manufacturing, and intelligent resource allocation. Training for the framework took place in simulated dynamic environments during 50,000 training episodes and was then evaluated alongside Deep Q-Learning and Proximal Policy Optimization models. The QERL self-model outperformed the baseline in policy accuracy (+18.6%) and cumulative reward loss (-21.4%). Decision latency decreased 16.2%, and convergence improved 23.8% with the use of a hybrid quantum architecture. The proposed analysis demonstrated improved average reward (78.4 to 94.7) with 95% CI, indicating model consistency. Ultimately, QERL improves decision-making in complex scenarios and provides robust adaptive learning. Also noted, QERL frameworks with hybrid quantum architecture are useful for real-world systems. Furthermore, the learning framework proved to be more stable and adaptable to rapid and stochastic environmental changes compared to classical agents, in environments with incomplete dynamic and rapidly changing environments.