Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Log inSign up
Challenges
Datasets
Workspaces
Papers
Discussions
Leaderboard
Blog
Job Board
Q3AS

© 2026 Aqora Quantum S.A.S.

TermsPrivacyLegal Notice

arXiv:2004.06040 · Quantum Machine Intelligence

K-spin Hamiltonian for quantum-resolvable Markov decision processes

Eric B. Jones, Peter A Graf, Eliot Kapit, Wesley B. Jones

Published Oct 30, 2020• 2 citations
arXivHTMLPDF
DOI
10.1007/s42484-020-00026-6

Related papers

Reachability analysis of quantum Markov decision processes

Shenggang Ying, Mingsheng Ying

arXiv:1406.6146•Information and Computation•Sep 5, 2018•37 citations

A quantum walk framework for multialternative decision making

Jiaqi Adam Huang, Jerome R. Busemeyer

Recent findings of Markov violations challenge Markov random walk processes for decision making. On the other hand, quantum walk processes explain these Markov violations in a natural way, but they have only been applied to binary alternative decision making. In this work, we propose a general framework for extending quantum walk processes to multi-alternative decision making. The multi-alternative quantum walk model operates in a direct sum space of the alternatives, with Hamiltonian built for each pair of alternatives to model context effects. Order effects come naturally from the matrix non-commutativity of the Hamiltonians. Future works built on this framework can connect parameters of the models with the expected utilities.

•May 1, 2022•0 citations

On quantum Markovian processes

Andrzej Posiewnik

Reports on Mathematical Physics•Oct 1, 1977•1 citation

Quantum partially observable Markov decision processes

Jennifer Barry, Daniel T. Barry, Scott Aaronson

We present quantum observable Markov decision processes (QOMDPs), the quantum analogues of partially observable Markov decision processes (POMDPs). In a QOMDP, an agent's state is represented as a quantum state and the agent can choose a superoperator to apply. This is similar to the POMDP belief state, which is a probability distribution over world states and evolves via a stochastic matrix. We show that the existence of a policy of at least a certain value has the same complexity for QOMDPs and POMDPs in the polynomial and infinite horizon cases. However, we also prove that the existence of a policy that can reach a goal state is decidable for goal POMDPs and undecidable for goal QOMDPs.

arXiv:1406.2858•Physical Review A•Sep 9, 2014•74 citations

Quantum Markov Processes

Burkhard Kümmerer

Lecture notes in physics•Jan 1, 2002•21 citations

Quantum Markov Processes

Luigi Accardi

Springer eBooks•Jan 1, 1980•3 citations
Recent findings of Markov violations challenge Markov random walk processes for decision making. On the other hand, quantum walk processes explain these Markov violations in a natural way, but they have only been applied to binary alternative decision making. In this work, we propose a general framework for extending quantum walk processes to multi-alternative decision making. The multi-alternative quantum walk model operates in a direct sum space of the alternatives, with Hamiltonian built for each pair of alternatives to model context effects. Order effects come naturally from the matrix non-commutativity of the Hamiltonians. Future works built on this framework can connect parameters of the models with the expected utilities.
We present quantum observable Markov decision processes (QOMDPs), the quantum analogues of partially observable Markov decision processes (POMDPs). In a QOMDP, an agent's state is represented as a quantum state and the agent can choose a superoperator to apply. This is similar to the POMDP belief state, which is a probability distribution over world states and evolves via a stochastic matrix. We show that the existence of a policy of at least a certain value has the same complexity for QOMDPs and POMDPs in the polynomial and infinite horizon cases. However, we also prove that the existence of a policy that can reach a goal state is decidable for goal POMDPs and undecidable for goal QOMDPs.