The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Variational Quantum Circuits for Deep Reinforcement Learning
Open accessAbstract
The state-of-the-art machine learning approaches are based on classical von Neumann computing architectures and have been widely used in many industrial and academic domains. With the recent development of quantum computing, researchers and tech-giants have attempted new quantum circuits for machine learning tasks. However, the existing quantum computing platforms are hard to simulate classical deep learning models or problems because of the intractability of deep quantum circuits. Thus, it is necessary to design feasible quantum algorithms for quantum machine learning for noisy intermediate scale quantum (NISQ) devices. This work explores variational quantum circuits for deep reinforcement learning. Specifically, we reshape classical deep reinforcement learning algorithms like experience replay and target network into a representation of variational quantum circuits. Moreover, we use a quantum information encoding scheme to reduce the number of model parameters compared to classical neural networks. To the best of our knowledge, this work is the first proof-of-principle demonstration of variational quantum circuits to approximate the deep Q-value function for decision-making and policy-selection reinforcement learning with experience replay and target network. Besides, our variational quantum circuits can be deployed in many near-term NISQ machines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
(2017) · Cited by 11,625
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
Quantum Computing in the NISQ era and beyond
Preskill, J. (2018) · Quantum · doi:10.22331/q-2018-08-06-79 · Cited by 8,830
Quantum supremacy using a programmable superconducting processor
Arute, F., Arya, K., Babbush, R., Bacon, D., Bardin, J. C., Barends, R., Biswas, R., Boixo, S., Brandao, F. G. S. L., Buell, D. A., et al. (2019) · Nature · doi:10.1038/s41586-019-1666-5 · Cited by 7,720
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Biamonte, J., Wittek, P., Pancotti, N., Rebentrost, P., Wiebe, N., & Lloyd, S. (2017) · Nature · doi:10.1038/nature23474 · Cited by 4,779
Deep learning for computer vision: A brief review
Voulodimos, A., Doulamis, N., Doulamis, A., & Protopapadakis, E. (2018) · Computational Intelligence and Neuroscience · doi:10.1155/2018/7068349 · Cited by 3,403
Hardware-efficient variational quantum eigensolver for small molecules and quantum magnets
Kandala, A., Mezzacapo, A., Temme, K., Takita, M., Brink, M., Chow, J. M., & Gambetta, J. M. (2017) · Nature · doi:10.1038/nature23879 · Cited by 2,982
Supervised learning with quantum-enhanced feature spaces
Havlíček, V., Córcoles, A. D., Temme, K., Harrow, A. W., Kandala, A., Chow, J. M., & Gambetta, J. M. (2019) · Nature · doi:10.1038/s41586-019-0980-2 · Cited by 2,572
Machine learning and the physical sciences
Carleo, G., Cirac, I., Cranmer, K., Daudet, L., Schuld, M., Tishby, N., Vogt-Maranto, L., & Zdeborová, L. (2019) · Reviews of Modern Physics · doi:10.1103/revmodphys.91.045002 · Cited by 2,417
The theory of variational hybrid quantum-classical algorithms
McClean, J. R., Romero, J., Babbush, R., & Aspuru-Guzik, A. (2016) · New Journal of Physics · doi:10.1088/1367-2630/18/2/023023 · Cited by 2,227
(2020) · Machine Learning and Visual Perception · doi:10.1515/9783110595567-011 · Cited by 1,930
A Quantum Approximate Optimization Algorithm
Farhi, E., Goldstone, J., & Gutmann, S. (2014) · arXiv · doi:10.48550/arxiv.1411.4028 · Cited by 1,789
Mitarai, K., Negoro, M., Kitagawa, M., & Fujii, K. (2018) · Physical Review A · doi:10.1103/physreva.98.032309 · Cited by 1,639
Evaluating analytic gradients on quantum hardware
Schuld, M., Bergholm, V., Gogolin, C., Izaac, J., & Killoran, N. (2019) · Physical Review A · doi:10.1103/physreva.99.032331 · Cited by 1,072
Circuit-centric quantum classifiers
Schuld, M., Bocharov, A., Svore, K. M., & Wiebe, N. (2020) · Physical Review A · doi:10.1103/physreva.101.032308 · Cited by 1,057
Machine learning & artificial intelligence in the quantum domain: a review of recent progress
Dunjko, V., & Briegel, H. J. (2018) · Reports on Progress in Physics · doi:10.1088/1361-6633/aab406 · Cited by 1,055
Sim, S., Johnson, P. D., & Aspuru‐Guzik, A. (2019) · Advanced Quantum Technologies · doi:10.1002/qute.201900070 · Cited by 972
Theory of fault-tolerant quantum computation
Gottesman, D. (1998) · Physical Review A · doi:10.1103/physreva.57.127 · Cited by 947
Stabilizer Codes and Quantum Error Correction
Gottesman, D. (1997) · arXiv · doi:10.48550/arxiv.quant-ph/9705052 · Cited by 753
PennyLane: Automatic differentiation of hybrid quantum-classical computations
Bergholm, V., Izaac, J., Schuld, M., Gogolin, C., Ahmed, S., Ajith, V., Alam, M. S., Alonso-Linaje, G., AkashNarayanan, B., Asadi, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1811.04968 · Cited by 732
Quantum computational supremacy
Harrow, A. W., & Montanaro, A. (2017) · Nature · doi:10.1038/nature23458 · Cited by 702
Classification with Quantum Neural Networks on Near Term Processors
Farhi, E., & Neven, H. (2018) · arXiv · doi:10.48550/arxiv.1802.06002 · Cited by 598
Quantum Reinforcement Learning
Dong, D., Chen, C., Li, H., & Tarn, T.-J. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.925743 · Cited by 410
Stock prediction using deep learning
Singh, R., & Srivastava, S. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-016-4159-7 · Cited by 339
Classification with Quantum Neural Networks on Near Term Processors
Farhi, E., & Neven, H. (2020) · doi:10.37686/qrl.v1i2.80 · Cited by 332
(1992) · Springer eBooks · doi:10.1007/978-1-4615-3618-5 · Cited by 331
A MultiPath Network for Object Detection
Zagoruyko, S., Lerer, A., Lin, T.-Y., Pinheiro, P., Gross, S., Chintala, S., & Dollar, P. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.15 · Cited by 228
Entanglement in a Quantum Annealing Processor
Lanting, T., Przybysz, A. J., Smirnov, A. Y., Spedalieri, F. M., Amin, M. H., Berkley, A. J., Harris, R., Altomare, F., Boixo, S., Bunyk, P., et al. (2014) · Physical Review X · doi:10.1103/physrevx.4.021041 · Cited by 195
The IBM Q experience and QISKit open-source quantum computing software
Cross, A. W. (2018) · Bulletin of the American Physical Society · Cited by 182
Projective simulation for artificial intelligence
Briegel, H. J., & Cuevas, G. D. L. (2012) · Scientific Reports · doi:10.1038/srep00400 · Cited by 181
NetKet: A machine learning toolkit for many-body quantum systems
Carleo, G., Choo, K., Hofmann, D., Smith, J. E. T., Westerhout, T., Alet, F., Davis, E. J., Efthymiou, S., Glasser, I., Lin, S.-H., et al. (2019) · SoftwareX · doi:10.1016/j.softx.2019.100311 · Cited by 176
ns-3 meets OpenAI Gym: The Playground for Machine Learning in Networking Research
Gawłowicz, P., & Zubow, A. (2019) · Proceedings of the 22nd International ACM Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems · doi:10.1145/3345768.3355908 · Cited by 167
Optimizing Quantum Error Correction Codes with Reinforcement Learning
Nautrup, H. P., Delfosse, N., Dunjko, V., Briegel, H. J., & Friis, N. (2019) · Quantum · doi:10.22331/q-2019-12-16-215 · Cited by 158
Deep reinforcement learning for quantum gate control
An, Z., & Zhou, D. L. (2019) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/126/60002 · Cited by 148
Quantum error correction for the toric code using deep reinforcement learning
Andreasson, P., Johansson, J., Liljestrand, S., & Granath, M. (2019) · Quantum · doi:10.22331/q-2019-09-02-183 · Cited by 120
NetKet: A machine learning toolkit for many-body quantum systems
Carleo, G., Choo, K., Hofmann, D., Smith, J. E. T., Westerhout, T., Alet, F., Davis, E. J., Efthymiou, S., Glasser, I., Lin, S.-H., et al. (2019) · MPG.PuRe (Max Planck Society) · doi:10.3929/ethz-b-000361961 · Cited by 120
Flurin, E., Martin, L. S., Hacohen-Gourgy, S., & Siddiqi, I. A. (2020) · Physical Review X · doi:10.1103/physrevx.10.011006 · Cited by 101
Expressive power of parametrized quantum circuits
Du, Y., Hsieh, M.-H., Liu, T., & Tao, D. (2018) · UTS ePRESS (University of Technology Sydney) · Cited by 99
Unveiling phase transitions with machine learning
Canabarro, A., Fanchini, F. F., Malvezzi, A. L., Pereira, R. G., & Chaves, R. (2019) · Physical review. B./Physical review. B · doi:10.1103/physrevb.100.045129 · Cited by 97
Improving TCP Congestion Control with Machine Intelligence
Kong, Y., Zang, H., & Ma, X. (2018) · ACM SIGCOMM Workshop on Network Meets AI & ML (NetAI) · doi:10.1145/3229543.3229550 · Cited by 88
Self-citationns3-gym: Extending OpenAI Gym for Networking ResearchPreprint
Gawłowicz, P., & Zubow, A. (2018) · arXiv (Cornell University) · doi:10.13140/rg.2.2.19588.78721 · Cited by 82
Advances in quantum reinforcement learning
Dunjko, V., Taylor, J. M., & Briegel, H. J. (2017) · 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc.2017.8122616 · Cited by 81
Transformation of quantum states using uniformly controlled rotations
Möttönen, M. P., Vartiainen, J. J., Bergholm, V, & Salomaa, M. M. (2004) · CERN Document Server (European Organization for Nuclear Research) · Cited by 74
Projective Simulation for Classical Learning Agents: A Comprehensive Investigation
Mautner, J., Makmal, A., Manzano, D., Tiersch, M., & Briegel, H. J. (2015) · New Generation Computing · doi:10.1007/s00354-015-0102-0 · Cited by 58
Enhanced Adversarial Strategically-Timed Attacks Against Deep Reinforcement Learning
Yang, C.-H. H., Qi, J., Chen, P., Ouyang, Y., Hung, I.-T. D., Lee, C., & Ma, X. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053342 · Cited by 33
Self-citationFramework for learning agents in quantum environmentsPreprint
Dunjko, V., Taylor, J. M., & Briegel, H. J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.08482 · Cited by 31
Approximating power of machine-learning ansatz for quantum many-body states
Borin, A., & Abanin, D. A. (2020) · Physical review. B./Physical review. B · doi:10.1103/physrevb.101.195141 · Cited by 27
Reinforcement learning based interconnection routing for adaptive traffic optimization
Kao, S.-C., Yang, C.-H. H., Chen, P., Ma, X., & Krishna, T. (2019) · IEEE/ACM International Symposium on Networks-on-Chip (NOCS) · doi:10.1145/3313231.3352369 · Cited by 23
Self-citationThe Expressive Power of Parameterized Quantum CircuitsPreprint
Du, Y., Hsieh, M., Liu, T., & Tao, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11922 · Cited by 14
Cited by
Variational quantum algorithms
Cerezo, M., Arrasmith, A., Babbush, R., Benjamin, S. C., Endo, S., Fujii, K., McClean, J. R., Mitarai, K., Yuan, X., Cincio, L., et al. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00348-9 · Cited by 3,385
Noisy intermediate-scale quantum algorithms
Bharti, K., Cervera-Lierta, A., Kyaw, T. H., Haug, T., Alperin-Lea, S., Anand, A., Degroote, M., Heimonen, H., Kottmann, J. S., Menke, T., et al. (2022) · Reviews of Modern Physics · doi:10.1103/revmodphys.94.015004 · Cited by 2,231
Herman, D., Googin, C., Liu, X., Sun, Y., Galda, A., Safro, I., Pistoia, M., & Alexeev, Y. (2023) · Nature Reviews Physics · doi:10.1038/s42254-023-00603-1 · Cited by 284
Biology and medicine in the landscape of quantum advantages
Cordier, B. A., Sawaya, N. P. D., Guerreschi, G. G., & McWeeney, S. K. (2022) · Journal of The Royal Society Interface · doi:10.1098/rsif.2022.0541 · Cited by 87
QuGAN: A Quantum State Fidelity based Generative Adversarial Network
Stein, S. A., Baheri, B., Chen, D., Mao, Y., Guan, Q., Li, A., Fang, B., & Xu, S. (2021) · 2021 IEEE International Conference on Quantum Computing and Engineering (QCE) · doi:10.1109/qce52317.2021.00023 · Cited by 69
Metadata
- Authors
- Chen, S. Y.-C., Yang, C.-H. H., Qi, J., Chen, P.-Y., Ma, X., & Goan, H.-S.
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 141007-141024
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2955932731
- Cited by
- 452
- References
- 59
- FWCI
- 15.06
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.